-- Logs begin at Thu 2022-09-01 15:48:22 UTC, end at Thu 2022-09-01 16:49:26 UTC. -- Sep 01 16:17:53.186672 dv-cinder-852209-10-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 01 16:17:53.200879 dv-cinder-852209-10-smb devstack@keystone.service[81453]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 01 16:17:53.204065 dv-cinder-852209-10-smb devstack@keystone.service[81453]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 16:17:53 2022] *** Sep 01 16:17:53.204065 dv-cinder-852209-10-smb devstack@keystone.service[81453]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 16:17:53.204065 dv-cinder-852209-10-smb devstack@keystone.service[81453]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 16:17:53.204065 dv-cinder-852209-10-smb devstack@keystone.service[81453]: nodename: dv-cinder-852209-10-smb Sep 01 16:17:53.204065 dv-cinder-852209-10-smb devstack@keystone.service[81453]: machine: x86_64 Sep 01 16:17:53.204065 dv-cinder-852209-10-smb devstack@keystone.service[81453]: clock source: unix Sep 01 16:17:53.204065 dv-cinder-852209-10-smb devstack@keystone.service[81453]: pcre jit disabled Sep 01 16:17:53.204065 dv-cinder-852209-10-smb devstack@keystone.service[81453]: detected number of CPU cores: 4 Sep 01 16:17:53.204065 dv-cinder-852209-10-smb devstack@keystone.service[81453]: current working directory: / Sep 01 16:17:53.204065 dv-cinder-852209-10-smb devstack@keystone.service[81453]: detected binary path: /usr/bin/uwsgi-core Sep 01 16:17:53.204065 dv-cinder-852209-10-smb devstack@keystone.service[81453]: your processes number limit is 47680 Sep 01 16:17:53.204065 dv-cinder-852209-10-smb devstack@keystone.service[81453]: your memory page size is 4096 bytes Sep 01 16:17:53.204065 dv-cinder-852209-10-smb devstack@keystone.service[81453]: detected max file descriptor number: 2048 Sep 01 16:17:53.204065 dv-cinder-852209-10-smb devstack@keystone.service[81453]: lock engine: pthread robust mutexes Sep 01 16:17:53.204848 dv-cinder-852209-10-smb devstack@keystone.service[81453]: thunder lock: enabled Sep 01 16:17:53.204848 dv-cinder-852209-10-smb devstack@keystone.service[81453]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 01 16:17:53.204848 dv-cinder-852209-10-smb devstack@keystone.service[81453]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 16:17:53.248376 dv-cinder-852209-10-smb devstack@keystone.service[81453]: Python main interpreter initialized at 0x55bce79389c0 Sep 01 16:17:53.248376 dv-cinder-852209-10-smb devstack@keystone.service[81453]: python threads support enabled Sep 01 16:17:53.248376 dv-cinder-852209-10-smb devstack@keystone.service[81453]: your server socket listen backlog is limited to 100 connections Sep 01 16:17:53.248376 dv-cinder-852209-10-smb devstack@keystone.service[81453]: your mercy for graceful operations on workers is 90 seconds Sep 01 16:17:53.249003 dv-cinder-852209-10-smb devstack@keystone.service[81453]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 16:17:53.249003 dv-cinder-852209-10-smb devstack@keystone.service[81453]: *** Operational MODE: preforking *** Sep 01 16:17:53.249255 dv-cinder-852209-10-smb devstack@keystone.service[81453]: *** uWSGI is running in multiple interpreter mode *** Sep 01 16:17:53.249255 dv-cinder-852209-10-smb devstack@keystone.service[81453]: spawned uWSGI master process (pid: 81453) Sep 01 16:17:53.249457 dv-cinder-852209-10-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 01 16:17:53.256658 dv-cinder-852209-10-smb devstack@keystone.service[81453]: spawned uWSGI worker 1 (pid: 81459, cores: 1) Sep 01 16:17:53.256658 dv-cinder-852209-10-smb devstack@keystone.service[81453]: spawned uWSGI worker 2 (pid: 81460, cores: 1) Sep 01 16:17:53.256658 dv-cinder-852209-10-smb devstack@keystone.service[81453]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 16:17:57.912877 dv-cinder-852209-10-smb devstack@keystone.service[81460]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:17:57.912877 dv-cinder-852209-10-smb devstack@keystone.service[81460]: from cryptography.utils import int_from_bytes Sep 01 16:17:57.914009 dv-cinder-852209-10-smb devstack@keystone.service[81459]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:17:57.914009 dv-cinder-852209-10-smb devstack@keystone.service[81459]: from cryptography.utils import int_from_bytes Sep 01 16:17:57.914499 dv-cinder-852209-10-smb devstack@keystone.service[81460]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:17:57.914499 dv-cinder-852209-10-smb devstack@keystone.service[81460]: from cryptography.utils import int_from_bytes Sep 01 16:17:57.914732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:17:57.914732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: from cryptography.utils import int_from_bytes Sep 01 16:17:57.964413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 16:17:57.964743 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 16:17:57.964901 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] command line args: [] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 16:17:57.965051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 16:17:57.965231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ================================================================================ {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 16:17:57.965493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] admin_token = **** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.965744 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] config_dir = [] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.966014 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.966166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] config_source = [] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.966298 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] debug = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.966474 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.966874 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.967025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 16:17:57.967142 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.967255 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 16:17:57.967255 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] command line args: [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 16:17:57.967468 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.967578 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 16:17:57.967702 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.967822 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ================================================================================ {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 16:17:57.967946 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] list_limit = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.968055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] admin_token = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.968163 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] log_config_append = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.968163 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.968394 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] config_dir = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.968517 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] log_dir = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.968672 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.968807 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] log_file = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.968931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] config_source = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.969056 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.969181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] debug = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.969181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.969401 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.969520 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.969644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.969745 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.969855 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.969957 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.970049 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.970049 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.970252 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.970402 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.970562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.970562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_config_append = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.970783 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.970932 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.971062 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.971187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_dir = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.971300 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.971300 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.971503 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_file = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.971635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.971749 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.971878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.971878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.972092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.972216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.972335 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.972461 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.972461 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] publish_errors = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.972688 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.972825 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.972966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.973081 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.973204 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.973332 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.973457 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.973581 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.973693 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.973808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] standard_threads = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.974097 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.975173 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.975330 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.975330 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.975589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.975780 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] use_journal = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.975780 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] use_json = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.976095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.976231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] use_stderr = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.976231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] use_syslog = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.976231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.976719 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.976853 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.977056 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.977203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.977203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.977511 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.977640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.977640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.977640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.978074 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.978213 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.978213 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.978452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.978582 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.978582 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.978582 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.978582 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.979097 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.979230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.979373 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] publish_errors = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.979514 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.979514 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.979760 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.979900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.979900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.980151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.980271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.980411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.980539 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.980539 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.980892 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.981045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.981045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.981284 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.981487 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.981487 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.981799 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] standard_threads = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.981941 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.981941 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.982176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.982317 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.982317 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.982632 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.982761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.982761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.983006 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.983146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.983277 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] use_journal = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.983432 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.983572 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] use_json = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.983701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.983701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.983948 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] use_stderr = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.984077 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.984327 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] use_syslog = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.984462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.984462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.984734 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:17:57.984880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.984880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.985129 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.985260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.985260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.985492 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.985622 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.985622 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.985874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.986005 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.986005 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.986240 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.986371 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.986371 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.986622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.986748 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.986748 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.987002 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.987130 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.987261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.987404 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.987404 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.987656 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.987787 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.987916 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.988041 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.988190 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.988322 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.988491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.988661 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.988793 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.988978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.989118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.989319 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.989452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.989583 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.989713 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.989853 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.989984 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.990212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.990473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.990606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.990739 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.990871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.990871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.991120 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.991251 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.991381 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.991508 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.991652 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.991855 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.991990 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.992130 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.992332 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.992467 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.992645 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.992819 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.992956 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.993094 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.993273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.993414 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.993565 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.993735 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.993874 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.994004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.994206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.994345 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.994573 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.994710 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.994887 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.995068 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.995250 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.995473 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.995473 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.995811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.995981 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.996161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.996328 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.996328 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.996777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.996952 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.996952 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.997250 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.997390 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.997390 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.997956 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.998104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.998104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.998433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.998625 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.998760 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.998875 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.998875 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.999099 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.999274 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.999274 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.999569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.999707 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:57.999707 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.000598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.000758 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.000758 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.001056 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.001515 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.001515 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.001796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.001934 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.002066 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.002256 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] auth.external = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.002256 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.002577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.002719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.002719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.002961 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.003093 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] auth.password = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.003093 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] auth.token = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.003347 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.003481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.003623 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.003754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.003754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.003993 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.004135 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.004135 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.004355 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.004550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.004550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.004903 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.005055 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] credential.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.005055 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.005285 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.005415 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.005415 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.005415 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.005832 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.005968 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.006101 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.006232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.006232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.006468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.006675 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.006675 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.006921 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.007054 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.007184 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.007313 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.007627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.007627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.007962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.008096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.008096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.008337 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.008462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] federation.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.008605 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.008745 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.008877 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.009024 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.009148 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.009290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.009512 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.009652 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.009784 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.009998 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.010137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.010269 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.010485 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.010627 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.010767 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.010899 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.011032 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.011191 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.011366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.011505 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.011681 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.011817 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.011949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.012138 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.012282 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.012416 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.012602 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.012771 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.012906 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.013270 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.013418 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.013552 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.013707 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.013851 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.013851 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.014086 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.014229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.014373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.014517 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.014649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.014786 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.014967 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.015105 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.015235 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.016045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.016193 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.016330 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.016520 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.016731 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.016867 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.017021 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.017189 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.017339 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.017472 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.017649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.017803 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.017949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.018079 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.018210 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.018372 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.018516 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.018650 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.018867 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.019009 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.019142 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.019338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.019629 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.019761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.019910 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.020040 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.020174 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.020308 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.020487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.020659 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.020816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.020965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.021108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.021282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.021487 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.021622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.021772 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.021905 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.022052 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.022192 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.022370 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.022625 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.022781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.022916 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.023048 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.023181 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.023313 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.023481 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.023638 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.023770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.023926 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.024067 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.024252 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.024389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.024535 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.024754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.024888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.025033 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.025222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.025381 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.025629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.025765 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.025896 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.026029 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.026157 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.026287 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.026433 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.026565 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.026696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.026829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.026999 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.027139 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.027288 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.027421 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.027557 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.027732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.027868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.028015 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.028204 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.028342 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.028476 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.028691 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.028831 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.028984 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.029117 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.029259 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.029393 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.029522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.029640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.029859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.030011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.030146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.030333 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.030457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.030590 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.030770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.030913 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.031046 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.031253 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.031398 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.031529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.031724 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.031867 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.032000 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.032183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.032326 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.032466 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] resource.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.032742 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.032889 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.033023 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.033134 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.033251 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.033384 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.033649 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.033793 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.033927 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.034107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.external = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.034252 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.034387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.034565 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.034704 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.034847 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] role.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.035037 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] role.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.035177 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.035315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.035506 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.035660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.035795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.035929 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.password = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.036061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.036239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.036391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.token = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.036525 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.036753 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.036894 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.037030 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.037192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.037353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.037487 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.037647 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.037790 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.037926 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.038057 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.038214 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.038400 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.038539 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.038856 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.039013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.039148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.039292 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.039426 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.039560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.039673 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.039806 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.040042 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.040183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.040315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.040512 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.040685 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.040805 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.040991 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.041135 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.041267 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.041430 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.041572 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.041704 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.041914 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.042052 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.042186 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.042313 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.042448 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.042642 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.042798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.042934 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.043102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.043238 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.043371 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] token.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.043566 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.043719 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.043853 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.044020 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.044161 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.044292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.044519 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.044772 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.044772 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.045020 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.045622 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.045622 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.045874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.046023 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.046023 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.046277 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.046409 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.046409 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.046676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.046823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.046823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.047035 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.047148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.047281 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.047412 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.047412 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.051417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.051621 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.connection = **** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.051621 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.051955 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.052132 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.052311 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.052500 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.052500 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.052858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.053042 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.053223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.053398 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.053398 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.053748 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.053933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.053933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.054260 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.054433 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.055496 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.055642 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.055642 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.055890 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.056026 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.056177 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.056296 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.056296 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.056508 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.056651 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.056651 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.057017 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.057154 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.057154 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 16:17:58.057401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.057401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.057401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.057401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.057401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.057401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.057401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.057401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.057401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.058349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.058349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.058349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.058349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.058349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.058876 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.058876 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.059285 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.059696 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.060064 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.060507 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.060913 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.061306 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.061670 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.062018 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.062951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.063489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.063826 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.064232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.064583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.064952 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.065324 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.065730 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.066189 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.066543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.066875 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.067215 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.067553 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.067961 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.068358 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.068759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.069192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.069665 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.069997 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.070328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.070681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.071038 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.071376 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.071711 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.072045 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.072372 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.072755 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.073123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.073449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.073794 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.074144 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.074488 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.074822 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.075156 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.075489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.075822 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.076155 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.076483 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.076887 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.077242 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.077585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.078514 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.078872 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.079293 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.079669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.080143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.080347 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.080974 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.081383 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.081752 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.082313 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.082700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.083134 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.083567 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.084025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.084460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.084959 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.085360 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.085509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.085626 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.085802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.086073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.086526 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.086921 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.087186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.087448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.087717 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.087983 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.088238 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.088594 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.088987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.089328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.089678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.090015 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.090363 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.090702 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] role.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.091044 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] role.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.091371 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.091715 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.092065 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.092420 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.092826 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.093174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.094074 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.094420 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.094781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.095113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.095445 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.095602 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.095856 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.096202 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.096554 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.097133 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.097468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.097817 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.098165 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.098509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.098866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.099232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.099585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.099931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.100268 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.100668 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.101002 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.101337 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.101684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.102038 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.102384 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.102719 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.103065 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.103389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.103721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.104053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.104393 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.104775 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.105141 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.105487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.105826 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.106166 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.106505 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.106851 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.107191 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.107525 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.107881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.108228 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.108602 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.108988 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.109994 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.110372 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.110752 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.connection = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.111095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.111440 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.111774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.112113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.112454 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.112826 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.113158 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.113491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.113841 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.114173 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.114522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.114856 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.115202 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.115652 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.116063 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.116396 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.116974 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.117373 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:17:58.117686 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 16:17:58.126357 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.126612 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.146284 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.146569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.146715 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.156324 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.177339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.177585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.182900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.221204 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.238086 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.238349 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.259628 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.259920 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.308936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.309206 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.309351 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.309586 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.309801 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.310020 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.339078 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.339340 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.339517 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.339744 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.339966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.340189 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.340408 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.401917 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.402188 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.402380 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.402552 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.402779 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.402996 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.419470 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.419819 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.420154 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.420464 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.420947 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.421258 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.421564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.431865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.447637 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.447886 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.448067 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.448294 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.448518 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.448771 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.448996 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.451711 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.455568 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.455879 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.456172 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.456459 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.456777 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.457052 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.457347 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:17:58.467838 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.468097 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 16:17:58.468389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.469211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 16:17:58.469361 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.469535 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.469671 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 16:17:58.469801 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.469990 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.470122 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.470264 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.470386 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 16:17:58.470689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.471021 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.471347 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.471674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.480579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.480909 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.481203 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.481497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.482011 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.482375 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.482723 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.483095 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.489413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.491360 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.492665 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.492944 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.493241 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.493536 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.493861 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.494133 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.494440 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.494726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.495008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.495158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.495300 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.495531 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.495676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.495955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.496268 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.496648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.496986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.497331 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.497933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.498271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.498747 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.499085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.520875 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.522473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.522766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.523383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.525217 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.525578 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.527479 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.527769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.528065 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.530735 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.531129 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.531480 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.534829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.535127 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.538290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.538661 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.539234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.539665 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.539829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.540130 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.540425 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.542942 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.543240 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.543616 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.543762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.544016 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.544367 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.544774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.545121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.545464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.545797 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.546135 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.560349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.560647 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.563469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.563937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.565292 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.568082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.568590 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.568930 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.571721 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.572107 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.573627 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.576704 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.577102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.580267 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.580489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.580873 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.581062 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.581360 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.581790 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.582207 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.584259 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.584653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.585032 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.585389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.585746 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.586100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.598812 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.599235 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.599596 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.599978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.603327 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.603775 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.604154 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.604515 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.607443 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.609897 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.611572 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.611920 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.614402 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.615167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.615526 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.615884 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.616253 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.616437 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.616699 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.618287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.618670 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.621585 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.621981 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.622506 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.623139 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.623511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.630092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.630475 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.630833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.631193 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.631563 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.631920 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.632300 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.636554 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.637165 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.637757 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.638142 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.638576 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.638989 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.639366 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.649800 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.653311 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.657089 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.657301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.658881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.660454 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.660657 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.660885 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.661248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.663854 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.665530 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.667312 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.667707 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.668111 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.668576 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.670265 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.674008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.674387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.674744 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.675116 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.676093 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.677811 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.681262 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.681609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.681996 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.682321 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.684605 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.685048 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.685470 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.690302 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.690624 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.690899 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.693188 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.693512 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.693859 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.694099 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.694380 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.694660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.695084 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.695387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.695678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.695974 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.696266 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.696518 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.696824 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.697102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.698193 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:17:58.698364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.698666 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.698968 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.699222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.699517 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.699795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.700067 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.700364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.700668 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.700930 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.701212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.701480 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.701751 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:17:58.734769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bce79389c0 pid: 81459 (default app) Sep 01 16:17:58.736503 dv-cinder-852209-10-smb devstack@keystone.service[81460]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bce79389c0 pid: 81460 (default app) Sep 01 16:17:58.738661 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b9bd8-e51a-479d-88c6-ee6f224e00ae None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:58.738950 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b9bd8-e51a-479d-88c6-ee6f224e00ae None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:58.739227 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b9bd8-e51a-479d-88c6-ee6f224e00ae None None] PATH_INFO: `/v3` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:58.743959 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 791 bytes} [Thu Sep 1 16:17:58 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:05.817002 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165222e4-80f6-42a9-9544-f3a189545250 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:05.817907 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165222e4-80f6-42a9-9544-f3a189545250 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:05.817907 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165222e4-80f6-42a9-9544-f3a189545250 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:05.822019 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1/2] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:18:05.828008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8a51b-afa8-4417-9d86-46ab0042dd29 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:05.829277 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8a51b-afa8-4417-9d86-46ab0042dd29 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:05.829277 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8a51b-afa8-4417-9d86-46ab0042dd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:05.901772 dv-cinder-852209-10-smb devstack@keystone.service[81459]: INFO dbcounter [None req-54b8a51b-afa8-4417-9d86-46ab0042dd29 None None] Registered counter for database keystone Sep 01 16:18:05.922500 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG oslo_db.sqlalchemy.engines [None req-54b8a51b-afa8-4417-9d86-46ab0042dd29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:18:05.929397 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writer thread running {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:18:06.133169 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG passlib.handlers.bcrypt [None req-54b8a51b-afa8-4417-9d86-46ab0042dd29 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81459) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 16:18:06.133474 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG passlib.handlers.bcrypt [None req-54b8a51b-afa8-4417-9d86-46ab0042dd29 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81459) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 16:18:06.195171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-54b8a51b-afa8-4417-9d86-46ab0042dd29 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:06.196909 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-54b8a51b-afa8-4417-9d86-46ab0042dd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:06.347356 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 2/3] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 520 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 01 16:18:06.884442 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165222e4-80f6-42a9-9544-f3a189545250 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:06.959538 dv-cinder-852209-10-smb devstack@keystone.service[81460]: INFO dbcounter [None req-165222e4-80f6-42a9-9544-f3a189545250 None None] Registered counter for database keystone Sep 01 16:18:06.982735 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG oslo_db.sqlalchemy.engines [None req-165222e4-80f6-42a9-9544-f3a189545250 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81460) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:18:06.990192 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writer thread running {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:18:07.121811 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165222e4-80f6-42a9-9544-f3a189545250 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:07.127607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1b617-9f3c-4216-b0df-14355ea461fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:07.128366 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1b617-9f3c-4216-b0df-14355ea461fd admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:07.128779 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1b617-9f3c-4216-b0df-14355ea461fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:07.129129 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1b617-9f3c-4216-b0df-14355ea461fd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:07.138760 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1b617-9f3c-4216-b0df-14355ea461fd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:07.191617 dv-cinder-852209-10-smb devstack@keystone.service[81460]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cdb1b617-9f3c-4216-b0df-14355ea461fd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 16:18:07.192002 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1b617-9f3c-4216-b0df-14355ea461fd admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:07.203089 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 2/4] 10.222.0.52 () {58 vars in 1324 bytes} [Thu Sep 1 16:18:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 16:18:07.209556 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8a51b-afa8-4417-9d86-46ab0042dd29 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:07.226379 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8a51b-afa8-4417-9d86-46ab0042dd29 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:07.230988 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e093af-8f0d-405c-aa70-3d6a8ae773ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:07.232144 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e093af-8f0d-405c-aa70-3d6a8ae773ee admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:07.232427 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e093af-8f0d-405c-aa70-3d6a8ae773ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:07.232741 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e093af-8f0d-405c-aa70-3d6a8ae773ee admin admin] PATH_INFO: `/v3/projects/3ac22d8b2a234cb4ae28b76d9f5e893d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:07.234408 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e093af-8f0d-405c-aa70-3d6a8ae773ee admin admin] RBAC: Authorizing `identity:get_project(project_id=3ac22d8b2a234cb4ae28b76d9f5e893d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:07.289433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: WARNING keystone.common.rbac_enforcer.enforcer [None req-23e093af-8f0d-405c-aa70-3d6a8ae773ee admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 16:18:07.289808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e093af-8f0d-405c-aa70-3d6a8ae773ee admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:07.294911 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 3/5] 10.222.0.52 () {56 vars in 1207 bytes} [Thu Sep 1 16:18:07 2022] GET /identity/v3/projects/3ac22d8b2a234cb4ae28b76d9f5e893d => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:09.320425 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4502f-5e96-40fc-ac0f-b4532cf391b8 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:09.321050 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4502f-5e96-40fc-ac0f-b4532cf391b8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:09.321050 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4502f-5e96-40fc-ac0f-b4532cf391b8 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:09.325224 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 3/6] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:09.331725 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb874df8-76ff-407a-b750-9d82045df42e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:09.332279 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb874df8-76ff-407a-b750-9d82045df42e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:09.332279 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb874df8-76ff-407a-b750-9d82045df42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:09.355082 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-cb874df8-76ff-407a-b750-9d82045df42e None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:09.356734 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cb874df8-76ff-407a-b750-9d82045df42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:09.366865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 4/7] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 01 16:18:09.805999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4502f-5e96-40fc-ac0f-b4532cf391b8 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:09.820341 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4502f-5e96-40fc-ac0f-b4532cf391b8 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:09.826048 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdea684-9d1c-46e7-84bb-2b7061275ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:09.826716 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdea684-9d1c-46e7-84bb-2b7061275ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:09.827005 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdea684-9d1c-46e7-84bb-2b7061275ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:09.827285 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdea684-9d1c-46e7-84bb-2b7061275ab2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:09.836938 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdea684-9d1c-46e7-84bb-2b7061275ab2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:09.838825 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdea684-9d1c-46e7-84bb-2b7061275ab2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:09.849613 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 4/8] 10.222.0.52 () {58 vars in 1324 bytes} [Thu Sep 1 16:18:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 16:18:09.856487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb874df8-76ff-407a-b750-9d82045df42e None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:09.873177 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb874df8-76ff-407a-b750-9d82045df42e None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:09.878496 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a27b2-7859-49b7-9abb-ac9a752d1ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:09.879213 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a27b2-7859-49b7-9abb-ac9a752d1ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:09.879552 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a27b2-7859-49b7-9abb-ac9a752d1ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:09.879875 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a27b2-7859-49b7-9abb-ac9a752d1ee3 admin admin] PATH_INFO: `/v3/users/2b43f72ae2234a7eb9bf83a968fd7292` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:09.881560 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a27b2-7859-49b7-9abb-ac9a752d1ee3 admin admin] RBAC: Authorizing `identity:get_user(user_id=2b43f72ae2234a7eb9bf83a968fd7292)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:09.883642 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a27b2-7859-49b7-9abb-ac9a752d1ee3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:09.885645 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 5/9] 10.222.0.52 () {56 vars in 1198 bytes} [Thu Sep 1 16:18:09 2022] GET /identity/v3/users/2b43f72ae2234a7eb9bf83a968fd7292 => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:12.011111 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64581db-a291-4041-be6d-4afd13c058ef None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:12.011677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64581db-a291-4041-be6d-4afd13c058ef None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:12.012084 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64581db-a291-4041-be6d-4afd13c058ef None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:12.014672 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 5/10] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:12.023112 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f67073-3225-4259-a99c-328d0a2e4d43 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:12.023914 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f67073-3225-4259-a99c-328d0a2e4d43 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:12.024191 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f67073-3225-4259-a99c-328d0a2e4d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:12.045855 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-53f67073-3225-4259-a99c-328d0a2e4d43 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:12.047249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-53f67073-3225-4259-a99c-328d0a2e4d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:12.077498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0bec7-2c03-46f9-8237-a4cd80108f15 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:12.077847 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0bec7-2c03-46f9-8237-a4cd80108f15 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:12.078219 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0bec7-2c03-46f9-8237-a4cd80108f15 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:12.080831 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 6/11] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:18:12.088675 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b80efa-bbd1-4f7e-bacb-e963bf6af134 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:12.089096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b80efa-bbd1-4f7e-bacb-e963bf6af134 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:12.089465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b80efa-bbd1-4f7e-bacb-e963bf6af134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:12.146776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG passlib.handlers.bcrypt [None req-80b80efa-bbd1-4f7e-bacb-e963bf6af134 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81460) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 16:18:12.147357 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG passlib.handlers.bcrypt [None req-80b80efa-bbd1-4f7e-bacb-e963bf6af134 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81460) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 16:18:12.161466 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 6/12] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:12.203044 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-80b80efa-bbd1-4f7e-bacb-e963bf6af134 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:12.206550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-80b80efa-bbd1-4f7e-bacb-e963bf6af134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:12.323780 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 7/13] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:18:12.593377 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f67073-3225-4259-a99c-328d0a2e4d43 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:12.608579 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b80efa-bbd1-4f7e-bacb-e963bf6af134 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:12.637003 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:12.758621 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f67073-3225-4259-a99c-328d0a2e4d43 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:12.764942 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b80efa-bbd1-4f7e-bacb-e963bf6af134 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:12.770225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:12.814549 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6042f-fca7-40c1-b3e8-9488005a49ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:12.815548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6042f-fca7-40c1-b3e8-9488005a49ef None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:12.815999 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6042f-fca7-40c1-b3e8-9488005a49ef None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:12.816444 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6042f-fca7-40c1-b3e8-9488005a49ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:12.825229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760d951-6ff2-4607-80b1-8ff26a8220cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:12.826632 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760d951-6ff2-4607-80b1-8ff26a8220cf None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:12.827067 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760d951-6ff2-4607-80b1-8ff26a8220cf None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:12.827508 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760d951-6ff2-4607-80b1-8ff26a8220cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:12.838409 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6042f-fca7-40c1-b3e8-9488005a49ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:12.849364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-77b6042f-fca7-40c1-b3e8-9488005a49ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:12.849364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:12.849364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:12.849364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:12.849364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:12.849364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:12.849364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:12.849364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:12.849364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:12.849364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:12.849364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:12.849364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:12.849364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:12.849364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:12.849364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:12.849364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:12.851172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:12.851172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:12.851172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:12.851172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:12.851172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:12.851172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:12.851172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:12.851172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:12.851172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:12.851172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:12.851172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:12.851172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:12.851172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:12.851172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:12.851172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:12.851172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:12.853218 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:12.853218 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:12.853218 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:12.853218 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:12.853218 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:12.853218 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:12.853218 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:12.853218 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:12.853218 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:12.853218 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:12.853218 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:12.853218 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:18:12.853218 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 7/14] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:18:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:12.857839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6042f-fca7-40c1-b3e8-9488005a49ef None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:12.937016 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0760d951-6ff2-4607-80b1-8ff26a8220cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:12.939765 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0760d951-6ff2-4607-80b1-8ff26a8220cf None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:12.976232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:13.006448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6042f-fca7-40c1-b3e8-9488005a49ef None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:13.054824 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851f4d9-ab24-474d-a9f9-ce0392a14e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:13.055790 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851f4d9-ab24-474d-a9f9-ce0392a14e0f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:13.056248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851f4d9-ab24-474d-a9f9-ce0392a14e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:13.056754 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851f4d9-ab24-474d-a9f9-ce0392a14e0f None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:13.057770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851f4d9-ab24-474d-a9f9-ce0392a14e0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:13.058275 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851f4d9-ab24-474d-a9f9-ce0392a14e0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:13.060695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851f4d9-ab24-474d-a9f9-ce0392a14e0f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:13.081068 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 8/15] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:13.086852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851f4d9-ab24-474d-a9f9-ce0392a14e0f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:13.103911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 8/16] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 16:18:13.112043 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760d951-6ff2-4607-80b1-8ff26a8220cf None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:13.117392 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:13.226395 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851f4d9-ab24-474d-a9f9-ce0392a14e0f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:13.249857 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760d951-6ff2-4607-80b1-8ff26a8220cf None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:13.285389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dd1eb-f64e-4271-b86f-e861e10e4208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:13.286254 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dd1eb-f64e-4271-b86f-e861e10e4208 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:13.286623 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dd1eb-f64e-4271-b86f-e861e10e4208 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:13.287009 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dd1eb-f64e-4271-b86f-e861e10e4208 None admin] PATH_INFO: `/v3/users/2b43f72ae2234a7eb9bf83a968fd7292` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:13.288790 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21dd1eb-f64e-4271-b86f-e861e10e4208 None admin] RBAC: Authorizing `identity:get_user(user_id=2b43f72ae2234a7eb9bf83a968fd7292)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:13.291359 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21dd1eb-f64e-4271-b86f-e861e10e4208 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:13.299694 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 9/17] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:13 2022] GET /identity/v3/users/2b43f72ae2234a7eb9bf83a968fd7292 => generated 247 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:13.299930 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6e51a-d08f-4f45-8d4b-fa3a0842472a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:13.299930 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6e51a-d08f-4f45-8d4b-fa3a0842472a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:13.300191 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6e51a-d08f-4f45-8d4b-fa3a0842472a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:13.300366 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6e51a-d08f-4f45-8d4b-fa3a0842472a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:13.301274 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dd1eb-f64e-4271-b86f-e861e10e4208 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:13.319535 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:13.326532 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6e51a-d08f-4f45-8d4b-fa3a0842472a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:13.329629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6e51a-d08f-4f45-8d4b-fa3a0842472a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:13.354225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-f1a6e51a-d08f-4f45-8d4b-fa3a0842472a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:18:13.354225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:13.354225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:13.354225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:13.354225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:13.354225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:13.354225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:13.354225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:13.354225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:13.354225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:13.354225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:13.354225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:13.354225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:18:13.354225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:18:13.354225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:18:13.354225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:18:13.355348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:13.355348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:13.355348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:13.355348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:13.355348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:13.355348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:13.355348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:13.355348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:13.355348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:13.355348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:13.355348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:13.355348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:13.355348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:13.355348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:13.355348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:13.355348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:13.355348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:18:13.356735 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:18:13.356735 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:18:13.356735 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:18:13.356735 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 9/18] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:13.361906 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6e51a-d08f-4f45-8d4b-fa3a0842472a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:13.441843 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:13.465546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dd1eb-f64e-4271-b86f-e861e10e4208 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:13.503221 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6e51a-d08f-4f45-8d4b-fa3a0842472a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:13.519071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433b620-76e6-47a5-bb01-10da0b87849a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:13.519722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433b620-76e6-47a5-bb01-10da0b87849a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:13.519997 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433b620-76e6-47a5-bb01-10da0b87849a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:13.520268 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433b620-76e6-47a5-bb01-10da0b87849a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:13.521509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4433b620-76e6-47a5-bb01-10da0b87849a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:13.523359 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4433b620-76e6-47a5-bb01-10da0b87849a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:13.525161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 10/19] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:13.531228 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433b620-76e6-47a5-bb01-10da0b87849a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:13.567281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deffdec-33bc-43ea-82b9-d55c12cc3d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:13.568222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deffdec-33bc-43ea-82b9-d55c12cc3d3b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:13.568863 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deffdec-33bc-43ea-82b9-d55c12cc3d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:13.569189 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deffdec-33bc-43ea-82b9-d55c12cc3d3b None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:13.570028 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deffdec-33bc-43ea-82b9-d55c12cc3d3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:13.570442 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deffdec-33bc-43ea-82b9-d55c12cc3d3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:13.572166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deffdec-33bc-43ea-82b9-d55c12cc3d3b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:13.601899 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 10/20] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:13.636563 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:13.668194 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433b620-76e6-47a5-bb01-10da0b87849a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:13.715241 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af9ba2-721f-4ef9-8e6c-e4f5032e621e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:13.715963 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af9ba2-721f-4ef9-8e6c-e4f5032e621e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:13.716315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af9ba2-721f-4ef9-8e6c-e4f5032e621e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:13.716673 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af9ba2-721f-4ef9-8e6c-e4f5032e621e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:13.717537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af9ba2-721f-4ef9-8e6c-e4f5032e621e None admin] RBAC: Adding query filter params (role.id=a8896546a02c42489ef73c7ad7c43542, scope.domain.id=default, user.id=2b43f72ae2234a7eb9bf83a968fd7292) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:13.717939 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af9ba2-721f-4ef9-8e6c-e4f5032e621e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:13.720186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af9ba2-721f-4ef9-8e6c-e4f5032e621e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:13.729142 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 11/21] 10.222.0.52 () {56 vars in 1322 bytes} [Thu Sep 1 16:18:13 2022] GET /identity/v3/role_assignments?user.id=2b43f72ae2234a7eb9bf83a968fd7292&scope.domain.id=default&role.id=a8896546a02c42489ef73c7ad7c43542 => generated 233 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:15.842100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c927d6c-4a0e-461a-b49a-c5db4aeb0fb5 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:15.843149 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c927d6c-4a0e-461a-b49a-c5db4aeb0fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:15.843667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c927d6c-4a0e-461a-b49a-c5db4aeb0fb5 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:15.845971 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 11/22] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:15.851952 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf567b90-f4ad-4457-9eca-0405e27f6d26 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:15.852478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf567b90-f4ad-4457-9eca-0405e27f6d26 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:15.852478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf567b90-f4ad-4457-9eca-0405e27f6d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:15.882755 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-bf567b90-f4ad-4457-9eca-0405e27f6d26 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:15.883992 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bf567b90-f4ad-4457-9eca-0405e27f6d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:15.994189 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 12/23] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:18:16.543569 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c927d6c-4a0e-461a-b49a-c5db4aeb0fb5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:16.816699 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c927d6c-4a0e-461a-b49a-c5db4aeb0fb5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:16.860297 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:16.907188 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae78ef4-26cf-42ef-8756-1d1309b1a20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:16.907860 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae78ef4-26cf-42ef-8756-1d1309b1a20b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:16.908143 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae78ef4-26cf-42ef-8756-1d1309b1a20b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:16.908417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae78ef4-26cf-42ef-8756-1d1309b1a20b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:16.932366 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae78ef4-26cf-42ef-8756-1d1309b1a20b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:16.939972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-fae78ef4-26cf-42ef-8756-1d1309b1a20b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:16.939972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:16.939972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:16.939972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:16.939972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:16.939972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:16.939972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:16.939972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:16.939972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:16.939972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:16.939972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:16.939972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:16.939972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:16.939972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:16.939972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:16.939972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:16.942197 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:16.942197 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:16.942197 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:16.942197 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:16.942197 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:16.942197 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:16.942197 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:16.942197 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:16.942197 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:16.942197 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:16.942197 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:16.942197 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:16.942197 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:16.942197 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:16.942197 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:16.942197 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:16.943914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:16.943914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:16.943914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:16.943914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:16.943914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:16.943914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:16.943914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:16.943914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:16.943914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:16.943914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:16.943914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:16.943914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:18:16.943914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 12/24] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:18:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:18:16.952484 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf567b90-f4ad-4457-9eca-0405e27f6d26 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:17.086334 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:17.129531 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf567b90-f4ad-4457-9eca-0405e27f6d26 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:17.178293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d82deb-f548-48ec-9216-395acbc4e72f None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:17.178579 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d82deb-f548-48ec-9216-395acbc4e72f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:17.178877 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d82deb-f548-48ec-9216-395acbc4e72f None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:17.180308 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 13/25] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:17.190254 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea62467-ce42-4304-8626-0501062168ad None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:17.190510 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea62467-ce42-4304-8626-0501062168ad None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:17.190802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea62467-ce42-4304-8626-0501062168ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:17.217336 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126c35c-1da1-433b-a418-3fcd08931f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:17.218488 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126c35c-1da1-433b-a418-3fcd08931f1b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:17.219009 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126c35c-1da1-433b-a418-3fcd08931f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:17.219550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126c35c-1da1-433b-a418-3fcd08931f1b None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:17.220830 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126c35c-1da1-433b-a418-3fcd08931f1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:17.221390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126c35c-1da1-433b-a418-3fcd08931f1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:17.222017 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-fea62467-ce42-4304-8626-0501062168ad None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:17.223271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fea62467-ce42-4304-8626-0501062168ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:17.224192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126c35c-1da1-433b-a418-3fcd08931f1b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:17.251267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 13/26] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:17.257761 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126c35c-1da1-433b-a418-3fcd08931f1b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:17.438677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 14/27] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:17.513535 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126c35c-1da1-433b-a418-3fcd08931f1b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:17.591340 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22672b4-26f3-486c-876f-166b00fe347c None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:17.591686 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22672b4-26f3-486c-876f-166b00fe347c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:17.591921 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22672b4-26f3-486c-876f-166b00fe347c None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:17.593562 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 15/28] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:17.593894 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a9a95-0187-451e-8c93-25e0152ac3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:17.595210 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a9a95-0187-451e-8c93-25e0152ac3fb None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:17.595667 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a9a95-0187-451e-8c93-25e0152ac3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:17.596159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a9a95-0187-451e-8c93-25e0152ac3fb None admin] PATH_INFO: `/v3/users/2b43f72ae2234a7eb9bf83a968fd7292` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:17.599005 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a9a95-0187-451e-8c93-25e0152ac3fb None admin] RBAC: Authorizing `identity:get_user(user_id=2b43f72ae2234a7eb9bf83a968fd7292)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:17.601956 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a9a95-0187-451e-8c93-25e0152ac3fb None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:17.605403 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 14/29] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:17 2022] GET /identity/v3/users/2b43f72ae2234a7eb9bf83a968fd7292 => generated 247 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:17.606152 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0c51f-678f-424b-b9f0-6fd6a43aa532 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:17.606442 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0c51f-678f-424b-b9f0-6fd6a43aa532 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:17.606723 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0c51f-678f-424b-b9f0-6fd6a43aa532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:17.611506 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a9a95-0187-451e-8c93-25e0152ac3fb None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:17.618449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:17.649810 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-74d0c51f-678f-424b-b9f0-6fd6a43aa532 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:17.651048 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-74d0c51f-678f-424b-b9f0-6fd6a43aa532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:17.730708 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 16/30] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:17.731953 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c30ca-b00f-4284-911e-ada0aa0be94c None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:17.732278 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c30ca-b00f-4284-911e-ada0aa0be94c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:17.732511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c30ca-b00f-4284-911e-ada0aa0be94c None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:17.734159 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 17/31] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:17.740224 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6578135-c25d-486c-a8db-ee3f845c1241 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:17.740515 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6578135-c25d-486c-a8db-ee3f845c1241 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:17.740814 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6578135-c25d-486c-a8db-ee3f845c1241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:17.762347 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f6578135-c25d-486c-a8db-ee3f845c1241 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:17.763660 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f6578135-c25d-486c-a8db-ee3f845c1241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:17.802119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:17.851260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 18/32] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:17.909845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a9a95-0187-451e-8c93-25e0152ac3fb None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:17.944140 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6578135-c25d-486c-a8db-ee3f845c1241 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:18.015847 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a92ca4-af41-4e77-9d9f-c5fccd2ec6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:18.018173 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a92ca4-af41-4e77-9d9f-c5fccd2ec6a0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:18.018482 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a92ca4-af41-4e77-9d9f-c5fccd2ec6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:18.019096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a92ca4-af41-4e77-9d9f-c5fccd2ec6a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:18.020591 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a92ca4-af41-4e77-9d9f-c5fccd2ec6a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:18.027854 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a92ca4-af41-4e77-9d9f-c5fccd2ec6a0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:18.029935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 15/33] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:18.037202 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a92ca4-af41-4e77-9d9f-c5fccd2ec6a0 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:18.203538 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6578135-c25d-486c-a8db-ee3f845c1241 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:18.241627 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:18.245028 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5faeb3-2614-4e65-99ac-728458f3ef7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:18.245891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5faeb3-2614-4e65-99ac-728458f3ef7b None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:18.246319 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5faeb3-2614-4e65-99ac-728458f3ef7b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:18.246789 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5faeb3-2614-4e65-99ac-728458f3ef7b None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:18.247648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5faeb3-2614-4e65-99ac-728458f3ef7b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:18.249540 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5faeb3-2614-4e65-99ac-728458f3ef7b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:18.287354 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a92ca4-af41-4e77-9d9f-c5fccd2ec6a0 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:18.329826 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d79e17-98b3-4a9a-8bc6-e923196ac60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:18.330744 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d79e17-98b3-4a9a-8bc6-e923196ac60f None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:18.331184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d79e17-98b3-4a9a-8bc6-e923196ac60f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:18.331628 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d79e17-98b3-4a9a-8bc6-e923196ac60f None admin] PATH_INFO: `/v3/domains/default/users/2b43f72ae2234a7eb9bf83a968fd7292/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:18.333951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d79e17-98b3-4a9a-8bc6-e923196ac60f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2b43f72ae2234a7eb9bf83a968fd7292, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:18.335705 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d79e17-98b3-4a9a-8bc6-e923196ac60f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:18.391237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 19/34] 10.222.0.52 () {60 vars in 1131 bytes} [Thu Sep 1 16:18:17 2022] POST /identity/v3/roles => generated 225 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:18:18.392967 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5faeb3-2614-4e65-99ac-728458f3ef7b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:18.435037 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:18.481516 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 16/35] 10.222.0.52 () {58 vars in 1361 bytes} [Thu Sep 1 16:18:18 2022] PUT /identity/v3/domains/default/users/2b43f72ae2234a7eb9bf83a968fd7292/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:18:18.483567 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5c46f-ddde-4a19-bb61-28eaa0a86c57 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:18.483965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5c46f-ddde-4a19-bb61-28eaa0a86c57 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:18.484325 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5c46f-ddde-4a19-bb61-28eaa0a86c57 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:18.490455 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 17/36] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:18.496198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5c46f-ddde-4a19-bb61-28eaa0a86c57 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:18.550037 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5faeb3-2614-4e65-99ac-728458f3ef7b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:18.601815 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979050d3-201f-4bf5-92f3-267d0d948613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:18.602750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979050d3-201f-4bf5-92f3-267d0d948613 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:18.603213 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979050d3-201f-4bf5-92f3-267d0d948613 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:18.603639 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979050d3-201f-4bf5-92f3-267d0d948613 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:18.617430 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979050d3-201f-4bf5-92f3-267d0d948613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:18.620552 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979050d3-201f-4bf5-92f3-267d0d948613 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:18.654356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-979050d3-201f-4bf5-92f3-267d0d948613 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:18:18.654356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:18.654356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:18.654356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:18.654356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:18.654356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:18.654356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:18.654356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:18.654356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:18.654356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:18.654356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:18.654356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:18.654356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:18:18.654356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:18:18.654356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:18:18.654356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:18:18.656265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:18.656265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:18.656265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:18.656265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:18.656265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:18.656265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:18.656265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:18.656265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:18.656265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:18.656265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:18.656265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:18.656265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:18.656265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:18.656265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:18.656265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:18.656265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:18.656265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:18:18.658090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:18:18.658090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:18:18.658090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:18:18.660996 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 20/37] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:18.663945 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778402b3-19cd-4b8d-aea9-6ba842579d7f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:18.664352 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778402b3-19cd-4b8d-aea9-6ba842579d7f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:18.664789 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778402b3-19cd-4b8d-aea9-6ba842579d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:18.691911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-778402b3-19cd-4b8d-aea9-6ba842579d7f None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:18.693601 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-778402b3-19cd-4b8d-aea9-6ba842579d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:18.712137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5c46f-ddde-4a19-bb61-28eaa0a86c57 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:18.767063 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:18.776461 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbe648-3143-4498-8bfc-0c5cd871bca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:18.777174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbe648-3143-4498-8bfc-0c5cd871bca6 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:18.777479 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbe648-3143-4498-8bfc-0c5cd871bca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:18.777620 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbe648-3143-4498-8bfc-0c5cd871bca6 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:18.778440 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbe648-3143-4498-8bfc-0c5cd871bca6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:18.780174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbe648-3143-4498-8bfc-0c5cd871bca6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:18.806828 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 18/38] 10.222.0.52 () {60 vars in 1131 bytes} [Thu Sep 1 16:18:18 2022] POST /identity/v3/roles => generated 219 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:18:18.809043 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d209b31-62b4-4abc-af43-ced1fd320c14 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:18.809540 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d209b31-62b4-4abc-af43-ced1fd320c14 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:18.809992 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d209b31-62b4-4abc-af43-ced1fd320c14 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:18.812491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 19/39] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:18.818275 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d209b31-62b4-4abc-af43-ced1fd320c14 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:18.835406 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 21/40] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:18.837472 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d393d-9e02-45f5-b1c7-6942c972622a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:18.838332 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d393d-9e02-45f5-b1c7-6942c972622a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:18.838933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d393d-9e02-45f5-b1c7-6942c972622a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:18.864369 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-431d393d-9e02-45f5-b1c7-6942c972622a None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:18.866095 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-431d393d-9e02-45f5-b1c7-6942c972622a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:18.882356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:19.065678 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 22/41] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:19.093261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d209b31-62b4-4abc-af43-ced1fd320c14 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:19.140276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997c151-3e61-458e-a734-3bb54f317e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:19.141211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997c151-3e61-458e-a734-3bb54f317e0b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:19.142053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997c151-3e61-458e-a734-3bb54f317e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:19.142350 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997c151-3e61-458e-a734-3bb54f317e0b None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:19.142999 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997c151-3e61-458e-a734-3bb54f317e0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:19.143301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997c151-3e61-458e-a734-3bb54f317e0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:19.144817 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997c151-3e61-458e-a734-3bb54f317e0b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:19.155209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d393d-9e02-45f5-b1c7-6942c972622a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:19.170963 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 20/42] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:19.177411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997c151-3e61-458e-a734-3bb54f317e0b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:19.240964 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:19.353145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d393d-9e02-45f5-b1c7-6942c972622a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:19.397385 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a189af-5bd0-4bbd-9ee1-25e9e0bbd54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:19.398310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a189af-5bd0-4bbd-9ee1-25e9e0bbd54c None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:19.398760 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a189af-5bd0-4bbd-9ee1-25e9e0bbd54c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:19.399183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a189af-5bd0-4bbd-9ee1-25e9e0bbd54c None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:19.400032 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a189af-5bd0-4bbd-9ee1-25e9e0bbd54c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:19.401802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a189af-5bd0-4bbd-9ee1-25e9e0bbd54c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:19.415449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:19.426178 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 23/43] 10.222.0.52 () {60 vars in 1131 bytes} [Thu Sep 1 16:18:19 2022] POST /identity/v3/roles => generated 223 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:18:19.444100 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997c151-3e61-458e-a734-3bb54f317e0b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:19.491193 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f876138-2959-4440-94b4-7ff15ad938be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:19.492182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f876138-2959-4440-94b4-7ff15ad938be None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:19.492694 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f876138-2959-4440-94b4-7ff15ad938be None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:19.493140 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f876138-2959-4440-94b4-7ff15ad938be None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:19.494020 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f876138-2959-4440-94b4-7ff15ad938be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:19.495905 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f876138-2959-4440-94b4-7ff15ad938be None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:19.541195 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 21/44] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 1 16:18:19 2022] POST /identity/v3/projects => generated 301 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:18:19.622099 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a189af-5bd0-4bbd-9ee1-25e9e0bbd54c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:19.778275 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a189af-5bd0-4bbd-9ee1-25e9e0bbd54c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:19.822433 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc13618-a829-4df5-ae88-5427a3dfa642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:19.823156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc13618-a829-4df5-ae88-5427a3dfa642 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:19.823508 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc13618-a829-4df5-ae88-5427a3dfa642 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:19.823913 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc13618-a829-4df5-ae88-5427a3dfa642 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:19.825650 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc13618-a829-4df5-ae88-5427a3dfa642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:19.827259 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc13618-a829-4df5-ae88-5427a3dfa642 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:19.829166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 24/45] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:19.835335 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f876138-2959-4440-94b4-7ff15ad938be None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:19.953255 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f876138-2959-4440-94b4-7ff15ad938be None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:19.956161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:19.995073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec1a0b-8348-49e3-a47b-156d1be2097f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:19.995698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec1a0b-8348-49e3-a47b-156d1be2097f None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:19.995980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec1a0b-8348-49e3-a47b-156d1be2097f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:19.996256 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec1a0b-8348-49e3-a47b-156d1be2097f None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:19.996994 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec1a0b-8348-49e3-a47b-156d1be2097f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:19.998514 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec1a0b-8348-49e3-a47b-156d1be2097f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:20.031514 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 22/46] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 1 16:18:19 2022] POST /identity/v3/projects => generated 312 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:18:20.910831 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ed94d-e931-4df0-a607-c3c5e6c75131 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:20.911434 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ed94d-e931-4df0-a607-c3c5e6c75131 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:20.911434 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ed94d-e931-4df0-a607-c3c5e6c75131 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:20.912885 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 25/47] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:20.918926 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba7e14-6087-4f40-8fa6-f5cf815f3792 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:20.919482 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba7e14-6087-4f40-8fa6-f5cf815f3792 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:20.919629 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba7e14-6087-4f40-8fa6-f5cf815f3792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:20.940658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-bcba7e14-6087-4f40-8fa6-f5cf815f3792 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:20.942414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bcba7e14-6087-4f40-8fa6-f5cf815f3792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:21.022840 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 23/48] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:21.297058 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ed94d-e931-4df0-a607-c3c5e6c75131 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:21.422111 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:21.484378 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ed94d-e931-4df0-a607-c3c5e6c75131 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:21.551258 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670d534-e3d4-4da5-91d4-b4a2f549a2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:21.552158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670d534-e3d4-4da5-91d4-b4a2f549a2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:21.552543 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670d534-e3d4-4da5-91d4-b4a2f549a2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:21.553068 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670d534-e3d4-4da5-91d4-b4a2f549a2b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:21.577196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670d534-e3d4-4da5-91d4-b4a2f549a2b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:21.591092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-2670d534-e3d4-4da5-91d4-b4a2f549a2b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:21.591092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:21.591092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:21.591092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:21.591092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:21.591092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:21.591092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:21.591092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:21.591092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:21.591092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:21.591092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:21.591092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:21.591092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:21.591092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:21.591092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:21.591092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:21.592108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:21.592108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:21.592108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:21.592108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:21.592108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:21.592108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:21.592108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:21.592108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:21.592108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:21.592108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:21.592108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:21.592108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:21.592108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:21.592108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:21.592108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:21.592108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:21.592966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:21.592966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:21.592966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:21.592966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:21.592966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:21.592966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:21.592966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:21.592966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:21.592966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:21.592966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:21.592966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:21.592966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:18:21.594228 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 26/49] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:18:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:21.602771 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba7e14-6087-4f40-8fa6-f5cf815f3792 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:21.728484 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:21.750285 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba7e14-6087-4f40-8fa6-f5cf815f3792 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:21.794269 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec881797-be7c-4891-821f-59e1b7eebb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:21.795022 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec881797-be7c-4891-821f-59e1b7eebb16 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:21.795397 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec881797-be7c-4891-821f-59e1b7eebb16 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:21.795773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec881797-be7c-4891-821f-59e1b7eebb16 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:21.796559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec881797-be7c-4891-821f-59e1b7eebb16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:21.796987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec881797-be7c-4891-821f-59e1b7eebb16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:21.798856 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec881797-be7c-4891-821f-59e1b7eebb16 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:21.809906 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 24/50] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:21.817048 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670d534-e3d4-4da5-91d4-b4a2f549a2b2 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:21.971901 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670d534-e3d4-4da5-91d4-b4a2f549a2b2 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:22.007082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:22.018283 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c97570-87ef-427f-84c4-9cf032799f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:22.019058 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c97570-87ef-427f-84c4-9cf032799f0b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:22.019450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c97570-87ef-427f-84c4-9cf032799f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:22.019815 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c97570-87ef-427f-84c4-9cf032799f0b None admin] PATH_INFO: `/v3/users/2b43f72ae2234a7eb9bf83a968fd7292` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:22.021490 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c97570-87ef-427f-84c4-9cf032799f0b None admin] RBAC: Authorizing `identity:get_user(user_id=2b43f72ae2234a7eb9bf83a968fd7292)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:22.023108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c97570-87ef-427f-84c4-9cf032799f0b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:22.025025 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 27/51] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:21 2022] GET /identity/v3/users/2b43f72ae2234a7eb9bf83a968fd7292 => generated 247 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:22.031247 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec881797-be7c-4891-821f-59e1b7eebb16 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:22.075002 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd348e86-1565-4aaf-8614-0e9ad70a8f90 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:22.075351 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd348e86-1565-4aaf-8614-0e9ad70a8f90 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:22.075838 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd348e86-1565-4aaf-8614-0e9ad70a8f90 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:22.077368 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 28/52] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:22.083878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61bfc2-1975-4d6e-819c-ad108cd29216 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:22.084210 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61bfc2-1975-4d6e-819c-ad108cd29216 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:22.084436 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61bfc2-1975-4d6e-819c-ad108cd29216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:22.105496 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9b61bfc2-1975-4d6e-819c-ad108cd29216 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:22.106748 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9b61bfc2-1975-4d6e-819c-ad108cd29216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:22.171111 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec881797-be7c-4891-821f-59e1b7eebb16 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:22.194697 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 29/53] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:18:22.225741 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70613a6-d4dd-4ccf-80a8-81b23f6a376d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:22.226835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70613a6-d4dd-4ccf-80a8-81b23f6a376d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:22.227339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70613a6-d4dd-4ccf-80a8-81b23f6a376d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:22.227831 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70613a6-d4dd-4ccf-80a8-81b23f6a376d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:22.230076 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70613a6-d4dd-4ccf-80a8-81b23f6a376d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:22.233007 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70613a6-d4dd-4ccf-80a8-81b23f6a376d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:22.236358 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 25/54] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:22.242764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61bfc2-1975-4d6e-819c-ad108cd29216 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:22.374628 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61bfc2-1975-4d6e-819c-ad108cd29216 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:22.405179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:22.419577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01830a35-3f9a-486d-a6bc-e7fb1458923e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:22.420379 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01830a35-3f9a-486d-a6bc-e7fb1458923e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:22.420788 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01830a35-3f9a-486d-a6bc-e7fb1458923e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:22.421159 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01830a35-3f9a-486d-a6bc-e7fb1458923e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:22.421988 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01830a35-3f9a-486d-a6bc-e7fb1458923e None admin] RBAC: Adding query filter params (role.id=a8896546a02c42489ef73c7ad7c43542, scope.domain.id=default, user.id=2b43f72ae2234a7eb9bf83a968fd7292) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:22.422407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01830a35-3f9a-486d-a6bc-e7fb1458923e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:22.424611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01830a35-3f9a-486d-a6bc-e7fb1458923e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:22.434820 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 30/55] 10.222.0.52 () {56 vars in 1322 bytes} [Thu Sep 1 16:18:22 2022] GET /identity/v3/role_assignments?user.id=2b43f72ae2234a7eb9bf83a968fd7292&scope.domain.id=default&role.id=a8896546a02c42489ef73c7ad7c43542 => generated 530 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:22.494829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70613a6-d4dd-4ccf-80a8-81b23f6a376d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:22.521130 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:22.671545 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70613a6-d4dd-4ccf-80a8-81b23f6a376d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:22.718407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9232e-400c-4063-8aaa-d644dc439354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:22.719057 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9232e-400c-4063-8aaa-d644dc439354 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:22.719966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9232e-400c-4063-8aaa-d644dc439354 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:22.720202 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9232e-400c-4063-8aaa-d644dc439354 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:22.721419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9232e-400c-4063-8aaa-d644dc439354 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:22.722927 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9232e-400c-4063-8aaa-d644dc439354 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:22.724605 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 26/56] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:22.730620 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01830a35-3f9a-486d-a6bc-e7fb1458923e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:22.851563 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01830a35-3f9a-486d-a6bc-e7fb1458923e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:22.893851 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f80a3-2739-41ae-8b66-7c41e801efd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:22.894485 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f80a3-2739-41ae-8b66-7c41e801efd9 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:22.894768 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f80a3-2739-41ae-8b66-7c41e801efd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:22.895044 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f80a3-2739-41ae-8b66-7c41e801efd9 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:22.895804 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f80a3-2739-41ae-8b66-7c41e801efd9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:22.897442 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f80a3-2739-41ae-8b66-7c41e801efd9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:22.931348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 31/57] 10.222.0.52 () {60 vars in 1140 bytes} [Thu Sep 1 16:18:22 2022] POST /identity/v3/projects => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:18:24.965993 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabc41e-b593-4b2c-aa2c-40ff85f09438 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:24.966556 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabc41e-b593-4b2c-aa2c-40ff85f09438 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:24.966556 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabc41e-b593-4b2c-aa2c-40ff85f09438 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:24.968031 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 27/58] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:18:24.974096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab5122-156f-45eb-89b5-30b8496f043f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:24.974661 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab5122-156f-45eb-89b5-30b8496f043f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:24.974661 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab5122-156f-45eb-89b5-30b8496f043f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:24.995073 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c5ab5122-156f-45eb-89b5-30b8496f043f None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:24.996322 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c5ab5122-156f-45eb-89b5-30b8496f043f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:25.040323 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:25.083486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 32/59] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:25.366222 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabc41e-b593-4b2c-aa2c-40ff85f09438 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:25.468892 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:25.488745 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabc41e-b593-4b2c-aa2c-40ff85f09438 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:25.529759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aaac59-15c8-4979-98f6-71e8e5b68d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:25.530416 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aaac59-15c8-4979-98f6-71e8e5b68d93 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:25.530700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aaac59-15c8-4979-98f6-71e8e5b68d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:25.530978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aaac59-15c8-4979-98f6-71e8e5b68d93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:25.532743 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aaac59-15c8-4979-98f6-71e8e5b68d93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:25.534233 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aaac59-15c8-4979-98f6-71e8e5b68d93 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:25.535893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 28/60] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:25.541954 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab5122-156f-45eb-89b5-30b8496f043f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:25.662901 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab5122-156f-45eb-89b5-30b8496f043f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:25.703785 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47e8e0-7c4d-4aef-81f2-470cebe9c2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:25.705054 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47e8e0-7c4d-4aef-81f2-470cebe9c2bf None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:25.705334 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47e8e0-7c4d-4aef-81f2-470cebe9c2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:25.705602 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47e8e0-7c4d-4aef-81f2-470cebe9c2bf None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:25.706272 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47e8e0-7c4d-4aef-81f2-470cebe9c2bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:25.707770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47e8e0-7c4d-4aef-81f2-470cebe9c2bf None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:25.739495 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 33/61] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 1 16:18:25 2022] POST /identity/v3/users => generated 275 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:18:28.894410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f08d63-7fdc-4061-8e8b-ce38b86f73a8 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:28.895473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f08d63-7fdc-4061-8e8b-ce38b86f73a8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:28.895960 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f08d63-7fdc-4061-8e8b-ce38b86f73a8 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:28.897658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 29/62] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:28.903707 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797f475-a84e-4e9b-940a-813baa7b8f27 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:28.904677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797f475-a84e-4e9b-940a-813baa7b8f27 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:28.905158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797f475-a84e-4e9b-940a-813baa7b8f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:28.926520 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f797f475-a84e-4e9b-940a-813baa7b8f27 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:28.928155 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f797f475-a84e-4e9b-940a-813baa7b8f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:28.953191 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:29.121702 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 34/63] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:18:29.427439 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f08d63-7fdc-4061-8e8b-ce38b86f73a8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:29.576039 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f08d63-7fdc-4061-8e8b-ce38b86f73a8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:29.612772 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3eeef2-3e41-4ff6-8f98-3266932cdb5a None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:29.613406 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3eeef2-3e41-4ff6-8f98-3266932cdb5a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:29.613880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3eeef2-3e41-4ff6-8f98-3266932cdb5a None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:29.615566 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 35/64] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:18:29.628158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c0424-1f91-4f9b-9830-e8bdb8ea1886 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:29.628425 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c0424-1f91-4f9b-9830-e8bdb8ea1886 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:29.628887 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c0424-1f91-4f9b-9830-e8bdb8ea1886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:29.631442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c8be7-e48f-4a02-81aa-1438c0a36831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:29.632103 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c8be7-e48f-4a02-81aa-1438c0a36831 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:29.632382 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c8be7-e48f-4a02-81aa-1438c0a36831 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:29.632692 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c8be7-e48f-4a02-81aa-1438c0a36831 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:29.656369 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c8be7-e48f-4a02-81aa-1438c0a36831 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:29.667833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-2f9c8be7-e48f-4a02-81aa-1438c0a36831 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:18:29.667833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:29.667833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:29.667833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:29.667833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:29.667833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:29.667833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:29.667833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:29.667833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:29.667833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:29.667833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:29.667833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:29.667833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:29.667833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:29.667833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:29.667833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:29.669473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:29.669473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:29.669473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:29.669473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:29.669473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:29.669473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:29.669473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:29.669473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:29.669473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:29.669473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:29.669473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:29.669473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:29.669473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:29.669473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:29.669473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:29.669473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:29.670875 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:29.670875 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:29.670875 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:29.670875 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:29.670875 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:29.670875 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:29.670875 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:29.670875 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:29.670875 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:29.670875 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:29.670875 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:18:29.670875 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:18:29.675566 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 30/65] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:18:29.676298 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ea0c0424-1f91-4f9b-9830-e8bdb8ea1886 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:29.677945 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ea0c0424-1f91-4f9b-9830-e8bdb8ea1886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:29.695974 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c8be7-e48f-4a02-81aa-1438c0a36831 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:29.746752 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:29.806052 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 36/66] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:29.964741 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c8be7-e48f-4a02-81aa-1438c0a36831 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:30.053195 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fbc2c-9731-4365-9003-1f75e6851313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:30.053847 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fbc2c-9731-4365-9003-1f75e6851313 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:30.054128 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fbc2c-9731-4365-9003-1f75e6851313 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:30.054408 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fbc2c-9731-4365-9003-1f75e6851313 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:30.055116 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fbc2c-9731-4365-9003-1f75e6851313 None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:30.055425 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fbc2c-9731-4365-9003-1f75e6851313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:30.061194 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fbc2c-9731-4365-9003-1f75e6851313 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:30.071408 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 31/67] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:18:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:30.081039 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c0424-1f91-4f9b-9830-e8bdb8ea1886 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:30.130443 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e56a9-a929-4779-bbc6-52ca579bbda0 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:30.131075 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e56a9-a929-4779-bbc6-52ca579bbda0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:30.131594 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e56a9-a929-4779-bbc6-52ca579bbda0 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:30.133259 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 32/68] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:18:30.139202 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df2fd6-ab6f-400d-9b20-778da355282d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:30.139806 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df2fd6-ab6f-400d-9b20-778da355282d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:30.140304 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df2fd6-ab6f-400d-9b20-778da355282d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:30.161824 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c0df2fd6-ab6f-400d-9b20-778da355282d None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:30.163430 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c0df2fd6-ab6f-400d-9b20-778da355282d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:30.245718 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 33/69] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:18:30.324496 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df2fd6-ab6f-400d-9b20-778da355282d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:30.329944 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:30.381004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:30.453041 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df2fd6-ab6f-400d-9b20-778da355282d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:30.464234 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c0424-1f91-4f9b-9830-e8bdb8ea1886 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:30.512862 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079a43e-24af-45b0-8175-85f5602175e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:30.513860 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079a43e-24af-45b0-8175-85f5602175e0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:30.514338 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079a43e-24af-45b0-8175-85f5602175e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:30.514828 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079a43e-24af-45b0-8175-85f5602175e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:30.528082 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079a43e-24af-45b0-8175-85f5602175e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:30.533559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-1079a43e-24af-45b0-8175-85f5602175e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:18:30.533559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:30.533559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:30.533559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:30.533559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:30.533559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:30.533559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:30.533559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:30.533559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:30.533559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:30.533559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:30.533559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:30.533559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:30.533559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:30.533559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:30.533559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:30.534417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:30.534417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:30.534417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:30.534417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:30.534417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:30.534417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:30.534417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:30.534417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:30.534417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:30.534417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:30.534417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:30.534417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:30.534417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:30.534417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:30.534417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:30.534417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:30.535134 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:30.535134 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:30.535134 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:30.535134 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:30.535134 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:30.535134 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:30.535134 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:30.535134 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:30.535134 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:30.535134 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:30.535134 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:18:30.535134 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:18:30.537472 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 34/70] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 1 16:18:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:30.553480 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079a43e-24af-45b0-8175-85f5602175e0 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:30.565175 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a19bba-6ccd-4c0e-a082-4090140a8747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:30.566320 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a19bba-6ccd-4c0e-a082-4090140a8747 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:30.566794 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a19bba-6ccd-4c0e-a082-4090140a8747 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:30.567291 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a19bba-6ccd-4c0e-a082-4090140a8747 None admin] PATH_INFO: `/v3/users/08a10ce8373d40309074b328c9c29722` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:30.617933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a19bba-6ccd-4c0e-a082-4090140a8747 None admin] RBAC: Authorizing `identity:get_user(user_id=08a10ce8373d40309074b328c9c29722)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:30.620772 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a19bba-6ccd-4c0e-a082-4090140a8747 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:30.624092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 37/71] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:30 2022] GET /identity/v3/users/08a10ce8373d40309074b328c9c29722 => generated 275 bytes in 544 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:30.636459 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a19bba-6ccd-4c0e-a082-4090140a8747 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:30.747823 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:30.800296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079a43e-24af-45b0-8175-85f5602175e0 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:30.841756 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a19bba-6ccd-4c0e-a082-4090140a8747 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:30.858225 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc667e-1198-4eba-9538-8ba5a1bbbc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:30.859268 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc667e-1198-4eba-9538-8ba5a1bbbc80 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:30.859764 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc667e-1198-4eba-9538-8ba5a1bbbc80 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:30.860250 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc667e-1198-4eba-9538-8ba5a1bbbc80 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:30.861542 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc667e-1198-4eba-9538-8ba5a1bbbc80 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:30.862088 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc667e-1198-4eba-9538-8ba5a1bbbc80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:30.864835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc667e-1198-4eba-9538-8ba5a1bbbc80 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:30.880942 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 35/72] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:18:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:30.883246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e0573-808d-48d7-ada1-2b7d34e53fb5 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:30.883758 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e0573-808d-48d7-ada1-2b7d34e53fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:30.884237 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e0573-808d-48d7-ada1-2b7d34e53fb5 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:30.887022 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 36/73] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:30.889619 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e0573-808d-48d7-ada1-2b7d34e53fb5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:30.918795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749cc86-801c-4065-bb6c-c74f8829162e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:30.919858 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749cc86-801c-4065-bb6c-c74f8829162e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:30.920351 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749cc86-801c-4065-bb6c-c74f8829162e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:30.920884 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749cc86-801c-4065-bb6c-c74f8829162e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:30.952701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:31.054012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749cc86-801c-4065-bb6c-c74f8829162e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:31.056188 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749cc86-801c-4065-bb6c-c74f8829162e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:31.059990 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e0573-808d-48d7-ada1-2b7d34e53fb5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:31.103917 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:31.118037 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e281cd-63a1-475a-9909-396583d4a938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:31.118830 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e281cd-63a1-475a-9909-396583d4a938 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:31.119214 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e281cd-63a1-475a-9909-396583d4a938 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:31.119627 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e281cd-63a1-475a-9909-396583d4a938 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:31.134993 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e281cd-63a1-475a-9909-396583d4a938 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:31.141138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-21e281cd-63a1-475a-9909-396583d4a938 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:31.141138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:31.141138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:31.141138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:31.141138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:31.141138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:31.141138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:31.141138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:31.141138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:31.141138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:31.141138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:31.141138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:31.141138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:31.141138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:31.141138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:31.141138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:31.143398 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:31.143398 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:31.143398 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:31.143398 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:31.143398 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:31.143398 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:31.143398 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:31.143398 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:31.143398 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:31.143398 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:31.143398 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:31.143398 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:31.143398 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:31.143398 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:31.143398 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:31.143398 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:31.145401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:31.145401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:31.145401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:31.145401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:31.145401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:31.145401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:31.145401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:31.145401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:31.145401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:31.145401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:31.145401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:31.145401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:18:31.145401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 37/74] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:18:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:31.145401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e281cd-63a1-475a-9909-396583d4a938 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:31.214662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 38/75] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:18:31.217149 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e713704-f113-42ef-915e-2cf4bb8bb177 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:31.217550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e713704-f113-42ef-915e-2cf4bb8bb177 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:31.217983 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e713704-f113-42ef-915e-2cf4bb8bb177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:31.240362 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3e713704-f113-42ef-915e-2cf4bb8bb177 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:31.241891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3e713704-f113-42ef-915e-2cf4bb8bb177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:31.294865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e281cd-63a1-475a-9909-396583d4a938 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:31.296480 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:31.332082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 39/76] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:31.333358 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6887206-1783-49db-b6ab-f90b585b0927 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:31.333613 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6887206-1783-49db-b6ab-f90b585b0927 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:31.333887 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6887206-1783-49db-b6ab-f90b585b0927 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:31.339326 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 40/77] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:31.339326 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6887206-1783-49db-b6ab-f90b585b0927 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:31.352789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b485e3-42cf-4013-afdd-da5c59e7decf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:31.353886 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b485e3-42cf-4013-afdd-da5c59e7decf None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:31.354358 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b485e3-42cf-4013-afdd-da5c59e7decf None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:31.354842 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b485e3-42cf-4013-afdd-da5c59e7decf None admin] PATH_INFO: `/v3/users/08a10ce8373d40309074b328c9c29722` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:31.356878 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b485e3-42cf-4013-afdd-da5c59e7decf None admin] RBAC: Authorizing `identity:get_user(user_id=08a10ce8373d40309074b328c9c29722)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:31.359429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b485e3-42cf-4013-afdd-da5c59e7decf None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:31.367050 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 38/78] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:31 2022] GET /identity/v3/users/08a10ce8373d40309074b328c9c29722 => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:31.367050 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b485e3-42cf-4013-afdd-da5c59e7decf None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:31.460783 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:31.480027 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6887206-1783-49db-b6ab-f90b585b0927 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:31.533530 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636972c-5a7b-4d48-9c01-26c814dd2fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:31.534057 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636972c-5a7b-4d48-9c01-26c814dd2fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:31.534558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636972c-5a7b-4d48-9c01-26c814dd2fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:31.534886 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636972c-5a7b-4d48-9c01-26c814dd2fa1 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:31.536004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636972c-5a7b-4d48-9c01-26c814dd2fa1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:31.536545 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636972c-5a7b-4d48-9c01-26c814dd2fa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:31.536750 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b485e3-42cf-4013-afdd-da5c59e7decf None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:31.539197 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636972c-5a7b-4d48-9c01-26c814dd2fa1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:31.567859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 41/79] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:31.567859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e77c98-b839-4f44-961c-1dd58a2be1fc None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:31.567859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e77c98-b839-4f44-961c-1dd58a2be1fc None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:31.567859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e77c98-b839-4f44-961c-1dd58a2be1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:31.583502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37034e7b-2b0f-4c2f-a2d3-f20ede4b160a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:31.584265 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37034e7b-2b0f-4c2f-a2d3-f20ede4b160a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:31.584670 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37034e7b-2b0f-4c2f-a2d3-f20ede4b160a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:31.585091 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37034e7b-2b0f-4c2f-a2d3-f20ede4b160a None admin] PATH_INFO: `/v3/projects/c6ec2c26955d46c3a767d88695f36411` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:31.586518 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37034e7b-2b0f-4c2f-a2d3-f20ede4b160a None admin] RBAC: Authorizing `identity:get_project(project_id=c6ec2c26955d46c3a767d88695f36411)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:31.588170 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37034e7b-2b0f-4c2f-a2d3-f20ede4b160a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:31.590107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 39/80] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:31 2022] GET /identity/v3/projects/c6ec2c26955d46c3a767d88695f36411 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:31.596104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37034e7b-2b0f-4c2f-a2d3-f20ede4b160a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:31.597092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-75e77c98-b839-4f44-961c-1dd58a2be1fc None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:31.599206 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-75e77c98-b839-4f44-961c-1dd58a2be1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:31.640015 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:31.696733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 42/81] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:31.700833 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e77c98-b839-4f44-961c-1dd58a2be1fc None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:31.770383 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37034e7b-2b0f-4c2f-a2d3-f20ede4b160a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:31.807448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:31.825408 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf00da4-232c-4280-a515-5b6628b06deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:31.826335 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf00da4-232c-4280-a515-5b6628b06deb None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:31.826760 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf00da4-232c-4280-a515-5b6628b06deb None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:31.827179 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf00da4-232c-4280-a515-5b6628b06deb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:31.887664 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e77c98-b839-4f44-961c-1dd58a2be1fc None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:31.930768 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf00da4-232c-4280-a515-5b6628b06deb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:31.932327 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf00da4-232c-4280-a515-5b6628b06deb None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:31.959508 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb4f3a-1161-4828-98c5-ad5151ed3070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:31.960600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb4f3a-1161-4828-98c5-ad5151ed3070 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:31.961132 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb4f3a-1161-4828-98c5-ad5151ed3070 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:31.961630 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb4f3a-1161-4828-98c5-ad5151ed3070 None admin] PATH_INFO: `/v3/users/2b43f72ae2234a7eb9bf83a968fd7292` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:31.963835 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb4f3a-1161-4828-98c5-ad5151ed3070 None admin] RBAC: Authorizing `identity:get_user(user_id=2b43f72ae2234a7eb9bf83a968fd7292)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:31.966708 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb4f3a-1161-4828-98c5-ad5151ed3070 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:31.972673 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 43/82] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:31 2022] GET /identity/v3/users/2b43f72ae2234a7eb9bf83a968fd7292 => generated 247 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:31.972673 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb4f3a-1161-4828-98c5-ad5151ed3070 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:32.026890 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:32.101709 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 40/83] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:18:32.102633 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf00da4-232c-4280-a515-5b6628b06deb None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:32.130028 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb4f3a-1161-4828-98c5-ad5151ed3070 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:32.145959 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:32.175232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c263999-582b-484e-b412-88a9a99ce6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:32.176205 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c263999-582b-484e-b412-88a9a99ce6da None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:32.176704 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c263999-582b-484e-b412-88a9a99ce6da None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:32.177190 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c263999-582b-484e-b412-88a9a99ce6da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:32.178493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c263999-582b-484e-b412-88a9a99ce6da None admin] RBAC: Adding query filter params (role.id=76a38a2307da45bcb511ef106076613d, scope.project.id=c6ec2c26955d46c3a767d88695f36411, user.id=08a10ce8373d40309074b328c9c29722) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:32.178997 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c263999-582b-484e-b412-88a9a99ce6da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:32.181546 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c263999-582b-484e-b412-88a9a99ce6da None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:32.189674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 44/84] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:31 2022] GET /identity/v3/role_assignments?user.id=08a10ce8373d40309074b328c9c29722&scope.project.id=c6ec2c26955d46c3a767d88695f36411&role.id=76a38a2307da45bcb511ef106076613d => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:32.191110 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c263999-582b-484e-b412-88a9a99ce6da None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:32.263055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf00da4-232c-4280-a515-5b6628b06deb None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:32.310118 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b41df-2843-4134-a9a9-00d8c4bee2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:32.310813 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b41df-2843-4134-a9a9-00d8c4bee2b3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:32.311081 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b41df-2843-4134-a9a9-00d8c4bee2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:32.311363 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b41df-2843-4134-a9a9-00d8c4bee2b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:32.332462 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b41df-2843-4134-a9a9-00d8c4bee2b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:32.346517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-621b41df-2843-4134-a9a9-00d8c4bee2b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:18:32.346517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:32.346517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:32.346517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:32.346517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:32.346517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:32.346517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:32.346517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:32.346517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:32.346517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:32.346517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:32.346517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:32.346517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:32.346517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:32.346517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:32.346517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:32.348123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:32.348123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:32.348123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:32.348123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:32.348123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:32.348123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:32.348123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:32.348123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:32.348123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:32.348123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:32.348123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:32.348123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:32.348123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:32.348123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:32.348123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:32.348123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:32.350107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:32.350107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:32.350107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:32.350107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:32.350107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:32.350107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:32.350107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:32.350107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:32.350107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:32.350107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:32.350107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:18:32.350107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:18:32.350107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 41/85] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:32.350107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b41df-2843-4134-a9a9-00d8c4bee2b3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:32.388517 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:32.397341 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c263999-582b-484e-b412-88a9a99ce6da None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:32.448126 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0fcbb-b363-4faa-a04b-82bbb39e47e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:32.448794 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0fcbb-b363-4faa-a04b-82bbb39e47e1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:32.449061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0fcbb-b363-4faa-a04b-82bbb39e47e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:32.449357 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0fcbb-b363-4faa-a04b-82bbb39e47e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:32.482934 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:32.519251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b41df-2843-4134-a9a9-00d8c4bee2b3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:32.561458 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0fcbb-b363-4faa-a04b-82bbb39e47e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:32.565099 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0fcbb-b363-4faa-a04b-82bbb39e47e1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:32.577442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6f8cb-bdef-43a1-b239-3fbb81db2745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:32.578478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6f8cb-bdef-43a1-b239-3fbb81db2745 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:32.578958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6f8cb-bdef-43a1-b239-3fbb81db2745 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:32.579416 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6f8cb-bdef-43a1-b239-3fbb81db2745 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:32.581185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6f8cb-bdef-43a1-b239-3fbb81db2745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:32.583693 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6f8cb-bdef-43a1-b239-3fbb81db2745 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:32.588796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 42/86] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:32.588796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6f8cb-bdef-43a1-b239-3fbb81db2745 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:32.753336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:32.755295 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6f8cb-bdef-43a1-b239-3fbb81db2745 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:32.761778 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 45/87] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:18:32.762696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0fcbb-b363-4faa-a04b-82bbb39e47e1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:32.836542 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934f8cb-e516-4adf-8087-eca1dcebf8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:32.837249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934f8cb-e516-4adf-8087-eca1dcebf8c3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:32.837585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934f8cb-e516-4adf-8087-eca1dcebf8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:32.837870 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934f8cb-e516-4adf-8087-eca1dcebf8c3 None admin] PATH_INFO: `/v3/projects/c6ec2c26955d46c3a767d88695f36411` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:32.839224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934f8cb-e516-4adf-8087-eca1dcebf8c3 None admin] RBAC: Authorizing `identity:get_project(project_id=c6ec2c26955d46c3a767d88695f36411)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:32.841564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934f8cb-e516-4adf-8087-eca1dcebf8c3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:32.852297 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 43/88] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:32 2022] GET /identity/v3/projects/c6ec2c26955d46c3a767d88695f36411 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:32.852297 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934f8cb-e516-4adf-8087-eca1dcebf8c3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:32.890626 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:32.946593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0fcbb-b363-4faa-a04b-82bbb39e47e1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:33.015661 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934f8cb-e516-4adf-8087-eca1dcebf8c3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:33.017665 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da1ecf-7e00-4e71-b7b4-e1e2b3ca8048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:33.018457 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da1ecf-7e00-4e71-b7b4-e1e2b3ca8048 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:33.019062 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da1ecf-7e00-4e71-b7b4-e1e2b3ca8048 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:33.019460 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da1ecf-7e00-4e71-b7b4-e1e2b3ca8048 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:33.020340 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da1ecf-7e00-4e71-b7b4-e1e2b3ca8048 None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:33.020879 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da1ecf-7e00-4e71-b7b4-e1e2b3ca8048 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:33.022925 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da1ecf-7e00-4e71-b7b4-e1e2b3ca8048 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:33.034702 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 46/89] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:18:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:33.035608 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da1ecf-7e00-4e71-b7b4-e1e2b3ca8048 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:33.091029 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bffe51-7bbd-4a05-b9bd-c2b49d165cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:33.091802 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bffe51-7bbd-4a05-b9bd-c2b49d165cd7 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:33.092050 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bffe51-7bbd-4a05-b9bd-c2b49d165cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:33.092660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bffe51-7bbd-4a05-b9bd-c2b49d165cd7 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:33.093373 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bffe51-7bbd-4a05-b9bd-c2b49d165cd7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:33.096351 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bffe51-7bbd-4a05-b9bd-c2b49d165cd7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:33.145009 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 44/90] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 1 16:18:32 2022] POST /identity/v3/users => generated 289 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:18:33.145009 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bffe51-7bbd-4a05-b9bd-c2b49d165cd7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:33.163640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:33.223594 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da1ecf-7e00-4e71-b7b4-e1e2b3ca8048 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:33.272582 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9a9bd-b126-4765-b266-fc60249a6f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:33.273193 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9a9bd-b126-4765-b266-fc60249a6f1d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:33.273477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9a9bd-b126-4765-b266-fc60249a6f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:33.273758 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9a9bd-b126-4765-b266-fc60249a6f1d None admin] PATH_INFO: `/v3/projects/c6ec2c26955d46c3a767d88695f36411` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:33.275109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9a9bd-b126-4765-b266-fc60249a6f1d None admin] RBAC: Authorizing `identity:get_project(project_id=c6ec2c26955d46c3a767d88695f36411)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:33.276695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9a9bd-b126-4765-b266-fc60249a6f1d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:33.278547 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 47/91] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:33 2022] GET /identity/v3/projects/c6ec2c26955d46c3a767d88695f36411 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:33.285068 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9a9bd-b126-4765-b266-fc60249a6f1d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:33.312464 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:33.370401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bffe51-7bbd-4a05-b9bd-c2b49d165cd7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:33.417433 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9a9bd-b126-4765-b266-fc60249a6f1d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:33.453107 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:33.453581 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac63d7d-f06a-4f51-9fb5-094e2e2928c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:33.454296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac63d7d-f06a-4f51-9fb5-094e2e2928c4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:33.454589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac63d7d-f06a-4f51-9fb5-094e2e2928c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:33.454928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac63d7d-f06a-4f51-9fb5-094e2e2928c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:33.456055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac63d7d-f06a-4f51-9fb5-094e2e2928c4 None admin] RBAC: Adding query filter params (role.id=f889b15cab8c46f58be00f84143aac60, scope.project.id=c6ec2c26955d46c3a767d88695f36411, user.id=08a10ce8373d40309074b328c9c29722) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:33.456055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac63d7d-f06a-4f51-9fb5-094e2e2928c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:33.458706 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac63d7d-f06a-4f51-9fb5-094e2e2928c4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:33.468807 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 45/92] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:33 2022] GET /identity/v3/role_assignments?user.id=08a10ce8373d40309074b328c9c29722&scope.project.id=c6ec2c26955d46c3a767d88695f36411&role.id=f889b15cab8c46f58be00f84143aac60 => generated 259 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:33.470311 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac63d7d-f06a-4f51-9fb5-094e2e2928c4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:33.478667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93855432-efe1-49a7-a9d3-221cb3eed55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:33.479921 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93855432-efe1-49a7-a9d3-221cb3eed55a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:33.480433 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93855432-efe1-49a7-a9d3-221cb3eed55a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:33.481105 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93855432-efe1-49a7-a9d3-221cb3eed55a None admin] PATH_INFO: `/v3/users/08a10ce8373d40309074b328c9c29722` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:33.486942 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93855432-efe1-49a7-a9d3-221cb3eed55a None admin] RBAC: Authorizing `identity:get_user(user_id=08a10ce8373d40309074b328c9c29722)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:33.489183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93855432-efe1-49a7-a9d3-221cb3eed55a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:33.493345 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 48/93] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:33 2022] GET /identity/v3/users/08a10ce8373d40309074b328c9c29722 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:33.510339 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93855432-efe1-49a7-a9d3-221cb3eed55a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:33.705314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac63d7d-f06a-4f51-9fb5-094e2e2928c4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:33.740880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93855432-efe1-49a7-a9d3-221cb3eed55a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:33.756222 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d1814-95f7-43e6-a37b-516d265e3ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:33.757134 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d1814-95f7-43e6-a37b-516d265e3ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:33.757561 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d1814-95f7-43e6-a37b-516d265e3ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:33.758006 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d1814-95f7-43e6-a37b-516d265e3ae8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:33.758918 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d1814-95f7-43e6-a37b-516d265e3ae8 None admin] RBAC: Adding query filter params (role.id=a8896546a02c42489ef73c7ad7c43542, scope.project.id=c6ec2c26955d46c3a767d88695f36411, user.id=2b43f72ae2234a7eb9bf83a968fd7292) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:33.759386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d1814-95f7-43e6-a37b-516d265e3ae8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:33.761108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d1814-95f7-43e6-a37b-516d265e3ae8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:33.768489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 46/94] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:33 2022] GET /identity/v3/role_assignments?user.id=2b43f72ae2234a7eb9bf83a968fd7292&scope.project.id=c6ec2c26955d46c3a767d88695f36411&role.id=a8896546a02c42489ef73c7ad7c43542 => generated 259 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:33.828447 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b762f4e-7780-4b3f-964b-0d50bbcbdd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:33.830365 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b762f4e-7780-4b3f-964b-0d50bbcbdd88 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:33.830802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b762f4e-7780-4b3f-964b-0d50bbcbdd88 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:33.831343 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b762f4e-7780-4b3f-964b-0d50bbcbdd88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:33.983335 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:33.999429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b762f4e-7780-4b3f-964b-0d50bbcbdd88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:34.003309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b762f4e-7780-4b3f-964b-0d50bbcbdd88 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:34.224610 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 49/95] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 716 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:18:34.231031 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d1814-95f7-43e6-a37b-516d265e3ae8 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:34.234872 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:34.420545 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d1814-95f7-43e6-a37b-516d265e3ae8 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:34.476308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bac22-f98b-4ee2-844f-8e05b778a56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:34.477454 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bac22-f98b-4ee2-844f-8e05b778a56d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:34.477941 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bac22-f98b-4ee2-844f-8e05b778a56d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:34.478414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bac22-f98b-4ee2-844f-8e05b778a56d None admin] PATH_INFO: `/v3/projects/3fbc93bff3134e5eb5c4e738d1fe1e88` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:34.479987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bac22-f98b-4ee2-844f-8e05b778a56d None admin] RBAC: Authorizing `identity:get_project(project_id=3fbc93bff3134e5eb5c4e738d1fe1e88)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:34.481816 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bac22-f98b-4ee2-844f-8e05b778a56d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:34.484295 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 47/96] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:34 2022] GET /identity/v3/projects/3fbc93bff3134e5eb5c4e738d1fe1e88 => generated 312 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:34.491649 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b762f4e-7780-4b3f-964b-0d50bbcbdd88 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:34.729066 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:34.737441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b762f4e-7780-4b3f-964b-0d50bbcbdd88 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:34.794627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd3022-41d5-45f4-9e20-328e9d83d9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:34.795160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd3022-41d5-45f4-9e20-328e9d83d9e2 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:34.795445 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd3022-41d5-45f4-9e20-328e9d83d9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:34.795714 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd3022-41d5-45f4-9e20-328e9d83d9e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:34.796542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd3022-41d5-45f4-9e20-328e9d83d9e2 None admin] RBAC: Adding query filter params (role.id=76a38a2307da45bcb511ef106076613d, scope.project.id=3fbc93bff3134e5eb5c4e738d1fe1e88, user.id=08a10ce8373d40309074b328c9c29722) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:34.796911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd3022-41d5-45f4-9e20-328e9d83d9e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:34.801093 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd3022-41d5-45f4-9e20-328e9d83d9e2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:34.814106 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 50/97] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:34 2022] GET /identity/v3/role_assignments?user.id=08a10ce8373d40309074b328c9c29722&scope.project.id=3fbc93bff3134e5eb5c4e738d1fe1e88&role.id=76a38a2307da45bcb511ef106076613d => generated 259 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:34.885656 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddd6cf-2d3f-4d22-8dbe-0ef8ae94cc34 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:34.886164 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddd6cf-2d3f-4d22-8dbe-0ef8ae94cc34 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:34.886666 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddd6cf-2d3f-4d22-8dbe-0ef8ae94cc34 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:34.889255 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 48/98] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:18:34.899139 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38c49b-93ab-4988-a599-cdb562104289 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:34.899633 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38c49b-93ab-4988-a599-cdb562104289 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:34.900122 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38c49b-93ab-4988-a599-cdb562104289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:34.936855 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5d38c49b-93ab-4988-a599-cdb562104289 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:34.939723 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5d38c49b-93ab-4988-a599-cdb562104289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:35.117502 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 51/99] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:35.671099 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddd6cf-2d3f-4d22-8dbe-0ef8ae94cc34 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:35.786526 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:35.836456 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddd6cf-2d3f-4d22-8dbe-0ef8ae94cc34 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:35.892571 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0f023-c825-478a-b860-f763c7ee0313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:35.893289 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0f023-c825-478a-b860-f763c7ee0313 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:35.893572 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0f023-c825-478a-b860-f763c7ee0313 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:35.893853 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0f023-c825-478a-b860-f763c7ee0313 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:35.913938 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0f023-c825-478a-b860-f763c7ee0313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:35.919156 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-f3f0f023-c825-478a-b860-f763c7ee0313 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:18:35.919156 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:35.919156 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:35.919156 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:35.919156 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:35.919156 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:35.919156 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:35.919156 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:35.919156 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:35.919156 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:35.919156 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:35.919156 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:35.919156 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:35.919156 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:35.919156 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:35.919156 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:35.920452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:35.920452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:35.920452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:35.920452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:35.920452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:35.920452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:35.920452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:35.920452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:35.920452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:35.920452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:35.920452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:35.920452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:35.920452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:35.920452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:35.920452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:35.920452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:35.921380 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:35.921380 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:35.921380 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:35.921380 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:35.921380 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:35.921380 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:35.921380 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:35.921380 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:35.921380 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:35.921380 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:35.921380 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:18:35.921380 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:18:35.921380 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 49/100] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:18:35.927631 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38c49b-93ab-4988-a599-cdb562104289 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:36.093019 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:36.103682 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38c49b-93ab-4988-a599-cdb562104289 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:36.159271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937bd64-6400-4a61-b8b6-8657e4a53cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:36.159918 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937bd64-6400-4a61-b8b6-8657e4a53cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:36.160202 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937bd64-6400-4a61-b8b6-8657e4a53cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:36.160477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937bd64-6400-4a61-b8b6-8657e4a53cf2 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:36.161319 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937bd64-6400-4a61-b8b6-8657e4a53cf2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:36.161630 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937bd64-6400-4a61-b8b6-8657e4a53cf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:36.163115 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937bd64-6400-4a61-b8b6-8657e4a53cf2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:36.177896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 52/101] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:18:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:36.183559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0f023-c825-478a-b860-f763c7ee0313 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:36.363706 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0f023-c825-478a-b860-f763c7ee0313 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:36.440892 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:36.449136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782c1e1-d47a-44d9-910d-e0879dbc0c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:36.453794 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782c1e1-d47a-44d9-910d-e0879dbc0c8f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:36.459509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782c1e1-d47a-44d9-910d-e0879dbc0c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:36.460085 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782c1e1-d47a-44d9-910d-e0879dbc0c8f None admin] PATH_INFO: `/v3/users/08a10ce8373d40309074b328c9c29722` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:36.461963 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782c1e1-d47a-44d9-910d-e0879dbc0c8f None admin] RBAC: Authorizing `identity:get_user(user_id=08a10ce8373d40309074b328c9c29722)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:36.463901 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782c1e1-d47a-44d9-910d-e0879dbc0c8f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:36.467176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 50/102] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:36 2022] GET /identity/v3/users/08a10ce8373d40309074b328c9c29722 => generated 275 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:36.476673 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937bd64-6400-4a61-b8b6-8657e4a53cf2 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:36.647954 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937bd64-6400-4a61-b8b6-8657e4a53cf2 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:36.701911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce9fd4-5360-46f4-b529-6f942b68b4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:36.702496 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce9fd4-5360-46f4-b529-6f942b68b4aa None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:36.702779 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce9fd4-5360-46f4-b529-6f942b68b4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:36.703061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce9fd4-5360-46f4-b529-6f942b68b4aa None admin] PATH_INFO: `/v3/projects/c6ec2c26955d46c3a767d88695f36411` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:36.709573 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce9fd4-5360-46f4-b529-6f942b68b4aa None admin] RBAC: Authorizing `identity:get_project(project_id=c6ec2c26955d46c3a767d88695f36411)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:36.711128 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce9fd4-5360-46f4-b529-6f942b68b4aa None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:36.713050 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 53/103] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:36 2022] GET /identity/v3/projects/c6ec2c26955d46c3a767d88695f36411 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:36.719164 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782c1e1-d47a-44d9-910d-e0879dbc0c8f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:36.856853 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782c1e1-d47a-44d9-910d-e0879dbc0c8f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:36.906297 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64161f69-7ec9-4ced-91be-f3ce2bc9b38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:36.907013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64161f69-7ec9-4ced-91be-f3ce2bc9b38f None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:36.907846 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64161f69-7ec9-4ced-91be-f3ce2bc9b38f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:36.908155 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64161f69-7ec9-4ced-91be-f3ce2bc9b38f None admin] PATH_INFO: `/v3/projects/c6ec2c26955d46c3a767d88695f36411/users/08a10ce8373d40309074b328c9c29722/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:36.910348 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64161f69-7ec9-4ced-91be-f3ce2bc9b38f None admin] RBAC: Authorizing `identity:create_grant(project_id=c6ec2c26955d46c3a767d88695f36411, user_id=08a10ce8373d40309074b328c9c29722, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:36.911863 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64161f69-7ec9-4ced-91be-f3ce2bc9b38f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:36.934706 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 51/104] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 1 16:18:36 2022] PUT /identity/v3/projects/c6ec2c26955d46c3a767d88695f36411/users/08a10ce8373d40309074b328c9c29722/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:18:37.551379 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756863fb-6e0c-4918-b4be-49cb1362681a None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:37.552157 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756863fb-6e0c-4918-b4be-49cb1362681a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:37.552157 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756863fb-6e0c-4918-b4be-49cb1362681a None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:37.553494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 54/105] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:18:37.559582 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c79ee-e0b2-4035-b25a-dbb46eca2fbc None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:37.559986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c79ee-e0b2-4035-b25a-dbb46eca2fbc None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:37.560142 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c79ee-e0b2-4035-b25a-dbb46eca2fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:37.581327 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a71c79ee-e0b2-4035-b25a-dbb46eca2fbc None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:37.582582 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a71c79ee-e0b2-4035-b25a-dbb46eca2fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:37.639248 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dcb07-b330-4ae5-9c0a-aa52839f4e80 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:37.639517 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dcb07-b330-4ae5-9c0a-aa52839f4e80 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:37.639829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dcb07-b330-4ae5-9c0a-aa52839f4e80 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:37.641255 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 55/106] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:37.653333 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:37.654493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b683e7-761f-4af2-b92f-3ad7b5d1b163 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:37.654782 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b683e7-761f-4af2-b92f-3ad7b5d1b163 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:37.655063 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b683e7-761f-4af2-b92f-3ad7b5d1b163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:37.690235 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c5b683e7-761f-4af2-b92f-3ad7b5d1b163 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:37.691668 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c5b683e7-761f-4af2-b92f-3ad7b5d1b163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:37.698701 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 52/107] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:37.726229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:37.862627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 56/108] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:38.214021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c79ee-e0b2-4035-b25a-dbb46eca2fbc None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:38.233803 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b683e7-761f-4af2-b92f-3ad7b5d1b163 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:38.527372 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b683e7-761f-4af2-b92f-3ad7b5d1b163 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:38.572658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c79ee-e0b2-4035-b25a-dbb46eca2fbc None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:38.624356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e224e-39c0-411d-9c17-fbecb7602715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:38.626012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e224e-39c0-411d-9c17-fbecb7602715 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:38.626460 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e224e-39c0-411d-9c17-fbecb7602715 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:38.627394 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e224e-39c0-411d-9c17-fbecb7602715 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:38.628903 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e224e-39c0-411d-9c17-fbecb7602715 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:38.630793 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e224e-39c0-411d-9c17-fbecb7602715 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:38.633429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 57/109] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:38.634943 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54fdff-c4f0-458d-99f6-9b0676602727 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:38.635423 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54fdff-c4f0-458d-99f6-9b0676602727 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:38.635862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54fdff-c4f0-458d-99f6-9b0676602727 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:38.637488 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 58/110] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:38.643903 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54fdff-c4f0-458d-99f6-9b0676602727 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:38.682299 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:38.685391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1677517-34ee-4d14-9b0e-a4f7fd7ac22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:38.686269 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1677517-34ee-4d14-9b0e-a4f7fd7ac22e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:38.686637 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1677517-34ee-4d14-9b0e-a4f7fd7ac22e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:38.686926 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1677517-34ee-4d14-9b0e-a4f7fd7ac22e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:38.711993 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1677517-34ee-4d14-9b0e-a4f7fd7ac22e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:38.717137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-b1677517-34ee-4d14-9b0e-a4f7fd7ac22e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:18:38.717137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:38.717137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:38.717137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:38.717137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:38.717137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:38.717137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:38.717137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:38.717137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:38.717137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:38.717137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:38.717137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:38.717137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:38.717137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:38.717137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:38.717137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:38.718774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:38.718774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:38.718774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:38.718774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:38.718774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:38.718774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:38.718774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:38.718774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:38.718774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:38.718774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:38.718774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:38.718774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:38.718774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:38.718774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:38.718774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:38.718774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:38.720781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:38.720781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:38.720781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:38.720781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:38.720781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:38.720781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:38.720781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:38.720781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:38.720781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:38.720781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:38.720781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:18:38.720781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:18:38.720781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 53/111] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 505 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:18:38.720781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615ee99-5f68-44e5-ac59-04278e90fe54 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:38.723017 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615ee99-5f68-44e5-ac59-04278e90fe54 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:38.723017 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615ee99-5f68-44e5-ac59-04278e90fe54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:38.742087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0615ee99-5f68-44e5-ac59-04278e90fe54 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:38.743348 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0615ee99-5f68-44e5-ac59-04278e90fe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:38.818062 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:38.852847 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54fdff-c4f0-458d-99f6-9b0676602727 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:38.862780 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 54/112] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:38.865387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5fe87-66ea-4ca8-8dcf-6c5280be4d02 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:38.865893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5fe87-66ea-4ca8-8dcf-6c5280be4d02 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:38.866394 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5fe87-66ea-4ca8-8dcf-6c5280be4d02 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:38.869102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 55/113] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:38.870453 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5fe87-66ea-4ca8-8dcf-6c5280be4d02 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:38.931373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6bdc3-ca90-4d74-be7b-34b2d6f10f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:38.932079 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6bdc3-ca90-4d74-be7b-34b2d6f10f6e None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:38.932365 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6bdc3-ca90-4d74-be7b-34b2d6f10f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:38.932656 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6bdc3-ca90-4d74-be7b-34b2d6f10f6e None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:38.933342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6bdc3-ca90-4d74-be7b-34b2d6f10f6e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:38.934870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6bdc3-ca90-4d74-be7b-34b2d6f10f6e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:38.980252 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 59/114] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 1 16:18:38 2022] POST /identity/v3/projects => generated 302 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:18:38.982929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a52701-0270-42b3-b101-b374354f45d3 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:38.983768 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a52701-0270-42b3-b101-b374354f45d3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:38.984506 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a52701-0270-42b3-b101-b374354f45d3 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:38.987683 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 60/115] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:38.990536 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7905de-e84b-4195-8d3e-501db32b90f0 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:38.991872 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7905de-e84b-4195-8d3e-501db32b90f0 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:38.992841 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7905de-e84b-4195-8d3e-501db32b90f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:39.028388 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8b7905de-e84b-4195-8d3e-501db32b90f0 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:39.031047 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8b7905de-e84b-4195-8d3e-501db32b90f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:39.108098 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5fe87-66ea-4ca8-8dcf-6c5280be4d02 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:39.186380 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28733c5-5384-44f8-963b-ed198a7bea63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:39.187481 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28733c5-5384-44f8-963b-ed198a7bea63 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:39.188060 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28733c5-5384-44f8-963b-ed198a7bea63 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:39.189161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28733c5-5384-44f8-963b-ed198a7bea63 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:39.190435 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28733c5-5384-44f8-963b-ed198a7bea63 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:39.196800 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28733c5-5384-44f8-963b-ed198a7bea63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:39.196800 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28733c5-5384-44f8-963b-ed198a7bea63 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:39.213180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 56/116] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:18:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:39.217186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba5ccb-15c5-4ea2-bea6-7a427b70d445 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:39.217186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba5ccb-15c5-4ea2-bea6-7a427b70d445 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:39.217186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba5ccb-15c5-4ea2-bea6-7a427b70d445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:39.242421 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:39.254514 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d5ba5ccb-15c5-4ea2-bea6-7a427b70d445 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:39.257379 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d5ba5ccb-15c5-4ea2-bea6-7a427b70d445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:39.264536 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 61/117] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:39.265861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7905de-e84b-4195-8d3e-501db32b90f0 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:39.349808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:39.492122 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 57/118] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:39.509135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba5ccb-15c5-4ea2-bea6-7a427b70d445 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:39.640933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7905de-e84b-4195-8d3e-501db32b90f0 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:39.774372 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49512c-d3f6-44b7-b5bf-70e9eb8eb090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:39.777731 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49512c-d3f6-44b7-b5bf-70e9eb8eb090 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:39.778610 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49512c-d3f6-44b7-b5bf-70e9eb8eb090 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:39.780414 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49512c-d3f6-44b7-b5bf-70e9eb8eb090 None admin] PATH_INFO: `/v3/users/cdc4ef8e117d47f58023f83a2dce5c2f` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:39.847877 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49512c-d3f6-44b7-b5bf-70e9eb8eb090 None admin] RBAC: Authorizing `identity:get_user(user_id=cdc4ef8e117d47f58023f83a2dce5c2f)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:39.850386 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49512c-d3f6-44b7-b5bf-70e9eb8eb090 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:39.856806 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 62/119] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:39 2022] GET /identity/v3/users/cdc4ef8e117d47f58023f83a2dce5c2f => generated 289 bytes in 588 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:39.858635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49512c-d3f6-44b7-b5bf-70e9eb8eb090 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:39.898264 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba5ccb-15c5-4ea2-bea6-7a427b70d445 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:39.991420 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494bd40-4b1c-4e6a-a483-c0efe5c8fe50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:39.992973 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494bd40-4b1c-4e6a-a483-c0efe5c8fe50 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:39.993928 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:39.995002 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494bd40-4b1c-4e6a-a483-c0efe5c8fe50 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:39.995754 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494bd40-4b1c-4e6a-a483-c0efe5c8fe50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:40.019337 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494bd40-4b1c-4e6a-a483-c0efe5c8fe50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:40.030344 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-f494bd40-4b1c-4e6a-a483-c0efe5c8fe50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:40.030344 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:40.030344 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:40.030344 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:40.030344 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:40.030344 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:40.030344 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:40.030344 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:40.030344 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:40.030344 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:40.030344 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:40.030344 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:40.030344 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:40.030344 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:40.030344 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:40.030344 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:40.031962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:40.031962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:40.031962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:40.031962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:40.031962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:40.031962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:40.031962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:40.031962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:40.031962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:40.031962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:40.031962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:40.031962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:40.031962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:40.031962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:40.031962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:40.031962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:40.034025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:40.034025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:40.034025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:40.034025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:40.034025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:40.034025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:40.034025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:40.034025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:40.034025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:40.034025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:40.034025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:40.034025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:18:40.036936 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 58/120] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:18:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 529 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:18:40.037923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494bd40-4b1c-4e6a-a483-c0efe5c8fe50 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:40.083959 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49512c-d3f6-44b7-b5bf-70e9eb8eb090 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:40.090594 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:40.146177 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b27808-45a2-49b1-aafb-6404354bcfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:40.146832 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b27808-45a2-49b1-aafb-6404354bcfbc None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:40.147118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b27808-45a2-49b1-aafb-6404354bcfbc None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:40.147399 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b27808-45a2-49b1-aafb-6404354bcfbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:40.234976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b27808-45a2-49b1-aafb-6404354bcfbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:40.237020 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b27808-45a2-49b1-aafb-6404354bcfbc None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:40.248206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494bd40-4b1c-4e6a-a483-c0efe5c8fe50 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:40.312651 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:40.326264 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bddb1e-66f1-4e2c-9f51-b38110140661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:40.328016 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bddb1e-66f1-4e2c-9f51-b38110140661 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:40.328876 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bddb1e-66f1-4e2c-9f51-b38110140661 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:40.330212 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bddb1e-66f1-4e2c-9f51-b38110140661 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:40.352984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bddb1e-66f1-4e2c-9f51-b38110140661 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:40.365340 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-21bddb1e-66f1-4e2c-9f51-b38110140661 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:18:40.365340 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:40.365340 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:40.365340 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:40.365340 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:40.365340 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:40.365340 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:40.365340 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:40.365340 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:40.365340 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:40.365340 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:40.365340 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:40.365340 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:40.365340 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:40.365340 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:40.365340 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:40.367013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:40.367013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:40.367013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:40.367013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:40.367013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:40.367013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:40.367013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:40.367013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:40.367013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:40.367013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:40.367013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:40.367013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:40.367013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:40.367013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:40.367013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:40.367013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:40.368465 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:40.368465 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:40.368465 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:40.368465 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:40.368465 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:40.368465 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:40.368465 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:40.368465 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:40.368465 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:40.368465 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:40.368465 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:18:40.368465 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:18:40.370833 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 63/121] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:18:40.371877 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b27808-45a2-49b1-aafb-6404354bcfbc None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:40.373403 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 59/122] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 1 16:18:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:40.375442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bddb1e-66f1-4e2c-9f51-b38110140661 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:40.507967 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b27808-45a2-49b1-aafb-6404354bcfbc None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:40.554627 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:40.567029 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ede7f-22bd-4ca6-bd4e-ca20a3f9693f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:40.567582 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ede7f-22bd-4ca6-bd4e-ca20a3f9693f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:40.567866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ede7f-22bd-4ca6-bd4e-ca20a3f9693f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:40.568146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ede7f-22bd-4ca6-bd4e-ca20a3f9693f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:40.568416 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bddb1e-66f1-4e2c-9f51-b38110140661 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:40.585362 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ede7f-22bd-4ca6-bd4e-ca20a3f9693f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:40.594022 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-b61ede7f-22bd-4ca6-bd4e-ca20a3f9693f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:18:40.594022 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:40.594022 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:40.594022 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:40.594022 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:40.594022 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:40.594022 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:40.594022 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:40.594022 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:40.594022 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:40.594022 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:40.594022 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:40.594022 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:40.594022 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:40.594022 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:40.594022 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:40.595549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:40.595549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:40.595549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:40.595549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:40.595549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:40.595549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:40.595549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:40.595549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:40.595549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:40.595549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:40.595549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:40.595549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:40.595549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:40.595549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:40.595549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:40.595549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:40.596318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:40.596318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:40.596318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:40.596318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:40.596318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:40.596318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:40.596318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:40.596318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:40.596318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:40.596318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:40.596318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:18:40.596318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:18:40.597437 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 64/123] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:40.601439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ede7f-22bd-4ca6-bd4e-ca20a3f9693f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:40.625672 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736d2f5-01c0-427a-a4f4-a7943270537f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:40.626968 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:40.627644 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736d2f5-01c0-427a-a4f4-a7943270537f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:40.628067 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736d2f5-01c0-427a-a4f4-a7943270537f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:40.628470 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736d2f5-01c0-427a-a4f4-a7943270537f None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:40.629637 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736d2f5-01c0-427a-a4f4-a7943270537f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:40.630070 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736d2f5-01c0-427a-a4f4-a7943270537f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:40.632861 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736d2f5-01c0-427a-a4f4-a7943270537f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:40.646475 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 60/124] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:40.647696 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736d2f5-01c0-427a-a4f4-a7943270537f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:40.770293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ede7f-22bd-4ca6-bd4e-ca20a3f9693f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:40.775104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736d2f5-01c0-427a-a4f4-a7943270537f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:40.823171 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9995c-7660-490d-b370-a6e10c64da0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:40.823737 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9995c-7660-490d-b370-a6e10c64da0c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:40.823998 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9995c-7660-490d-b370-a6e10c64da0c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:40.824110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91783b-3549-49d3-9a94-ba284c53b1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:40.824311 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9995c-7660-490d-b370-a6e10c64da0c None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:40.825003 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9995c-7660-490d-b370-a6e10c64da0c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:40.825185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91783b-3549-49d3-9a94-ba284c53b1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:40.825336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9995c-7660-490d-b370-a6e10c64da0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:40.825657 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91783b-3549-49d3-9a94-ba284c53b1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:40.826163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91783b-3549-49d3-9a94-ba284c53b1f4 None admin] PATH_INFO: `/v3/projects/c6ec2c26955d46c3a767d88695f36411` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:40.826758 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9995c-7660-490d-b370-a6e10c64da0c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:40.828299 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91783b-3549-49d3-9a94-ba284c53b1f4 None admin] RBAC: Authorizing `identity:get_project(project_id=c6ec2c26955d46c3a767d88695f36411)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:40.831178 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91783b-3549-49d3-9a94-ba284c53b1f4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:40.839759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 61/125] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:40 2022] GET /identity/v3/projects/c6ec2c26955d46c3a767d88695f36411 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:40.839759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd842b9-9b53-4ad9-a633-601a76cb5e83 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:40.839759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd842b9-9b53-4ad9-a633-601a76cb5e83 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:40.839759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd842b9-9b53-4ad9-a633-601a76cb5e83 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:40.840556 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 62/126] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:40.842039 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd842b9-9b53-4ad9-a633-601a76cb5e83 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:40.856124 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 65/127] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:18:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:40.856124 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9995c-7660-490d-b370-a6e10c64da0c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:40.886680 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:40.992525 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:41.009348 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd842b9-9b53-4ad9-a633-601a76cb5e83 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:41.020897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9995c-7660-490d-b370-a6e10c64da0c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:41.068646 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac9e20-9099-419f-b3ab-3dc93e087756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:41.069669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac9e20-9099-419f-b3ab-3dc93e087756 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:41.070111 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac9e20-9099-419f-b3ab-3dc93e087756 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:41.070585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac9e20-9099-419f-b3ab-3dc93e087756 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:41.071473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac9e20-9099-419f-b3ab-3dc93e087756 None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:41.072203 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac9e20-9099-419f-b3ab-3dc93e087756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:41.073903 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393744c2-a631-45ec-9f59-714e6069d6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:41.074123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac9e20-9099-419f-b3ab-3dc93e087756 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:41.074492 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393744c2-a631-45ec-9f59-714e6069d6e9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:41.074778 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393744c2-a631-45ec-9f59-714e6069d6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:41.075059 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393744c2-a631-45ec-9f59-714e6069d6e9 None admin] PATH_INFO: `/v3/users/2b43f72ae2234a7eb9bf83a968fd7292` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:41.076649 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393744c2-a631-45ec-9f59-714e6069d6e9 None admin] RBAC: Authorizing `identity:get_user(user_id=2b43f72ae2234a7eb9bf83a968fd7292)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:41.078675 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393744c2-a631-45ec-9f59-714e6069d6e9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:41.087359 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 66/128] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:40 2022] GET /identity/v3/users/2b43f72ae2234a7eb9bf83a968fd7292 => generated 247 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:41.087359 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393744c2-a631-45ec-9f59-714e6069d6e9 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:41.090127 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 63/129] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:18:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:41.094468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fdeeb-bee8-4939-8e8f-a48bd58b045f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:41.095453 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fdeeb-bee8-4939-8e8f-a48bd58b045f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:41.096816 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fdeeb-bee8-4939-8e8f-a48bd58b045f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:41.116917 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f72fdeeb-bee8-4939-8e8f-a48bd58b045f None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:41.119036 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f72fdeeb-bee8-4939-8e8f-a48bd58b045f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:41.219160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393744c2-a631-45ec-9f59-714e6069d6e9 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:41.253405 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 64/130] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:41.255283 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fdeeb-bee8-4939-8e8f-a48bd58b045f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:41.273065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0cb9f-07c1-47e1-bbaf-7afc65c014a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:41.273721 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0cb9f-07c1-47e1-bbaf-7afc65c014a2 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:41.274117 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0cb9f-07c1-47e1-bbaf-7afc65c014a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:41.274402 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0cb9f-07c1-47e1-bbaf-7afc65c014a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:41.275171 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0cb9f-07c1-47e1-bbaf-7afc65c014a2 None admin] RBAC: Adding query filter params (role.id=2b507beec2294bd293287825491de4bc, scope.project.id=c6ec2c26955d46c3a767d88695f36411, user.id=cdc4ef8e117d47f58023f83a2dce5c2f) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:41.275566 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0cb9f-07c1-47e1-bbaf-7afc65c014a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:41.276292 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:41.277266 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0cb9f-07c1-47e1-bbaf-7afc65c014a2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:41.286858 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 67/131] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:41 2022] GET /identity/v3/role_assignments?user.id=cdc4ef8e117d47f58023f83a2dce5c2f&scope.project.id=c6ec2c26955d46c3a767d88695f36411&role.id=2b507beec2294bd293287825491de4bc => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:41.287838 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0cb9f-07c1-47e1-bbaf-7afc65c014a2 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:41.317270 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:41.459485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fdeeb-bee8-4939-8e8f-a48bd58b045f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:41.512224 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0cb9f-07c1-47e1-bbaf-7afc65c014a2 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:41.552962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5234fc-93be-4960-aa3a-7699b876815f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:41.553683 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5234fc-93be-4960-aa3a-7699b876815f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:41.553969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5234fc-93be-4960-aa3a-7699b876815f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:41.554244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5234fc-93be-4960-aa3a-7699b876815f None admin] PATH_INFO: `/v3/users/08a10ce8373d40309074b328c9c29722` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:41.558431 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5234fc-93be-4960-aa3a-7699b876815f None admin] RBAC: Authorizing `identity:get_user(user_id=08a10ce8373d40309074b328c9c29722)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:41.560165 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5234fc-93be-4960-aa3a-7699b876815f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:41.561868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 65/132] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:41 2022] GET /identity/v3/users/08a10ce8373d40309074b328c9c29722 => generated 275 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:41.562892 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5234fc-93be-4960-aa3a-7699b876815f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:41.591384 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a806207-eac8-4e63-928a-8cccdb80e53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:41.592055 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a806207-eac8-4e63-928a-8cccdb80e53c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:41.592340 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a806207-eac8-4e63-928a-8cccdb80e53c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:41.592789 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a806207-eac8-4e63-928a-8cccdb80e53c None admin] PATH_INFO: `/v3/projects/c6ec2c26955d46c3a767d88695f36411` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:41.594119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a806207-eac8-4e63-928a-8cccdb80e53c None admin] RBAC: Authorizing `identity:get_project(project_id=c6ec2c26955d46c3a767d88695f36411)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:41.595831 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a806207-eac8-4e63-928a-8cccdb80e53c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:41.598849 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 68/133] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:41 2022] GET /identity/v3/projects/c6ec2c26955d46c3a767d88695f36411 => generated 298 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:41.599796 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a806207-eac8-4e63-928a-8cccdb80e53c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:41.728507 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:41.749432 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:41.780443 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a806207-eac8-4e63-928a-8cccdb80e53c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:41.781350 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5234fc-93be-4960-aa3a-7699b876815f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:41.846838 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae6a51-bce9-4465-a95c-9d0107016dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:41.848215 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae6a51-bce9-4465-a95c-9d0107016dae None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:41.848751 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae6a51-bce9-4465-a95c-9d0107016dae None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:41.849222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae6a51-bce9-4465-a95c-9d0107016dae None admin] PATH_INFO: `/v3/projects/c6ec2c26955d46c3a767d88695f36411` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:41.851227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae6a51-bce9-4465-a95c-9d0107016dae None admin] RBAC: Authorizing `identity:get_project(project_id=c6ec2c26955d46c3a767d88695f36411)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:41.854103 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae6a51-bce9-4465-a95c-9d0107016dae None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:41.855825 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a40ba-5cef-4ac3-86ea-c8a2e3ff8495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:41.857229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a40ba-5cef-4ac3-86ea-c8a2e3ff8495 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:41.857591 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 69/134] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:41 2022] GET /identity/v3/projects/c6ec2c26955d46c3a767d88695f36411 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:41.858299 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a40ba-5cef-4ac3-86ea-c8a2e3ff8495 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:41.858997 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a40ba-5cef-4ac3-86ea-c8a2e3ff8495 None admin] PATH_INFO: `/v3/users/08a10ce8373d40309074b328c9c29722` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:41.859145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae6a51-bce9-4465-a95c-9d0107016dae None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:41.861726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a40ba-5cef-4ac3-86ea-c8a2e3ff8495 None admin] RBAC: Authorizing `identity:get_user(user_id=08a10ce8373d40309074b328c9c29722)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:41.866263 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a40ba-5cef-4ac3-86ea-c8a2e3ff8495 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:41.869721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 66/135] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:41 2022] GET /identity/v3/users/08a10ce8373d40309074b328c9c29722 => generated 275 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:41.879138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a40ba-5cef-4ac3-86ea-c8a2e3ff8495 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:42.032889 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae6a51-bce9-4465-a95c-9d0107016dae None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:42.058051 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a40ba-5cef-4ac3-86ea-c8a2e3ff8495 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:42.086703 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f64d9-7fec-4958-a77e-74cd7eed8cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:42.087562 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f64d9-7fec-4958-a77e-74cd7eed8cad None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:42.087974 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f64d9-7fec-4958-a77e-74cd7eed8cad None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:42.088393 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f64d9-7fec-4958-a77e-74cd7eed8cad None admin] PATH_INFO: `/v3/projects/c6ec2c26955d46c3a767d88695f36411/users/2b43f72ae2234a7eb9bf83a968fd7292/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:42.091883 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f64d9-7fec-4958-a77e-74cd7eed8cad None admin] RBAC: Authorizing `identity:create_grant(project_id=c6ec2c26955d46c3a767d88695f36411, user_id=2b43f72ae2234a7eb9bf83a968fd7292, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:42.094440 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f64d9-7fec-4958-a77e-74cd7eed8cad None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:42.105636 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed683e-815a-4bbc-9d0f-13fd07e6c684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:42.106706 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed683e-815a-4bbc-9d0f-13fd07e6c684 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:42.107315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed683e-815a-4bbc-9d0f-13fd07e6c684 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:42.107767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed683e-815a-4bbc-9d0f-13fd07e6c684 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:42.115147 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 70/136] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 1 16:18:41 2022] PUT /identity/v3/projects/c6ec2c26955d46c3a767d88695f36411/users/2b43f72ae2234a7eb9bf83a968fd7292/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:18:42.116377 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f64d9-7fec-4958-a77e-74cd7eed8cad None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:42.123966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed683e-815a-4bbc-9d0f-13fd07e6c684 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:42.131983 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-2fed683e-815a-4bbc-9d0f-13fd07e6c684 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:18:42.131983 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:42.131983 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:42.131983 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:42.131983 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:42.131983 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:42.131983 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:42.131983 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:42.131983 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:42.131983 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:42.131983 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:42.131983 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:42.131983 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:42.131983 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:42.131983 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:42.131983 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:42.132949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:42.132949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:42.132949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:42.132949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:42.132949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:42.132949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:42.132949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:42.132949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:42.132949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:42.132949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:42.132949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:42.132949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:42.132949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:42.132949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:42.132949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:42.132949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:42.133719 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:42.133719 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:42.133719 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:42.133719 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:42.133719 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:42.133719 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:42.133719 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:42.133719 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:42.133719 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:42.133719 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:42.133719 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:18:42.133719 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:18:42.134307 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:42.136614 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 67/137] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:42.137913 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed683e-815a-4bbc-9d0f-13fd07e6c684 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:42.152749 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:42.273734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f64d9-7fec-4958-a77e-74cd7eed8cad None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:42.323779 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149032d-0258-4d4a-ab93-3deedd0f1dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:42.325565 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149032d-0258-4d4a-ab93-3deedd0f1dcc None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:42.326044 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149032d-0258-4d4a-ab93-3deedd0f1dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:42.326500 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149032d-0258-4d4a-ab93-3deedd0f1dcc None admin] PATH_INFO: `/v3/projects/c6ec2c26955d46c3a767d88695f36411/users/08a10ce8373d40309074b328c9c29722/roles/f889b15cab8c46f58be00f84143aac60` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:42.331320 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3149032d-0258-4d4a-ab93-3deedd0f1dcc None admin] RBAC: Authorizing `identity:create_grant(project_id=c6ec2c26955d46c3a767d88695f36411, user_id=08a10ce8373d40309074b328c9c29722, role_id=f889b15cab8c46f58be00f84143aac60)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:42.333923 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3149032d-0258-4d4a-ab93-3deedd0f1dcc None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:42.357994 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 71/138] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 1 16:18:42 2022] PUT /identity/v3/projects/c6ec2c26955d46c3a767d88695f36411/users/08a10ce8373d40309074b328c9c29722/roles/f889b15cab8c46f58be00f84143aac60 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:18:42.359201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149032d-0258-4d4a-ab93-3deedd0f1dcc None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:42.367944 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed683e-815a-4bbc-9d0f-13fd07e6c684 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:42.415329 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43249a-82eb-4e27-bc09-76b2e18fcd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:42.416249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43249a-82eb-4e27-bc09-76b2e18fcd24 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:42.416712 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43249a-82eb-4e27-bc09-76b2e18fcd24 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:42.417164 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43249a-82eb-4e27-bc09-76b2e18fcd24 None admin] PATH_INFO: `/v3/projects/3fbc93bff3134e5eb5c4e738d1fe1e88` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:42.418913 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43249a-82eb-4e27-bc09-76b2e18fcd24 None admin] RBAC: Authorizing `identity:get_project(project_id=3fbc93bff3134e5eb5c4e738d1fe1e88)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:42.421704 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43249a-82eb-4e27-bc09-76b2e18fcd24 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:42.423983 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 68/139] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:42 2022] GET /identity/v3/projects/3fbc93bff3134e5eb5c4e738d1fe1e88 => generated 312 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:42.431130 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43249a-82eb-4e27-bc09-76b2e18fcd24 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:42.491295 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:42.560446 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149032d-0258-4d4a-ab93-3deedd0f1dcc None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:42.608474 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:42.610988 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366df477-8c88-4587-a62e-464f7a975c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:42.610988 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366df477-8c88-4587-a62e-464f7a975c2a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:42.611405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366df477-8c88-4587-a62e-464f7a975c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:42.611880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366df477-8c88-4587-a62e-464f7a975c2a None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:42.612807 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366df477-8c88-4587-a62e-464f7a975c2a None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:42.613218 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366df477-8c88-4587-a62e-464f7a975c2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:42.615042 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366df477-8c88-4587-a62e-464f7a975c2a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:42.629445 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 72/140] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:18:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:42.638162 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366df477-8c88-4587-a62e-464f7a975c2a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:42.678412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43249a-82eb-4e27-bc09-76b2e18fcd24 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:42.753062 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db765f1-8b1b-4482-976a-29433cd7b074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:42.753923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db765f1-8b1b-4482-976a-29433cd7b074 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:42.754497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db765f1-8b1b-4482-976a-29433cd7b074 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:42.754874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db765f1-8b1b-4482-976a-29433cd7b074 None admin] PATH_INFO: `/v3/projects/3fbc93bff3134e5eb5c4e738d1fe1e88/users/08a10ce8373d40309074b328c9c29722/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:42.761634 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db765f1-8b1b-4482-976a-29433cd7b074 None admin] RBAC: Authorizing `identity:create_grant(project_id=3fbc93bff3134e5eb5c4e738d1fe1e88, user_id=08a10ce8373d40309074b328c9c29722, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:42.762995 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db765f1-8b1b-4482-976a-29433cd7b074 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:42.788000 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 69/141] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 1 16:18:42 2022] PUT /identity/v3/projects/3fbc93bff3134e5eb5c4e738d1fe1e88/users/08a10ce8373d40309074b328c9c29722/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:18:42.804750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366df477-8c88-4587-a62e-464f7a975c2a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:42.845599 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:42.858117 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740ad39-0bc3-4241-9cd0-7b18396f4c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:42.858752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740ad39-0bc3-4241-9cd0-7b18396f4c9f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:42.858943 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740ad39-0bc3-4241-9cd0-7b18396f4c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:42.859226 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740ad39-0bc3-4241-9cd0-7b18396f4c9f None admin] PATH_INFO: `/v3/users/08a10ce8373d40309074b328c9c29722` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:42.861580 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740ad39-0bc3-4241-9cd0-7b18396f4c9f None admin] RBAC: Authorizing `identity:get_user(user_id=08a10ce8373d40309074b328c9c29722)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:42.863203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740ad39-0bc3-4241-9cd0-7b18396f4c9f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:42.865311 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 73/142] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:42 2022] GET /identity/v3/users/08a10ce8373d40309074b328c9c29722 => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:42.873709 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db765f1-8b1b-4482-976a-29433cd7b074 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:42.984869 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc3384-1ddb-4c91-ac58-ca9ccffadf1e None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:42.985348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc3384-1ddb-4c91-ac58-ca9ccffadf1e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:42.986048 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc3384-1ddb-4c91-ac58-ca9ccffadf1e None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:42.988089 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 74/143] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:18:42.998401 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ec4b0-b5db-416e-a3d2-09e4ac085cc9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:42.998707 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ec4b0-b5db-416e-a3d2-09e4ac085cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:42.998979 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ec4b0-b5db-416e-a3d2-09e4ac085cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:43.041866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-993ec4b0-b5db-416e-a3d2-09e4ac085cc9 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:43.043144 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-993ec4b0-b5db-416e-a3d2-09e4ac085cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:43.096304 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db765f1-8b1b-4482-976a-29433cd7b074 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:43.142204 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90901e-5bd1-4a98-ba85-39c027928749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:43.142641 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90901e-5bd1-4a98-ba85-39c027928749 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:43.142966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90901e-5bd1-4a98-ba85-39c027928749 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:43.143246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90901e-5bd1-4a98-ba85-39c027928749 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:43.147436 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:43.203013 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 75/144] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:18:43.231362 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90901e-5bd1-4a98-ba85-39c027928749 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:43.232919 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90901e-5bd1-4a98-ba85-39c027928749 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:43.358697 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 70/145] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:18:43.364775 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ec4b0-b5db-416e-a3d2-09e4ac085cc9 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:43.503479 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ec4b0-b5db-416e-a3d2-09e4ac085cc9 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:43.535975 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:43.549862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce6194-2018-472d-9415-0d48c8df8511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:43.550546 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce6194-2018-472d-9415-0d48c8df8511 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:43.550831 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce6194-2018-472d-9415-0d48c8df8511 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:43.551111 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce6194-2018-472d-9415-0d48c8df8511 None admin] PATH_INFO: `/v3/projects/c6ec2c26955d46c3a767d88695f36411` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:43.552790 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce6194-2018-472d-9415-0d48c8df8511 None admin] RBAC: Authorizing `identity:get_project(project_id=c6ec2c26955d46c3a767d88695f36411)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:43.554325 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce6194-2018-472d-9415-0d48c8df8511 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:43.556115 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 76/146] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:43 2022] GET /identity/v3/projects/c6ec2c26955d46c3a767d88695f36411 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:43.562416 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90901e-5bd1-4a98-ba85-39c027928749 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:43.605493 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:43.689477 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90901e-5bd1-4a98-ba85-39c027928749 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:43.731470 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bddf5-7ab3-49a2-a019-0a359f2d3a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:43.732097 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bddf5-7ab3-49a2-a019-0a359f2d3a0f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:43.732379 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bddf5-7ab3-49a2-a019-0a359f2d3a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:43.732687 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bddf5-7ab3-49a2-a019-0a359f2d3a0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:43.733454 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bddf5-7ab3-49a2-a019-0a359f2d3a0f None admin] RBAC: Adding query filter params (role.id=76a38a2307da45bcb511ef106076613d, scope.project.id=c6ec2c26955d46c3a767d88695f36411, user.id=08a10ce8373d40309074b328c9c29722) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:43.733768 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bddf5-7ab3-49a2-a019-0a359f2d3a0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:43.735342 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bddf5-7ab3-49a2-a019-0a359f2d3a0f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:43.743322 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 71/147] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:43 2022] GET /identity/v3/role_assignments?user.id=08a10ce8373d40309074b328c9c29722&scope.project.id=c6ec2c26955d46c3a767d88695f36411&role.id=76a38a2307da45bcb511ef106076613d => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:44.160514 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce6194-2018-472d-9415-0d48c8df8511 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:44.395440 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce6194-2018-472d-9415-0d48c8df8511 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:44.474718 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edc9e6-bd56-46fb-86e3-eac8c3da9d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:44.476311 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edc9e6-bd56-46fb-86e3-eac8c3da9d10 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:44.477152 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edc9e6-bd56-46fb-86e3-eac8c3da9d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:44.477907 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edc9e6-bd56-46fb-86e3-eac8c3da9d10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:44.480400 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13edc9e6-bd56-46fb-86e3-eac8c3da9d10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:44.483616 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13edc9e6-bd56-46fb-86e3-eac8c3da9d10 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:44.487818 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 77/148] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:44.501569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bddf5-7ab3-49a2-a019-0a359f2d3a0f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:44.663797 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bddf5-7ab3-49a2-a019-0a359f2d3a0f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:44.682954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:44.720396 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968c4ab-9af3-4ffc-a09a-55854f6411ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:44.721065 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968c4ab-9af3-4ffc-a09a-55854f6411ca None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:44.721350 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968c4ab-9af3-4ffc-a09a-55854f6411ca None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:44.721701 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968c4ab-9af3-4ffc-a09a-55854f6411ca None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:44.722503 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968c4ab-9af3-4ffc-a09a-55854f6411ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:44.724182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968c4ab-9af3-4ffc-a09a-55854f6411ca None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:44.749836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 72/149] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 1 16:18:44 2022] POST /identity/v3/users => generated 283 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:18:44.932581 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81ff1b-4b2d-4092-b419-2a311c644eff None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:44.933040 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81ff1b-4b2d-4092-b419-2a311c644eff None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:44.933188 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81ff1b-4b2d-4092-b419-2a311c644eff None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:44.934639 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 78/150] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:18:44.941551 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a021a0-439b-4101-b7ac-a93cef644e08 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:44.941956 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a021a0-439b-4101-b7ac-a93cef644e08 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:44.942101 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a021a0-439b-4101-b7ac-a93cef644e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:44.971610 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f6a021a0-439b-4101-b7ac-a93cef644e08 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:44.973084 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f6a021a0-439b-4101-b7ac-a93cef644e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:45.078715 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 73/151] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:45.367403 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81ff1b-4b2d-4092-b419-2a311c644eff None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:45.485972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:45.565259 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81ff1b-4b2d-4092-b419-2a311c644eff None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:45.617845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a605a2e-8030-45e9-b02a-0c95ff70027b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:45.618728 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a605a2e-8030-45e9-b02a-0c95ff70027b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:45.619155 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a605a2e-8030-45e9-b02a-0c95ff70027b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:45.619573 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a605a2e-8030-45e9-b02a-0c95ff70027b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:45.636940 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a605a2e-8030-45e9-b02a-0c95ff70027b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:45.642728 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-1a605a2e-8030-45e9-b02a-0c95ff70027b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:18:45.642728 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:45.642728 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:45.642728 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:45.642728 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:45.642728 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:45.642728 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:45.642728 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:45.642728 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:45.642728 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:45.642728 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:45.642728 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:45.642728 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:45.642728 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:45.642728 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:45.642728 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:45.643629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:45.643629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:45.643629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:45.643629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:45.643629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:45.643629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:45.643629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:45.643629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:45.643629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:45.643629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:45.643629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:45.643629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:45.643629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:45.643629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:45.643629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:45.643629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:45.644389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:45.644389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:45.644389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:45.644389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:45.644389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:45.644389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:45.644389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:45.644389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:45.644389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:45.644389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:45.644389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:18:45.644389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:18:45.646826 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 79/152] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:45.652974 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a021a0-439b-4101-b7ac-a93cef644e08 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:45.774460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:45.789342 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a021a0-439b-4101-b7ac-a93cef644e08 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:45.811302 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c2b9b-8efe-4172-ab89-7e0382792620 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:45.811603 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c2b9b-8efe-4172-ab89-7e0382792620 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:45.811864 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c2b9b-8efe-4172-ab89-7e0382792620 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:45.813896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 80/153] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:45.819877 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ffba4-7f9b-46cb-bf56-b37121745468 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:45.820184 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ffba4-7f9b-46cb-bf56-b37121745468 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:45.820436 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ffba4-7f9b-46cb-bf56-b37121745468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:45.863924 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8c6ffba4-7f9b-46cb-bf56-b37121745468 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:45.865218 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8c6ffba4-7f9b-46cb-bf56-b37121745468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:45.887573 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4535ce-f082-48fb-a4ca-4c72c25b8e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:45.888557 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4535ce-f082-48fb-a4ca-4c72c25b8e64 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:45.889139 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4535ce-f082-48fb-a4ca-4c72c25b8e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:45.889647 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4535ce-f082-48fb-a4ca-4c72c25b8e64 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:45.890936 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4535ce-f082-48fb-a4ca-4c72c25b8e64 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:45.892010 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4535ce-f082-48fb-a4ca-4c72c25b8e64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:45.904866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4535ce-f082-48fb-a4ca-4c72c25b8e64 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:45.943337 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 74/154] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:18:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:45.949912 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4535ce-f082-48fb-a4ca-4c72c25b8e64 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:46.075880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 81/155] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:46.077731 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8969ac-bcb0-48a6-b838-fa5317fdea50 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:46.078285 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8969ac-bcb0-48a6-b838-fa5317fdea50 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:46.079428 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8969ac-bcb0-48a6-b838-fa5317fdea50 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:46.081173 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 82/156] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:46.090000 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0a044-3d0c-4a35-a327-276c96eb668b None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:46.090628 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0a044-3d0c-4a35-a327-276c96eb668b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:46.091282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0a044-3d0c-4a35-a327-276c96eb668b None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:46.092978 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 83/157] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:46 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:46.097515 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf97f3-261f-48b6-a0fb-510f475e138d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:46.098074 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf97f3-261f-48b6-a0fb-510f475e138d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:46.098614 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf97f3-261f-48b6-a0fb-510f475e138d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:46.120528 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a7cf97f3-261f-48b6-a0fb-510f475e138d None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:46.122263 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a7cf97f3-261f-48b6-a0fb-510f475e138d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:46.166162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4535ce-f082-48fb-a4ca-4c72c25b8e64 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:46.210166 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfe694-0c11-44bc-848e-027bdfcf42ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:46.211205 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfe694-0c11-44bc-848e-027bdfcf42ae None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:46.211628 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfe694-0c11-44bc-848e-027bdfcf42ae None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:46.212119 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfe694-0c11-44bc-848e-027bdfcf42ae None admin] PATH_INFO: `/v3/users/cdc4ef8e117d47f58023f83a2dce5c2f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:46.213628 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfe694-0c11-44bc-848e-027bdfcf42ae None admin] RBAC: Authorizing `identity:get_user(user_id=cdc4ef8e117d47f58023f83a2dce5c2f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:46.215344 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfe694-0c11-44bc-848e-027bdfcf42ae None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:46.217369 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 75/158] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:45 2022] GET /identity/v3/users/cdc4ef8e117d47f58023f83a2dce5c2f => generated 289 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:46.219007 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18978e5-8115-4e47-a64e-fd8843c5cec6 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:46.219561 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18978e5-8115-4e47-a64e-fd8843c5cec6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:46.220547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18978e5-8115-4e47-a64e-fd8843c5cec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:46.222801 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:46.244852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c18978e5-8115-4e47-a64e-fd8843c5cec6 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:46.246367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c18978e5-8115-4e47-a64e-fd8843c5cec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:46.257827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 84/159] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:46.261857 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf97f3-261f-48b6-a0fb-510f475e138d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:46.266336 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:46.387178 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 76/160] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:46.465303 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf97f3-261f-48b6-a0fb-510f475e138d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:46.516800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a5e6d-ff5f-47b4-a3ea-c1414f5bcc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:46.517473 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a5e6d-ff5f-47b4-a3ea-c1414f5bcc49 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:46.517757 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a5e6d-ff5f-47b4-a3ea-c1414f5bcc49 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:46.518032 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a5e6d-ff5f-47b4-a3ea-c1414f5bcc49 None admin] PATH_INFO: `/v3/projects/c6ec2c26955d46c3a767d88695f36411` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:46.519262 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a5e6d-ff5f-47b4-a3ea-c1414f5bcc49 None admin] RBAC: Authorizing `identity:get_project(project_id=c6ec2c26955d46c3a767d88695f36411)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:46.520779 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a5e6d-ff5f-47b4-a3ea-c1414f5bcc49 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:46.522525 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 85/161] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:46 2022] GET /identity/v3/projects/c6ec2c26955d46c3a767d88695f36411 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:46.528393 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18978e5-8115-4e47-a64e-fd8843c5cec6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:46.686171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18978e5-8115-4e47-a64e-fd8843c5cec6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:46.708402 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a5e6d-ff5f-47b4-a3ea-c1414f5bcc49 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:46.746706 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618a0d3-bec9-4699-85bc-0f860204407b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:46.748046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618a0d3-bec9-4699-85bc-0f860204407b None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:46.749517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618a0d3-bec9-4699-85bc-0f860204407b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:46.750064 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618a0d3-bec9-4699-85bc-0f860204407b None admin] PATH_INFO: `/v3/projects/c6ec2c26955d46c3a767d88695f36411/users/cdc4ef8e117d47f58023f83a2dce5c2f/roles/2b507beec2294bd293287825491de4bc` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:46.754116 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618a0d3-bec9-4699-85bc-0f860204407b None admin] RBAC: Authorizing `identity:create_grant(project_id=c6ec2c26955d46c3a767d88695f36411, user_id=cdc4ef8e117d47f58023f83a2dce5c2f, role_id=2b507beec2294bd293287825491de4bc)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:46.757579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618a0d3-bec9-4699-85bc-0f860204407b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:46.788900 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 77/162] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 1 16:18:46 2022] PUT /identity/v3/projects/c6ec2c26955d46c3a767d88695f36411/users/cdc4ef8e117d47f58023f83a2dce5c2f/roles/2b507beec2294bd293287825491de4bc => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:18:46.790956 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618a0d3-bec9-4699-85bc-0f860204407b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:46.809566 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:46.826657 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:47.011033 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a5e6d-ff5f-47b4-a3ea-c1414f5bcc49 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:47.015865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618a0d3-bec9-4699-85bc-0f860204407b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:47.069167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74cf10-639d-41d2-bcdd-cc27ca48abd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:47.070189 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74cf10-639d-41d2-bcdd-cc27ca48abd8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:47.071203 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74cf10-639d-41d2-bcdd-cc27ca48abd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:47.071651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74cf10-639d-41d2-bcdd-cc27ca48abd8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:47.105429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74cf10-639d-41d2-bcdd-cc27ca48abd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:47.111184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-7e74cf10-639d-41d2-bcdd-cc27ca48abd8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:18:47.111184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:47.111184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:47.111184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:47.111184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:47.111184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:47.111184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:47.111184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:47.111184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:47.111184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:47.111184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:47.111184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:47.111184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:47.111184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:47.111184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:47.111184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:47.112211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:47.112211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:47.112211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:47.112211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:47.112211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:47.112211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:47.112211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:47.112211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:47.112211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:47.112211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:47.112211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:47.112211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:47.112211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:47.112211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:47.112211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:47.112211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:47.113096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:47.113096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:47.113096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:47.113096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:47.113096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:47.113096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:47.113096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:47.113096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:47.113096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:47.113096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:47.113096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:18:47.113096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:18:47.113096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 78/163] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 1 16:18:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:47.113856 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74cf10-639d-41d2-bcdd-cc27ca48abd8 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:47.150399 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd7999-11e7-42ce-86e9-99c373fcd288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:47.152347 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd7999-11e7-42ce-86e9-99c373fcd288 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:47.152347 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd7999-11e7-42ce-86e9-99c373fcd288 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:47.156559 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd7999-11e7-42ce-86e9-99c373fcd288 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:47.182346 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd7999-11e7-42ce-86e9-99c373fcd288 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:47.200986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-30dd7999-11e7-42ce-86e9-99c373fcd288 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:47.200986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:47.200986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:47.200986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:47.200986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:47.200986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:47.200986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:47.200986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:47.200986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:47.200986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:47.200986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:47.200986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:47.200986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:47.200986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:47.200986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:47.200986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:47.201937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:47.201937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:47.201937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:47.201937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:47.201937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:47.201937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:47.201937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:47.201937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:47.201937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:47.201937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:47.201937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:47.201937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:47.201937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:47.201937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:47.201937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:47.201937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:47.202700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:47.202700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:47.202700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:47.202700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:47.202700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:47.202700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:47.202700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:47.202700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:47.202700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:47.202700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:47.202700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:47.202700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:18:47.202700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 86/164] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:18:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 495 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:18:47.203334 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd7999-11e7-42ce-86e9-99c373fcd288 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:47.323325 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:47.378512 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd7999-11e7-42ce-86e9-99c373fcd288 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:47.395148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:47.431482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0fe96-cf7b-40c9-99c8-d1574b79bb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:47.433794 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0fe96-cf7b-40c9-99c8-d1574b79bb93 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:47.434251 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0fe96-cf7b-40c9-99c8-d1574b79bb93 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:47.434722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0fe96-cf7b-40c9-99c8-d1574b79bb93 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:47.435933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0fe96-cf7b-40c9-99c8-d1574b79bb93 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:47.436485 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0fe96-cf7b-40c9-99c8-d1574b79bb93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:47.439766 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0fe96-cf7b-40c9-99c8-d1574b79bb93 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:47.451335 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74cf10-639d-41d2-bcdd-cc27ca48abd8 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:47.471867 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 87/165] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:18:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:47.472917 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0fe96-cf7b-40c9-99c8-d1574b79bb93 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:47.564698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b0e7c-f7e3-4dab-b2a3-d62c4cf57d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:47.565794 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b0e7c-f7e3-4dab-b2a3-d62c4cf57d38 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:47.566268 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b0e7c-f7e3-4dab-b2a3-d62c4cf57d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:47.566749 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b0e7c-f7e3-4dab-b2a3-d62c4cf57d38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:47.613850 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b0e7c-f7e3-4dab-b2a3-d62c4cf57d38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:47.619364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-119b0e7c-f7e3-4dab-b2a3-d62c4cf57d38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:18:47.619364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:47.619364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:47.619364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:47.619364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:47.619364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:47.619364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:47.619364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:47.619364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:47.619364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:47.619364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:47.619364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:47.619364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:47.619364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:47.619364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:47.619364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:47.620277 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:47.620277 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:47.620277 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:47.620277 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:47.620277 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:47.620277 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:47.620277 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:47.620277 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:47.620277 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:47.620277 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:47.620277 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:47.620277 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:47.620277 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:47.620277 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:47.620277 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:47.620277 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:47.621434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:47.621434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:47.621434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:47.621434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:47.621434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:47.621434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:47.621434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:47.621434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:47.621434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:47.621434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:47.621434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:18:47.621434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:18:47.621434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 79/166] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 508 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:47.629645 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b0e7c-f7e3-4dab-b2a3-d62c4cf57d38 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:47.777721 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0fe96-cf7b-40c9-99c8-d1574b79bb93 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:47.831885 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c44bb-68df-41d9-955b-0bd463cbae90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:47.832527 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c44bb-68df-41d9-955b-0bd463cbae90 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:47.832831 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c44bb-68df-41d9-955b-0bd463cbae90 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:47.833103 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c44bb-68df-41d9-955b-0bd463cbae90 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:47.833796 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c44bb-68df-41d9-955b-0bd463cbae90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:47.834093 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c44bb-68df-41d9-955b-0bd463cbae90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:47.835735 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c44bb-68df-41d9-955b-0bd463cbae90 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:47.847801 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 88/167] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:47.848718 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c44bb-68df-41d9-955b-0bd463cbae90 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:47.871184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b0e7c-f7e3-4dab-b2a3-d62c4cf57d38 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:47.900773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:47.958582 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:47.985389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c44bb-68df-41d9-955b-0bd463cbae90 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:48.002339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b473542-01b8-4fc5-9fca-fa3ba633c254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:48.003272 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b473542-01b8-4fc5-9fca-fa3ba633c254 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:48.003740 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b473542-01b8-4fc5-9fca-fa3ba633c254 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:48.004246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b473542-01b8-4fc5-9fca-fa3ba633c254 None admin] PATH_INFO: `/v3/users/08a10ce8373d40309074b328c9c29722` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:48.005775 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b473542-01b8-4fc5-9fca-fa3ba633c254 None admin] RBAC: Authorizing `identity:get_user(user_id=08a10ce8373d40309074b328c9c29722)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:48.007528 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b473542-01b8-4fc5-9fca-fa3ba633c254 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:48.009527 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 80/168] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:47 2022] GET /identity/v3/users/08a10ce8373d40309074b328c9c29722 => generated 275 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:48.010605 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b473542-01b8-4fc5-9fca-fa3ba633c254 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:48.029696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c614c3-a824-4d6b-b61d-19f825dfd2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:48.030327 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c614c3-a824-4d6b-b61d-19f825dfd2c2 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:48.030603 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c614c3-a824-4d6b-b61d-19f825dfd2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:48.030870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c614c3-a824-4d6b-b61d-19f825dfd2c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:48.031554 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c614c3-a824-4d6b-b61d-19f825dfd2c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:48.031859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c614c3-a824-4d6b-b61d-19f825dfd2c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:48.033938 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c614c3-a824-4d6b-b61d-19f825dfd2c2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:48.045329 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 89/169] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:18:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:48.046329 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c614c3-a824-4d6b-b61d-19f825dfd2c2 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:48.173872 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:48.185694 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c614c3-a824-4d6b-b61d-19f825dfd2c2 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:48.228656 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dddc7f-cf3d-4663-8ad8-f0ca6bd3c14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:48.229915 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dddc7f-cf3d-4663-8ad8-f0ca6bd3c14e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:48.230300 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dddc7f-cf3d-4663-8ad8-f0ca6bd3c14e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:48.230677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dddc7f-cf3d-4663-8ad8-f0ca6bd3c14e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:48.357591 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b473542-01b8-4fc5-9fca-fa3ba633c254 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:48.420771 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dddc7f-cf3d-4663-8ad8-f0ca6bd3c14e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:48.424983 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dddc7f-cf3d-4663-8ad8-f0ca6bd3c14e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:48.444212 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2522d-971d-422b-89c4-03222ed197dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:48.444906 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2522d-971d-422b-89c4-03222ed197dc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:48.445185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2522d-971d-422b-89c4-03222ed197dc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:48.445467 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2522d-971d-422b-89c4-03222ed197dc None admin] PATH_INFO: `/v3/users/2b43f72ae2234a7eb9bf83a968fd7292` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:48.449443 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2522d-971d-422b-89c4-03222ed197dc None admin] RBAC: Authorizing `identity:get_user(user_id=2b43f72ae2234a7eb9bf83a968fd7292)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:48.451125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2522d-971d-422b-89c4-03222ed197dc None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:48.452880 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 81/170] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:48 2022] GET /identity/v3/users/2b43f72ae2234a7eb9bf83a968fd7292 => generated 247 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:48.453705 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2522d-971d-422b-89c4-03222ed197dc None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:48.619016 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:48.664412 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:48.673589 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 90/171] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:18:48.675550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dddc7f-cf3d-4663-8ad8-f0ca6bd3c14e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:48.746684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2522d-971d-422b-89c4-03222ed197dc None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:48.861458 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200d0df-f7c9-4ab7-b7e1-104f18164441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:48.862258 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200d0df-f7c9-4ab7-b7e1-104f18164441 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:48.862551 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200d0df-f7c9-4ab7-b7e1-104f18164441 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:48.862838 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200d0df-f7c9-4ab7-b7e1-104f18164441 None admin] PATH_INFO: `/v3/users/08a10ce8373d40309074b328c9c29722` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:48.864239 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200d0df-f7c9-4ab7-b7e1-104f18164441 None admin] RBAC: Authorizing `identity:get_user(user_id=08a10ce8373d40309074b328c9c29722)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:48.865804 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200d0df-f7c9-4ab7-b7e1-104f18164441 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:48.867495 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 82/172] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:48 2022] GET /identity/v3/users/08a10ce8373d40309074b328c9c29722 => generated 275 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:48.868863 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37492463-a4ac-434d-979e-5e26d3252192 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:48.869149 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37492463-a4ac-434d-979e-5e26d3252192 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:48.869422 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37492463-a4ac-434d-979e-5e26d3252192 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:48.877957 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 83/173] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:48 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:48.878842 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37492463-a4ac-434d-979e-5e26d3252192 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:48.905069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dddc7f-cf3d-4663-8ad8-f0ca6bd3c14e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:48.971504 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cd940-1963-482b-a861-3c218194e8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:48.972068 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cd940-1963-482b-a861-3c218194e8e6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:48.972347 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cd940-1963-482b-a861-3c218194e8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:48.972739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cd940-1963-482b-a861-3c218194e8e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:49.085248 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2cd940-1963-482b-a861-3c218194e8e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:49.088253 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2cd940-1963-482b-a861-3c218194e8e6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:49.122867 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:49.185349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37492463-a4ac-434d-979e-5e26d3252192 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:49.225337 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:49.240134 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617e63b-b4a4-4225-bb16-66708675863a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:49.241267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617e63b-b4a4-4225-bb16-66708675863a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:49.241767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617e63b-b4a4-4225-bb16-66708675863a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:49.242243 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617e63b-b4a4-4225-bb16-66708675863a None admin] PATH_INFO: `/v3/projects/c6ec2c26955d46c3a767d88695f36411` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:49.245498 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617e63b-b4a4-4225-bb16-66708675863a None admin] RBAC: Authorizing `identity:get_project(project_id=c6ec2c26955d46c3a767d88695f36411)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:49.247031 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617e63b-b4a4-4225-bb16-66708675863a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:49.248905 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 84/174] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:48 2022] GET /identity/v3/projects/c6ec2c26955d46c3a767d88695f36411 => generated 298 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:49.249906 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617e63b-b4a4-4225-bb16-66708675863a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:49.326502 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 91/175] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:18:49.330367 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dbd75-073d-4929-91e7-cd2dedcf0918 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:49.331274 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dbd75-073d-4929-91e7-cd2dedcf0918 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:49.332065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dbd75-073d-4929-91e7-cd2dedcf0918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:49.367841 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e31dbd75-073d-4929-91e7-cd2dedcf0918 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:49.371075 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e31dbd75-073d-4929-91e7-cd2dedcf0918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:49.417850 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617e63b-b4a4-4225-bb16-66708675863a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:49.505812 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf2f06-1623-47b4-8ddd-43fba59fed4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:49.506775 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf2f06-1623-47b4-8ddd-43fba59fed4e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:49.507510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf2f06-1623-47b4-8ddd-43fba59fed4e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:49.508003 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf2f06-1623-47b4-8ddd-43fba59fed4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:49.524802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 92/176] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:49.527503 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d01e01-76ad-4174-9b48-fb38dbe36fee None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:49.528272 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d01e01-76ad-4174-9b48-fb38dbe36fee None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:49.528949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d01e01-76ad-4174-9b48-fb38dbe36fee None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:49.531692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 93/177] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:49.533368 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d01e01-76ad-4174-9b48-fb38dbe36fee None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:49.601760 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:49.673201 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:49.677822 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf2f06-1623-47b4-8ddd-43fba59fed4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:49.681561 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf2f06-1623-47b4-8ddd-43fba59fed4e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:49.763142 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d01e01-76ad-4174-9b48-fb38dbe36fee None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:49.815291 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 85/178] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:18:49.816044 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf2f06-1623-47b4-8ddd-43fba59fed4e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:49.840417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03822377-5c44-48eb-85e4-9c8005a75ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:49.841875 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03822377-5c44-48eb-85e4-9c8005a75ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:49.842546 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03822377-5c44-48eb-85e4-9c8005a75ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:49.843218 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03822377-5c44-48eb-85e4-9c8005a75ec6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:49.845482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03822377-5c44-48eb-85e4-9c8005a75ec6 None admin] RBAC: Adding query filter params (role.id=f889b15cab8c46f58be00f84143aac60, scope.project.id=c6ec2c26955d46c3a767d88695f36411, user.id=08a10ce8373d40309074b328c9c29722) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:49.846276 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03822377-5c44-48eb-85e4-9c8005a75ec6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:49.849390 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03822377-5c44-48eb-85e4-9c8005a75ec6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:49.861923 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 94/179] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:49 2022] GET /identity/v3/role_assignments?user.id=08a10ce8373d40309074b328c9c29722&scope.project.id=c6ec2c26955d46c3a767d88695f36411&role.id=f889b15cab8c46f58be00f84143aac60 => generated 608 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:49.864613 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf32e48-2ef7-4f42-a4cf-c1f58c21b5c6 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:49.865155 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf32e48-2ef7-4f42-a4cf-c1f58c21b5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:49.865637 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf32e48-2ef7-4f42-a4cf-c1f58c21b5c6 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:49.868271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 95/180] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:49.872897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c90456-1521-4d15-bf62-6e063b548040 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:49.872897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c90456-1521-4d15-bf62-6e063b548040 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:49.872897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c90456-1521-4d15-bf62-6e063b548040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:49.907835 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-50c90456-1521-4d15-bf62-6e063b548040 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:49.910141 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-50c90456-1521-4d15-bf62-6e063b548040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:49.965442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:49.973157 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf2f06-1623-47b4-8ddd-43fba59fed4e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:50.024468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249a1a3-a5c5-4aa3-8f06-93ea43096609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:50.025476 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249a1a3-a5c5-4aa3-8f06-93ea43096609 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:50.026044 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249a1a3-a5c5-4aa3-8f06-93ea43096609 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:50.026474 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249a1a3-a5c5-4aa3-8f06-93ea43096609 None admin] PATH_INFO: `/v3/projects/c6ec2c26955d46c3a767d88695f36411` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:50.028013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249a1a3-a5c5-4aa3-8f06-93ea43096609 None admin] RBAC: Authorizing `identity:get_project(project_id=c6ec2c26955d46c3a767d88695f36411)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:50.029835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249a1a3-a5c5-4aa3-8f06-93ea43096609 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:50.032002 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 86/181] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:49 2022] GET /identity/v3/projects/c6ec2c26955d46c3a767d88695f36411 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:50.033778 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249a1a3-a5c5-4aa3-8f06-93ea43096609 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:50.058312 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 96/182] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:50.065001 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c90456-1521-4d15-bf62-6e063b548040 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:50.120441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:50.216244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249a1a3-a5c5-4aa3-8f06-93ea43096609 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:50.285629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c90456-1521-4d15-bf62-6e063b548040 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:50.296575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f9d4e-2624-42ef-ae82-2bacb505ab31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:50.298833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f9d4e-2624-42ef-ae82-2bacb505ab31 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:50.299251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f9d4e-2624-42ef-ae82-2bacb505ab31 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:50.300194 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f9d4e-2624-42ef-ae82-2bacb505ab31 None admin] PATH_INFO: `/v3/projects/3fbc93bff3134e5eb5c4e738d1fe1e88` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:50.302940 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f9d4e-2624-42ef-ae82-2bacb505ab31 None admin] RBAC: Authorizing `identity:get_project(project_id=3fbc93bff3134e5eb5c4e738d1fe1e88)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:50.307374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f9d4e-2624-42ef-ae82-2bacb505ab31 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:50.312352 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 87/183] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:50 2022] GET /identity/v3/projects/3fbc93bff3134e5eb5c4e738d1fe1e88 => generated 312 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:50.316106 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bc66a-ac38-4cb4-b601-6382d5e74ec6 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:50.317313 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bc66a-ac38-4cb4-b601-6382d5e74ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:50.317962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bc66a-ac38-4cb4-b601-6382d5e74ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:50.340604 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f571fe-a603-4815-9931-1934ef567490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:50.342169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f571fe-a603-4815-9931-1934ef567490 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:50.342668 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f571fe-a603-4815-9931-1934ef567490 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:50.343154 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f571fe-a603-4815-9931-1934ef567490 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:50.346275 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0a4bc66a-ac38-4cb4-b601-6382d5e74ec6 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:50.347610 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0a4bc66a-ac38-4cb4-b601-6382d5e74ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:50.372449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f571fe-a603-4815-9931-1934ef567490 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:50.380577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-b7f571fe-a603-4815-9931-1934ef567490 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:50.380577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:50.380577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:50.380577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:50.380577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:50.380577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:50.380577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:50.380577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:50.380577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:50.380577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:50.380577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:50.380577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:50.380577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:50.380577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:50.380577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:50.380577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:50.381561 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:50.381561 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:50.381561 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:50.381561 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:50.381561 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:50.381561 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:50.381561 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:50.381561 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:50.381561 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:50.381561 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:50.381561 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:50.381561 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:50.381561 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:50.381561 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:50.381561 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:50.381561 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:50.382337 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:50.382337 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:50.382337 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:50.382337 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:50.382337 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:50.382337 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:50.382337 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:50.382337 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:50.382337 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:50.382337 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:50.382337 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:50.382337 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:18:50.382337 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 97/184] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:18:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:50.382973 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f571fe-a603-4815-9931-1934ef567490 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:50.395934 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:50.494809 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:50.509591 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 88/185] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:50.511609 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bc66a-ac38-4cb4-b601-6382d5e74ec6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:50.519656 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f571fe-a603-4815-9931-1934ef567490 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:50.563964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fffca-2860-4dcb-956a-36ffa9d0b19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:50.564599 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fffca-2860-4dcb-956a-36ffa9d0b19e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:50.564910 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fffca-2860-4dcb-956a-36ffa9d0b19e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:50.565383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fffca-2860-4dcb-956a-36ffa9d0b19e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:50.566369 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24fffca-2860-4dcb-956a-36ffa9d0b19e None admin] RBAC: Adding query filter params (role.id=a8896546a02c42489ef73c7ad7c43542, scope.project.id=c6ec2c26955d46c3a767d88695f36411, user.id=2b43f72ae2234a7eb9bf83a968fd7292) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:50.566544 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24fffca-2860-4dcb-956a-36ffa9d0b19e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:50.568091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24fffca-2860-4dcb-956a-36ffa9d0b19e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:50.575673 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 98/186] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:50 2022] GET /identity/v3/role_assignments?user.id=2b43f72ae2234a7eb9bf83a968fd7292&scope.project.id=c6ec2c26955d46c3a767d88695f36411&role.id=a8896546a02c42489ef73c7ad7c43542 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:50.576675 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fffca-2860-4dcb-956a-36ffa9d0b19e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:50.711842 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fffca-2860-4dcb-956a-36ffa9d0b19e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:50.736001 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bc66a-ac38-4cb4-b601-6382d5e74ec6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:50.758659 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1003eb8-1cae-426b-a082-c13dbfedbcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:50.759301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1003eb8-1cae-426b-a082-c13dbfedbcd7 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:50.759584 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1003eb8-1cae-426b-a082-c13dbfedbcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:50.759874 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1003eb8-1cae-426b-a082-c13dbfedbcd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:50.760575 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1003eb8-1cae-426b-a082-c13dbfedbcd7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:50.760912 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1003eb8-1cae-426b-a082-c13dbfedbcd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:50.762425 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1003eb8-1cae-426b-a082-c13dbfedbcd7 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:50.775970 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 99/187] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:50.777469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a1895-f5fb-4896-9271-4a5a8518ae30 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:50.777756 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a1895-f5fb-4896-9271-4a5a8518ae30 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:50.778044 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a1895-f5fb-4896-9271-4a5a8518ae30 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:50.779650 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 100/188] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:50.780296 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a1895-f5fb-4896-9271-4a5a8518ae30 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:50.800705 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:50.823660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e90d4-9eb3-4c08-86da-735e0bd0597e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:50.824542 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e90d4-9eb3-4c08-86da-735e0bd0597e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:50.825020 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e90d4-9eb3-4c08-86da-735e0bd0597e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:50.825476 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e90d4-9eb3-4c08-86da-735e0bd0597e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:50.826405 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e90d4-9eb3-4c08-86da-735e0bd0597e None admin] RBAC: Adding query filter params (role.id=76a38a2307da45bcb511ef106076613d, scope.project.id=3fbc93bff3134e5eb5c4e738d1fe1e88, user.id=08a10ce8373d40309074b328c9c29722) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:50.826877 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e90d4-9eb3-4c08-86da-735e0bd0597e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:50.828787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e90d4-9eb3-4c08-86da-735e0bd0597e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:50.841451 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 89/189] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:50 2022] GET /identity/v3/role_assignments?user.id=08a10ce8373d40309074b328c9c29722&scope.project.id=3fbc93bff3134e5eb5c4e738d1fe1e88&role.id=76a38a2307da45bcb511ef106076613d => generated 608 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:50.843907 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a22c3-1bc1-416f-bf88-25f753510a10 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:50.844401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a22c3-1bc1-416f-bf88-25f753510a10 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:50.845560 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a22c3-1bc1-416f-bf88-25f753510a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:50.880415 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a03a22c3-1bc1-416f-bf88-25f753510a10 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:50.882558 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a03a22c3-1bc1-416f-bf88-25f753510a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:50.939824 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:50.972570 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a1895-f5fb-4896-9271-4a5a8518ae30 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:51.019254 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 90/190] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:51.020181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a22c3-1bc1-416f-bf88-25f753510a10 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:51.055499 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029a2ed-bc76-4eda-a3c5-88f53fd4677e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:51.056567 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029a2ed-bc76-4eda-a3c5-88f53fd4677e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:51.057083 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029a2ed-bc76-4eda-a3c5-88f53fd4677e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:51.057536 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029a2ed-bc76-4eda-a3c5-88f53fd4677e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:51.059108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029a2ed-bc76-4eda-a3c5-88f53fd4677e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:51.061064 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029a2ed-bc76-4eda-a3c5-88f53fd4677e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:51.063133 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 101/191] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:51.064866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029a2ed-bc76-4eda-a3c5-88f53fd4677e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:51.186980 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:51.231680 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029a2ed-bc76-4eda-a3c5-88f53fd4677e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:51.249435 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a22c3-1bc1-416f-bf88-25f753510a10 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:51.286676 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caebf0a-fd38-43a2-af24-655763b69ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:51.287330 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caebf0a-fd38-43a2-af24-655763b69ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:51.287719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caebf0a-fd38-43a2-af24-655763b69ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:51.287926 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caebf0a-fd38-43a2-af24-655763b69ff8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:51.303271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caebf0a-fd38-43a2-af24-655763b69ff8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:51.308848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-2caebf0a-fd38-43a2-af24-655763b69ff8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:18:51.308848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:51.308848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:51.308848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:51.308848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:51.308848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:51.308848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:51.308848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:51.308848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:51.308848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:51.308848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:51.308848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:51.308848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:51.308848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:51.308848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:51.308848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:51.310558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:51.310558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:51.310558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:51.310558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:51.310558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:51.310558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:51.310558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:51.310558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:51.310558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:51.310558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:51.310558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:51.310558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:51.310558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:51.310558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:51.310558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:51.310558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:51.312100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:51.312100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:51.312100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:51.312100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:51.312100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:51.312100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:51.312100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:51.312100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:51.312100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:51.312100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:51.312100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:18:51.312100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:18:51.312100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 102/192] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 1 16:18:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:51.312100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caebf0a-fd38-43a2-af24-655763b69ff8 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:51.338221 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a430cf-9e95-4d7c-afd6-3a29d1d6890a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:51.339211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a430cf-9e95-4d7c-afd6-3a29d1d6890a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:51.339622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a430cf-9e95-4d7c-afd6-3a29d1d6890a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:51.340063 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a430cf-9e95-4d7c-afd6-3a29d1d6890a None admin] PATH_INFO: `/v3/users/a8cf90f11cad4262944d84826169770b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:51.366759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a430cf-9e95-4d7c-afd6-3a29d1d6890a None admin] RBAC: Authorizing `identity:get_user(user_id=a8cf90f11cad4262944d84826169770b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:51.369077 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a430cf-9e95-4d7c-afd6-3a29d1d6890a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:51.372166 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 91/193] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:51 2022] GET /identity/v3/users/a8cf90f11cad4262944d84826169770b => generated 283 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:51.374641 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a430cf-9e95-4d7c-afd6-3a29d1d6890a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:51.413569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:51.461488 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caebf0a-fd38-43a2-af24-655763b69ff8 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:51.505238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8d8b2-1dd8-4aa9-86ab-8b82e2adfdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:51.505878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8d8b2-1dd8-4aa9-86ab-8b82e2adfdf8 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:51.506159 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8d8b2-1dd8-4aa9-86ab-8b82e2adfdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:51.506431 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8d8b2-1dd8-4aa9-86ab-8b82e2adfdf8 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:51.507121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8d8b2-1dd8-4aa9-86ab-8b82e2adfdf8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:51.508705 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8d8b2-1dd8-4aa9-86ab-8b82e2adfdf8 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:51.518974 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:51.534135 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 103/194] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 1 16:18:51 2022] POST /identity/v3/users => generated 297 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:18:51.540431 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a430cf-9e95-4d7c-afd6-3a29d1d6890a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:51.546148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8d8b2-1dd8-4aa9-86ab-8b82e2adfdf8 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:51.611281 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd864e8-d04a-4e27-8095-9a814b169bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:51.612294 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd864e8-d04a-4e27-8095-9a814b169bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:51.612798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd864e8-d04a-4e27-8095-9a814b169bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:51.613302 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd864e8-d04a-4e27-8095-9a814b169bf3 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:51.614382 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd864e8-d04a-4e27-8095-9a814b169bf3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:51.614801 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd864e8-d04a-4e27-8095-9a814b169bf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:51.617116 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd864e8-d04a-4e27-8095-9a814b169bf3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:51.633413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 92/195] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:18:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:51.635060 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd864e8-d04a-4e27-8095-9a814b169bf3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:51.746730 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8d8b2-1dd8-4aa9-86ab-8b82e2adfdf8 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:51.786840 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:51.812333 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99963c1b-280b-4fa7-a992-7e9e8e913c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:51.813435 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99963c1b-280b-4fa7-a992-7e9e8e913c39 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:51.813856 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99963c1b-280b-4fa7-a992-7e9e8e913c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:51.814265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99963c1b-280b-4fa7-a992-7e9e8e913c39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:51.831431 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd864e8-d04a-4e27-8095-9a814b169bf3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:51.905984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16adf9-d2dc-4811-8e75-6c6b6112324d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:51.908300 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16adf9-d2dc-4811-8e75-6c6b6112324d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:51.909170 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16adf9-d2dc-4811-8e75-6c6b6112324d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:51.909656 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16adf9-d2dc-4811-8e75-6c6b6112324d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:51.930261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16adf9-d2dc-4811-8e75-6c6b6112324d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:51.932554 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:51.941843 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-ae16adf9-d2dc-4811-8e75-6c6b6112324d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:18:51.941843 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:51.941843 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:51.941843 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:51.941843 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:51.941843 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:51.941843 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:51.941843 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:51.941843 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:51.941843 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:51.941843 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:51.941843 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:51.941843 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:51.941843 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:51.941843 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:51.941843 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:51.943452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:51.943452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:51.943452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:51.943452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:51.943452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:51.943452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:51.943452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:51.943452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:51.943452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:51.943452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:51.943452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:51.943452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:51.943452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:51.943452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:51.943452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:51.943452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:51.944859 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:51.944859 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:51.944859 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:51.944859 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:51.944859 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:51.944859 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:51.944859 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:51.944859 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:51.944859 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:51.944859 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:51.944859 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:18:51.944859 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:18:51.944859 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 93/196] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:51.945887 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16adf9-d2dc-4811-8e75-6c6b6112324d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:51.962170 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99963c1b-280b-4fa7-a992-7e9e8e913c39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:51.964152 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99963c1b-280b-4fa7-a992-7e9e8e913c39 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:52.171135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16adf9-d2dc-4811-8e75-6c6b6112324d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:52.204458 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 104/197] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:18:52.204458 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99963c1b-280b-4fa7-a992-7e9e8e913c39 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:52.258171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c860c-b402-4ad9-a719-6e7c13aaedeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:52.260183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c860c-b402-4ad9-a719-6e7c13aaedeb None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:52.261035 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c860c-b402-4ad9-a719-6e7c13aaedeb None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:52.262183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c860c-b402-4ad9-a719-6e7c13aaedeb None admin] PATH_INFO: `/v3/users/a8cf90f11cad4262944d84826169770b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:52.265853 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c860c-b402-4ad9-a719-6e7c13aaedeb None admin] RBAC: Authorizing `identity:get_user(user_id=a8cf90f11cad4262944d84826169770b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:52.270737 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c860c-b402-4ad9-a719-6e7c13aaedeb None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:52.274676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 94/198] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:51 2022] GET /identity/v3/users/a8cf90f11cad4262944d84826169770b => generated 283 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:52.277196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c860c-b402-4ad9-a719-6e7c13aaedeb None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:52.350331 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:52.382881 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:52.394489 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99963c1b-280b-4fa7-a992-7e9e8e913c39 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:52.449219 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c9c4b-3e23-4dd6-abba-06b36e9ad924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:52.450058 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c9c4b-3e23-4dd6-abba-06b36e9ad924 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:52.450444 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c9c4b-3e23-4dd6-abba-06b36e9ad924 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:52.450819 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c9c4b-3e23-4dd6-abba-06b36e9ad924 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:52.452060 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c9c4b-3e23-4dd6-abba-06b36e9ad924 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:52.452060 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c9c4b-3e23-4dd6-abba-06b36e9ad924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:52.454958 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c9c4b-3e23-4dd6-abba-06b36e9ad924 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:52.464482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 105/199] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:18:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:52.465288 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c9c4b-3e23-4dd6-abba-06b36e9ad924 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:52.546639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c860c-b402-4ad9-a719-6e7c13aaedeb None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:52.584998 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c9c4b-3e23-4dd6-abba-06b36e9ad924 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:52.621662 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8776e-01fe-4c88-b176-b44ba8b10084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:52.622973 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8776e-01fe-4c88-b176-b44ba8b10084 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:52.623648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8776e-01fe-4c88-b176-b44ba8b10084 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:52.624450 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8776e-01fe-4c88-b176-b44ba8b10084 None admin] PATH_INFO: `/v3/projects/4adbce25e8e4487caa00d740c3b88473` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:52.625129 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714eddc4-0130-4061-967f-a5070f1a192f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:52.626585 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714eddc4-0130-4061-967f-a5070f1a192f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:52.626868 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714eddc4-0130-4061-967f-a5070f1a192f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:52.627164 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714eddc4-0130-4061-967f-a5070f1a192f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:52.628495 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8776e-01fe-4c88-b176-b44ba8b10084 None admin] RBAC: Authorizing `identity:get_project(project_id=4adbce25e8e4487caa00d740c3b88473)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:52.631357 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8776e-01fe-4c88-b176-b44ba8b10084 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:52.640094 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 95/200] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:52 2022] GET /identity/v3/projects/4adbce25e8e4487caa00d740c3b88473 => generated 302 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:52.642533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8776e-01fe-4c88-b176-b44ba8b10084 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:52.655932 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:52.706704 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714eddc4-0130-4061-967f-a5070f1a192f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:52.708242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714eddc4-0130-4061-967f-a5070f1a192f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:52.818226 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:52.830413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 106/201] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:18:52.831315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714eddc4-0130-4061-967f-a5070f1a192f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:52.884114 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8776e-01fe-4c88-b176-b44ba8b10084 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:52.896350 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:52.951743 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714eddc4-0130-4061-967f-a5070f1a192f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:52.967948 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a9989-8633-4850-8c82-8d347aa2912b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:52.969729 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a9989-8633-4850-8c82-8d347aa2912b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:52.970471 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a9989-8633-4850-8c82-8d347aa2912b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:52.971185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a9989-8633-4850-8c82-8d347aa2912b None admin] PATH_INFO: `/v3/users/cdc4ef8e117d47f58023f83a2dce5c2f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:52.974011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a9989-8633-4850-8c82-8d347aa2912b None admin] RBAC: Authorizing `identity:get_user(user_id=cdc4ef8e117d47f58023f83a2dce5c2f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:52.977473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a9989-8633-4850-8c82-8d347aa2912b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:52.981159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 96/202] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:52 2022] GET /identity/v3/users/cdc4ef8e117d47f58023f83a2dce5c2f => generated 289 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:52.983707 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a9989-8633-4850-8c82-8d347aa2912b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:52.994909 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d0fcb-3962-4994-95a3-405d74629bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:52.995545 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d0fcb-3962-4994-95a3-405d74629bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:52.995858 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d0fcb-3962-4994-95a3-405d74629bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:52.996098 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d0fcb-3962-4994-95a3-405d74629bf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:52.996871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d0fcb-3962-4994-95a3-405d74629bf9 None admin] RBAC: Adding query filter params (role.id=a8896546a02c42489ef73c7ad7c43542, scope.project.id=4adbce25e8e4487caa00d740c3b88473, user.id=a8cf90f11cad4262944d84826169770b) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:52.997182 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d0fcb-3962-4994-95a3-405d74629bf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:52.998690 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d0fcb-3962-4994-95a3-405d74629bf9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:53.012163 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 107/203] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:52 2022] GET /identity/v3/role_assignments?user.id=a8cf90f11cad4262944d84826169770b&scope.project.id=4adbce25e8e4487caa00d740c3b88473&role.id=a8896546a02c42489ef73c7ad7c43542 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:53.012163 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d0fcb-3962-4994-95a3-405d74629bf9 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:53.216241 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d0fcb-3962-4994-95a3-405d74629bf9 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:53.256780 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a9989-8633-4850-8c82-8d347aa2912b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:53.279986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:53.302702 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38360987-ef74-4580-a65d-56e65761b91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:53.303336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38360987-ef74-4580-a65d-56e65761b91d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:53.303618 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38360987-ef74-4580-a65d-56e65761b91d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:53.303884 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38360987-ef74-4580-a65d-56e65761b91d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:53.331997 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b281fb-f85a-4965-aef1-20fc5c7655bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:53.333640 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b281fb-f85a-4965-aef1-20fc5c7655bf None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:53.334550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b281fb-f85a-4965-aef1-20fc5c7655bf None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:53.335277 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b281fb-f85a-4965-aef1-20fc5c7655bf None admin] PATH_INFO: `/v3/projects/4adbce25e8e4487caa00d740c3b88473` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:53.342597 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b281fb-f85a-4965-aef1-20fc5c7655bf None admin] RBAC: Authorizing `identity:get_project(project_id=4adbce25e8e4487caa00d740c3b88473)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:53.348348 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b281fb-f85a-4965-aef1-20fc5c7655bf None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:53.358348 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 97/204] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:52 2022] GET /identity/v3/projects/4adbce25e8e4487caa00d740c3b88473 => generated 302 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:53.368703 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b281fb-f85a-4965-aef1-20fc5c7655bf None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:53.417024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:53.540506 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38360987-ef74-4580-a65d-56e65761b91d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:53.543521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38360987-ef74-4580-a65d-56e65761b91d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:53.637577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b281fb-f85a-4965-aef1-20fc5c7655bf None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:53.713205 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b1698-cc25-4e36-9fdb-5b26a6aa30a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:53.714439 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b1698-cc25-4e36-9fdb-5b26a6aa30a4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:53.715036 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b1698-cc25-4e36-9fdb-5b26a6aa30a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:53.715732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b1698-cc25-4e36-9fdb-5b26a6aa30a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:53.717374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b1698-cc25-4e36-9fdb-5b26a6aa30a4 None admin] RBAC: Adding query filter params (role.id=f889b15cab8c46f58be00f84143aac60, scope.project.id=4adbce25e8e4487caa00d740c3b88473, user.id=a8cf90f11cad4262944d84826169770b) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:53.718068 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b1698-cc25-4e36-9fdb-5b26a6aa30a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:53.722388 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b1698-cc25-4e36-9fdb-5b26a6aa30a4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:53.737870 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 98/205] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:53 2022] GET /identity/v3/role_assignments?user.id=a8cf90f11cad4262944d84826169770b&scope.project.id=4adbce25e8e4487caa00d740c3b88473&role.id=f889b15cab8c46f58be00f84143aac60 => generated 259 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:53.859045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 108/206] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 852 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:18:53.865742 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b1698-cc25-4e36-9fdb-5b26a6aa30a4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:53.994246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:54.037381 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b1698-cc25-4e36-9fdb-5b26a6aa30a4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:54.089601 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90801d73-4ffd-493b-b693-6216c7a9051a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:54.090272 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90801d73-4ffd-493b-b693-6216c7a9051a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:54.090554 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90801d73-4ffd-493b-b693-6216c7a9051a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:54.090829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90801d73-4ffd-493b-b693-6216c7a9051a None admin] PATH_INFO: `/v3/projects/c6ec2c26955d46c3a767d88695f36411` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:54.092893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90801d73-4ffd-493b-b693-6216c7a9051a None admin] RBAC: Authorizing `identity:get_project(project_id=c6ec2c26955d46c3a767d88695f36411)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:54.094462 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90801d73-4ffd-493b-b693-6216c7a9051a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:54.097070 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 99/207] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:53 2022] GET /identity/v3/projects/c6ec2c26955d46c3a767d88695f36411 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:54.107041 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38360987-ef74-4580-a65d-56e65761b91d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:54.177301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:54.383584 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38360987-ef74-4580-a65d-56e65761b91d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:54.456410 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d0a7a-7092-4bb7-8437-be572c0b7c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:54.457475 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d0a7a-7092-4bb7-8437-be572c0b7c94 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:54.457960 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d0a7a-7092-4bb7-8437-be572c0b7c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:54.458497 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d0a7a-7092-4bb7-8437-be572c0b7c94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:54.459983 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d0a7a-7092-4bb7-8437-be572c0b7c94 None admin] RBAC: Adding query filter params (role.id=2b507beec2294bd293287825491de4bc, scope.project.id=c6ec2c26955d46c3a767d88695f36411, user.id=cdc4ef8e117d47f58023f83a2dce5c2f) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:54.460535 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d0a7a-7092-4bb7-8437-be572c0b7c94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:54.463336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d0a7a-7092-4bb7-8437-be572c0b7c94 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:54.475893 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 109/208] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:54 2022] GET /identity/v3/role_assignments?user.id=cdc4ef8e117d47f58023f83a2dce5c2f&scope.project.id=c6ec2c26955d46c3a767d88695f36411&role.id=2b507beec2294bd293287825491de4bc => generated 608 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:54.478953 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b2551-46bc-4b39-87a9-2a4a4a17ca01 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:54.479429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b2551-46bc-4b39-87a9-2a4a4a17ca01 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:54.479924 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b2551-46bc-4b39-87a9-2a4a4a17ca01 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:54.482620 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 100/209] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:54.490750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80772c6-133c-4857-84e9-5bc1798b6f04 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:54.491241 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80772c6-133c-4857-84e9-5bc1798b6f04 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:54.491719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80772c6-133c-4857-84e9-5bc1798b6f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:54.524713 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e80772c6-133c-4857-84e9-5bc1798b6f04 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:54.526862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e80772c6-133c-4857-84e9-5bc1798b6f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:54.661798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1770a6-fc2a-4454-bfff-70b40ed7e0d9 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:54.662180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1770a6-fc2a-4454-bfff-70b40ed7e0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:54.662546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1770a6-fc2a-4454-bfff-70b40ed7e0d9 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:54.664331 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 101/210] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:54.670004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 110/211] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:54.671857 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde39f4e-08aa-41dc-b482-7577738c168b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:54.672156 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde39f4e-08aa-41dc-b482-7577738c168b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:54.673358 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde39f4e-08aa-41dc-b482-7577738c168b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:54.715848 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-fde39f4e-08aa-41dc-b482-7577738c168b None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:54.717077 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fde39f4e-08aa-41dc-b482-7577738c168b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:54.812186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 102/212] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:55.106906 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80772c6-133c-4857-84e9-5bc1798b6f04 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:55.129067 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:55.249389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80772c6-133c-4857-84e9-5bc1798b6f04 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:55.283668 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde39f4e-08aa-41dc-b482-7577738c168b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:55.303209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea447fa-d031-4007-b066-063b1af830c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:55.303955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea447fa-d031-4007-b066-063b1af830c6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:55.304232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea447fa-d031-4007-b066-063b1af830c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:55.304526 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea447fa-d031-4007-b066-063b1af830c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:55.305908 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea447fa-d031-4007-b066-063b1af830c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:55.308070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea447fa-d031-4007-b066-063b1af830c6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:55.310785 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 111/213] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:55.317233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea447fa-d031-4007-b066-063b1af830c6 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:55.435498 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:55.484247 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:55.501722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde39f4e-08aa-41dc-b482-7577738c168b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:55.504216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea447fa-d031-4007-b066-063b1af830c6 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:55.567529 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b7a17-a8ff-412c-9253-f0e31f908eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:55.568217 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b7a17-a8ff-412c-9253-f0e31f908eeb None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:55.568753 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b7a17-a8ff-412c-9253-f0e31f908eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:55.569414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b7a17-a8ff-412c-9253-f0e31f908eeb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:55.576672 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f8360-3179-4bd3-8c00-6029f496da4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:55.578128 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f8360-3179-4bd3-8c00-6029f496da4c None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:55.578894 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f8360-3179-4bd3-8c00-6029f496da4c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:55.579671 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f8360-3179-4bd3-8c00-6029f496da4c None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:55.581260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f8360-3179-4bd3-8c00-6029f496da4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:55.584449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f8360-3179-4bd3-8c00-6029f496da4c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:55.589472 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b7a17-a8ff-412c-9253-f0e31f908eeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:55.598151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-810b7a17-a8ff-412c-9253-f0e31f908eeb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:18:55.598151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:55.598151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:55.598151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:55.598151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:55.598151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:55.598151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:55.598151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:55.598151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:55.598151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:55.598151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:55.598151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:55.598151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:55.598151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:55.598151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:55.598151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:55.599904 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:55.599904 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:55.599904 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:55.599904 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:55.599904 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:55.599904 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:55.599904 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:55.599904 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:55.599904 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:55.599904 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:55.599904 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:55.599904 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:55.599904 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:55.599904 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:55.599904 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:55.599904 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:55.601248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:55.601248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:55.601248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:55.601248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:55.601248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:55.601248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:55.601248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:55.601248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:55.601248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:55.601248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:55.601248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:18:55.601248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:18:55.601248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 103/214] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:18:55.609849 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b7a17-a8ff-412c-9253-f0e31f908eeb None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:55.628714 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 112/215] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 1 16:18:55 2022] POST /identity/v3/users => generated 297 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:18:55.828500 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b7a17-a8ff-412c-9253-f0e31f908eeb None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:55.897482 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:55.905505 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456beea2-5372-4c90-b1ea-c475fa57d308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:55.906644 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456beea2-5372-4c90-b1ea-c475fa57d308 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:55.907878 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456beea2-5372-4c90-b1ea-c475fa57d308 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:55.908368 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456beea2-5372-4c90-b1ea-c475fa57d308 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:55.909674 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456beea2-5372-4c90-b1ea-c475fa57d308 None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:55.910211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456beea2-5372-4c90-b1ea-c475fa57d308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:55.912877 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456beea2-5372-4c90-b1ea-c475fa57d308 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:55.928312 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 104/216] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:18:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:55.937568 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f8360-3179-4bd3-8c00-6029f496da4c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:56.142980 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f8360-3179-4bd3-8c00-6029f496da4c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:56.213920 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35f2b4-ca82-474d-b793-8c53021c8128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:56.215481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35f2b4-ca82-474d-b793-8c53021c8128 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:56.216825 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35f2b4-ca82-474d-b793-8c53021c8128 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:56.217921 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35f2b4-ca82-474d-b793-8c53021c8128 None admin] PATH_INFO: `/v3/users/5b8f8c6818104fa2854af819d6a1bd2e` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:56.218076 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbc588-2071-4184-a4be-4945ad1258b0 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:56.218532 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbc588-2071-4184-a4be-4945ad1258b0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:56.218532 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbc588-2071-4184-a4be-4945ad1258b0 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:56.221863 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 105/217] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:56.229391 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:56.231431 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81895f-02bc-4003-8615-28d090d45ad4 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:56.231742 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81895f-02bc-4003-8615-28d090d45ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:56.232001 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81895f-02bc-4003-8615-28d090d45ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:56.257174 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35f2b4-ca82-474d-b793-8c53021c8128 None admin] RBAC: Authorizing `identity:get_user(user_id=5b8f8c6818104fa2854af819d6a1bd2e)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:56.260348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35f2b4-ca82-474d-b793-8c53021c8128 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:56.262206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-aa81895f-02bc-4003-8615-28d090d45ad4 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:56.263441 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-aa81895f-02bc-4003-8615-28d090d45ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:56.265167 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 113/218] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:55 2022] GET /identity/v3/users/5b8f8c6818104fa2854af819d6a1bd2e => generated 297 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:56.274712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35f2b4-ca82-474d-b793-8c53021c8128 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:56.389287 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 106/219] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:18:56.487433 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35f2b4-ca82-474d-b793-8c53021c8128 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:56.569623 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bec13-4649-4c10-9457-e7606025af6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:56.571116 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bec13-4649-4c10-9457-e7606025af6c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:56.571825 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bec13-4649-4c10-9457-e7606025af6c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:56.572542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bec13-4649-4c10-9457-e7606025af6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:56.698308 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:56.713007 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863bec13-4649-4c10-9457-e7606025af6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:56.716306 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863bec13-4649-4c10-9457-e7606025af6c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:56.754282 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81895f-02bc-4003-8615-28d090d45ad4 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:56.931993 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 114/220] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:18:56.942341 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bec13-4649-4c10-9457-e7606025af6c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:57.098527 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:57.108134 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bec13-4649-4c10-9457-e7606025af6c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:57.128056 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81895f-02bc-4003-8615-28d090d45ad4 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:57.154135 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30322eb-dfe2-4ae9-929a-b7a70e68d156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:57.155600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30322eb-dfe2-4ae9-929a-b7a70e68d156 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:57.156181 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30322eb-dfe2-4ae9-929a-b7a70e68d156 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:57.156487 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30322eb-dfe2-4ae9-929a-b7a70e68d156 None admin] PATH_INFO: `/v3/projects/4adbce25e8e4487caa00d740c3b88473` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:57.158751 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30322eb-dfe2-4ae9-929a-b7a70e68d156 None admin] RBAC: Authorizing `identity:get_project(project_id=4adbce25e8e4487caa00d740c3b88473)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:57.160564 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30322eb-dfe2-4ae9-929a-b7a70e68d156 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:57.162898 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 115/221] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:56 2022] GET /identity/v3/projects/4adbce25e8e4487caa00d740c3b88473 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:57.164671 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191a7b3-17fd-4b2b-b904-df6467206276 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:57.164807 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191a7b3-17fd-4b2b-b904-df6467206276 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:57.165209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191a7b3-17fd-4b2b-b904-df6467206276 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:57.166652 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 116/222] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:57.174574 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191a7b3-17fd-4b2b-b904-df6467206276 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:57.193494 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:57.224902 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a0a7b-154a-42c4-8933-87b5dbd9c979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:57.226775 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a0a7b-154a-42c4-8933-87b5dbd9c979 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:57.227952 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a0a7b-154a-42c4-8933-87b5dbd9c979 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:57.229577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a0a7b-154a-42c4-8933-87b5dbd9c979 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:57.266765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a0a7b-154a-42c4-8933-87b5dbd9c979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:57.283391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-579a0a7b-154a-42c4-8933-87b5dbd9c979 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:57.283391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:57.283391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:57.283391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:57.283391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:57.283391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:57.283391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:57.283391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:57.283391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:57.283391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:57.283391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:57.283391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:57.283391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:57.283391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:57.283391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:57.283391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:57.285489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:57.285489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:57.285489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:57.285489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:57.285489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:57.285489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:57.285489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:57.285489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:57.285489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:57.285489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:57.285489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:57.285489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:57.285489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:57.285489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:57.285489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:57.285489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:57.287121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:57.287121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:57.287121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:57.287121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:57.287121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:57.287121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:57.287121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:57.287121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:57.287121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:57.287121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:57.287121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:57.287121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:18:57.290798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 107/223] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:18:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 537 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:18:57.295006 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e0849-29ce-4d81-a46e-6bf0fa040128 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:57.296363 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e0849-29ce-4d81-a46e-6bf0fa040128 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:57.297162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e0849-29ce-4d81-a46e-6bf0fa040128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:57.325710 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191a7b3-17fd-4b2b-b904-df6467206276 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:57.337103 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b06e0849-29ce-4d81-a46e-6bf0fa040128 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:57.339729 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b06e0849-29ce-4d81-a46e-6bf0fa040128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:57.368534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b987ac-4b1e-4987-bc08-4ce5c72244ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:57.369193 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b987ac-4b1e-4987-bc08-4ce5c72244ac None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:57.369474 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b987ac-4b1e-4987-bc08-4ce5c72244ac None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:57.369749 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b987ac-4b1e-4987-bc08-4ce5c72244ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:57.370519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b987ac-4b1e-4987-bc08-4ce5c72244ac None admin] RBAC: Adding query filter params (role.id=76a38a2307da45bcb511ef106076613d, scope.project.id=4adbce25e8e4487caa00d740c3b88473, user.id=5b8f8c6818104fa2854af819d6a1bd2e) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:57.370831 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b987ac-4b1e-4987-bc08-4ce5c72244ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:57.372339 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b987ac-4b1e-4987-bc08-4ce5c72244ac None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:57.388681 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 117/224] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:57 2022] GET /identity/v3/role_assignments?user.id=5b8f8c6818104fa2854af819d6a1bd2e&scope.project.id=4adbce25e8e4487caa00d740c3b88473&role.id=76a38a2307da45bcb511ef106076613d => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:57.388681 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b987ac-4b1e-4987-bc08-4ce5c72244ac None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:57.465735 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:57.506951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 108/225] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:57.600947 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b987ac-4b1e-4987-bc08-4ce5c72244ac None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:57.659954 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b726e-c24a-4478-8862-9b9a2e70f002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:57.660594 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b726e-c24a-4478-8862-9b9a2e70f002 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:57.660902 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b726e-c24a-4478-8862-9b9a2e70f002 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:57.661200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b726e-c24a-4478-8862-9b9a2e70f002 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:57.661871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b726e-c24a-4478-8862-9b9a2e70f002 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:57.662176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b726e-c24a-4478-8862-9b9a2e70f002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:57.663635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b726e-c24a-4478-8862-9b9a2e70f002 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:57.677743 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 118/226] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:57.683205 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e0849-29ce-4d81-a46e-6bf0fa040128 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:57.806376 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e0849-29ce-4d81-a46e-6bf0fa040128 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:57.825463 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:57.857049 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98468fd5-ea49-4e17-bd94-e0e7d46a69dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:57.857623 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98468fd5-ea49-4e17-bd94-e0e7d46a69dd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:57.857915 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98468fd5-ea49-4e17-bd94-e0e7d46a69dd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:57.858195 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98468fd5-ea49-4e17-bd94-e0e7d46a69dd None admin] PATH_INFO: `/v3/users/a8cf90f11cad4262944d84826169770b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:57.861741 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98468fd5-ea49-4e17-bd94-e0e7d46a69dd None admin] RBAC: Authorizing `identity:get_user(user_id=a8cf90f11cad4262944d84826169770b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:57.863364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98468fd5-ea49-4e17-bd94-e0e7d46a69dd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:57.865409 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 109/227] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:57 2022] GET /identity/v3/users/a8cf90f11cad4262944d84826169770b => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:57.870944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b726e-c24a-4478-8862-9b9a2e70f002 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:58.002290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:58.021182 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b726e-c24a-4478-8862-9b9a2e70f002 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:58.076348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06cfa2-8749-44e3-875b-6668c277540f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:58.077044 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06cfa2-8749-44e3-875b-6668c277540f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:58.077336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06cfa2-8749-44e3-875b-6668c277540f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:58.083488 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06cfa2-8749-44e3-875b-6668c277540f None admin] PATH_INFO: `/v3/projects/4adbce25e8e4487caa00d740c3b88473` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:58.085082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06cfa2-8749-44e3-875b-6668c277540f None admin] RBAC: Authorizing `identity:get_project(project_id=4adbce25e8e4487caa00d740c3b88473)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:58.086609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06cfa2-8749-44e3-875b-6668c277540f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:58.088389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 119/228] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:57 2022] GET /identity/v3/projects/4adbce25e8e4487caa00d740c3b88473 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:58.095289 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98468fd5-ea49-4e17-bd94-e0e7d46a69dd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:58.289794 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06cfa2-8749-44e3-875b-6668c277540f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:58.293417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98468fd5-ea49-4e17-bd94-e0e7d46a69dd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:58.386303 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2041e0-f3c7-418a-8b26-4c22b2e8fa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:58.389273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2041e0-f3c7-418a-8b26-4c22b2e8fa8d None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:58.389863 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2041e0-f3c7-418a-8b26-4c22b2e8fa8d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:58.390265 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2041e0-f3c7-418a-8b26-4c22b2e8fa8d None admin] PATH_INFO: `/v3/projects/4adbce25e8e4487caa00d740c3b88473/users/a8cf90f11cad4262944d84826169770b/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:58.402344 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2041e0-f3c7-418a-8b26-4c22b2e8fa8d None admin] RBAC: Authorizing `identity:create_grant(project_id=4adbce25e8e4487caa00d740c3b88473, user_id=a8cf90f11cad4262944d84826169770b, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:58.405159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2041e0-f3c7-418a-8b26-4c22b2e8fa8d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:58.443609 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 110/229] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 1 16:18:58 2022] PUT /identity/v3/projects/4adbce25e8e4487caa00d740c3b88473/users/a8cf90f11cad4262944d84826169770b/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:18:58.450122 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2739fcc-8310-4a58-ba03-aca38ccc3932 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:58.450623 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2739fcc-8310-4a58-ba03-aca38ccc3932 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:58.451152 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2739fcc-8310-4a58-ba03-aca38ccc3932 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:58.454012 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 111/230] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:58 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:58.461808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193957e-842e-4eab-9770-89d2efa684d4 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:58.462382 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193957e-842e-4eab-9770-89d2efa684d4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:58.462897 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193957e-842e-4eab-9770-89d2efa684d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:58.512279 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06cfa2-8749-44e3-875b-6668c277540f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:58.518965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e193957e-842e-4eab-9770-89d2efa684d4 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:58.521366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e193957e-842e-4eab-9770-89d2efa684d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:58.564911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57a60a-bd9b-481b-99b9-32eb247edd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:58.565821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57a60a-bd9b-481b-99b9-32eb247edd88 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:58.566485 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57a60a-bd9b-481b-99b9-32eb247edd88 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:58.567071 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57a60a-bd9b-481b-99b9-32eb247edd88 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:58.582176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57a60a-bd9b-481b-99b9-32eb247edd88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:58.588607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-ad57a60a-bd9b-481b-99b9-32eb247edd88 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:18:58.588607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:58.588607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:58.588607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:58.588607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:58.588607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:58.588607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:58.588607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:58.588607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:58.588607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:58.588607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:58.588607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:58.588607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:58.588607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:58.588607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:58.588607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:58.589736 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:58.589736 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:58.589736 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:58.589736 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:58.589736 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:58.589736 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:58.589736 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:58.589736 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:58.589736 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:58.589736 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:58.589736 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:58.589736 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:58.589736 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:58.589736 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:58.589736 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:58.589736 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:58.590733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:58.590733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:58.590733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:58.590733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:58.590733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:58.590733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:58.590733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:58.590733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:58.590733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:58.590733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:58.590733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:18:58.590733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:18:58.593371 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 120/231] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 1 16:18:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:58.604608 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57a60a-bd9b-481b-99b9-32eb247edd88 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:58.673392 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:58.680134 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:58.774037 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 112/232] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:58.894529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57a60a-bd9b-481b-99b9-32eb247edd88 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:58.968138 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462cb26-cd78-4d83-b75f-935a2336c29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:58.969212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462cb26-cd78-4d83-b75f-935a2336c29b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:58.970216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462cb26-cd78-4d83-b75f-935a2336c29b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:58.970692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462cb26-cd78-4d83-b75f-935a2336c29b None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:58.972035 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462cb26-cd78-4d83-b75f-935a2336c29b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:58.972570 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462cb26-cd78-4d83-b75f-935a2336c29b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:58.980938 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462cb26-cd78-4d83-b75f-935a2336c29b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:58.998768 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 121/233] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:18:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:59.008856 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193957e-842e-4eab-9770-89d2efa684d4 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:59.138588 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462cb26-cd78-4d83-b75f-935a2336c29b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:59.195918 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193957e-842e-4eab-9770-89d2efa684d4 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:59.244800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:59.273125 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462cb26-cd78-4d83-b75f-935a2336c29b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:59.277228 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43080a55-27b1-48dc-9627-561750c7fa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:59.277433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43080a55-27b1-48dc-9627-561750c7fa1b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:59.277663 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43080a55-27b1-48dc-9627-561750c7fa1b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:59.277821 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43080a55-27b1-48dc-9627-561750c7fa1b None admin] PATH_INFO: `/v3/users/a8cf90f11cad4262944d84826169770b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:59.279071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43080a55-27b1-48dc-9627-561750c7fa1b None admin] RBAC: Authorizing `identity:get_user(user_id=a8cf90f11cad4262944d84826169770b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:59.280821 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43080a55-27b1-48dc-9627-561750c7fa1b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:59.282551 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 113/234] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:59 2022] GET /identity/v3/users/a8cf90f11cad4262944d84826169770b => generated 283 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:59.292167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43080a55-27b1-48dc-9627-561750c7fa1b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:59.318854 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481c6ce-b451-438f-89a1-8c4948415f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:59.320792 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481c6ce-b451-438f-89a1-8c4948415f60 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:59.321306 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481c6ce-b451-438f-89a1-8c4948415f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:59.321778 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481c6ce-b451-438f-89a1-8c4948415f60 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:59.336183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481c6ce-b451-438f-89a1-8c4948415f60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:59.342501 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-1481c6ce-b451-438f-89a1-8c4948415f60 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:18:59.342501 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:59.342501 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:59.342501 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:59.342501 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:59.342501 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:59.342501 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:59.342501 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:59.342501 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:59.342501 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:59.342501 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:59.342501 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:59.342501 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:59.342501 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:59.342501 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:59.342501 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:59.343450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:59.343450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:59.343450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:59.343450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:59.343450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:59.343450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:59.343450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:59.343450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:59.343450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:59.343450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:59.343450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:59.343450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:59.343450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:59.343450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:59.343450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:59.343450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:59.344230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:59.344230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:59.344230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:59.344230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:59.344230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:59.344230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:59.344230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:59.344230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:59.344230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:59.344230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:59.344230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:18:59.344230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:18:59.348265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 122/235] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:18:59.354418 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481c6ce-b451-438f-89a1-8c4948415f60 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:59.425264 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:59.524578 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481c6ce-b451-438f-89a1-8c4948415f60 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:59.601374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43080a55-27b1-48dc-9627-561750c7fa1b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:59.621891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d19aa4-1dd7-416a-94ef-06d92c650db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:59.623088 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d19aa4-1dd7-416a-94ef-06d92c650db8 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:59.623588 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d19aa4-1dd7-416a-94ef-06d92c650db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:59.624062 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d19aa4-1dd7-416a-94ef-06d92c650db8 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:59.625347 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d19aa4-1dd7-416a-94ef-06d92c650db8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:59.629191 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d19aa4-1dd7-416a-94ef-06d92c650db8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:59.632330 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d19aa4-1dd7-416a-94ef-06d92c650db8 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:59.644140 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:59.664425 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 123/236] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:18:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:59.666472 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb02233-cd7c-4049-b6c3-499089648826 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:59.667058 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb02233-cd7c-4049-b6c3-499089648826 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:59.672533 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb02233-cd7c-4049-b6c3-499089648826 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:59.672533 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 124/237] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:18:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:59.675477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb02233-cd7c-4049-b6c3-499089648826 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:59.683429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a9867-c7c1-40da-a5a2-979ec7a0ebf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:59.684379 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a9867-c7c1-40da-a5a2-979ec7a0ebf9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:59.684830 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a9867-c7c1-40da-a5a2-979ec7a0ebf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:59.685260 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a9867-c7c1-40da-a5a2-979ec7a0ebf9 None admin] PATH_INFO: `/v3/projects/4adbce25e8e4487caa00d740c3b88473` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:59.686697 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a9867-c7c1-40da-a5a2-979ec7a0ebf9 None admin] RBAC: Authorizing `identity:get_project(project_id=4adbce25e8e4487caa00d740c3b88473)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:59.689087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a9867-c7c1-40da-a5a2-979ec7a0ebf9 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:59.691457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 114/238] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:59 2022] GET /identity/v3/projects/4adbce25e8e4487caa00d740c3b88473 => generated 302 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:59.692973 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e3c8c-a9e9-4a7f-bb06-3818b448011f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:59.693428 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e3c8c-a9e9-4a7f-bb06-3818b448011f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:59.693843 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e3c8c-a9e9-4a7f-bb06-3818b448011f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:59.714693 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-105e3c8c-a9e9-4a7f-bb06-3818b448011f None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:59.716219 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-105e3c8c-a9e9-4a7f-bb06-3818b448011f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:59.845769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 115/239] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:18:59.850461 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e3c8c-a9e9-4a7f-bb06-3818b448011f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:59.885338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb02233-cd7c-4049-b6c3-499089648826 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:59.951472 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:59.969229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83050000-ca04-4c45-9a90-ab158b9f27fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:59.970773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83050000-ca04-4c45-9a90-ab158b9f27fa None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:59.971193 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83050000-ca04-4c45-9a90-ab158b9f27fa None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:59.971608 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83050000-ca04-4c45-9a90-ab158b9f27fa None admin] PATH_INFO: `/v3/users/22ca99c68fe847d38726a57e8c6f3b41` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:00.006811 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83050000-ca04-4c45-9a90-ab158b9f27fa None admin] RBAC: Authorizing `identity:get_user(user_id=22ca99c68fe847d38726a57e8c6f3b41)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:00.009637 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83050000-ca04-4c45-9a90-ab158b9f27fa None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:00.021281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 125/240] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:59 2022] GET /identity/v3/users/22ca99c68fe847d38726a57e8c6f3b41 => generated 297 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:00.027770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83050000-ca04-4c45-9a90-ab158b9f27fa None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:00.105411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e3c8c-a9e9-4a7f-bb06-3818b448011f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:00.227990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:00.249399 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c97b1-af7e-4abb-81fa-8491289e52d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:00.250774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c97b1-af7e-4abb-81fa-8491289e52d8 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:00.251753 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c97b1-af7e-4abb-81fa-8491289e52d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:00.252240 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c97b1-af7e-4abb-81fa-8491289e52d8 None admin] PATH_INFO: `/v3/projects/4adbce25e8e4487caa00d740c3b88473/users/a8cf90f11cad4262944d84826169770b/roles/f889b15cab8c46f58be00f84143aac60` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:00.257102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c97b1-af7e-4abb-81fa-8491289e52d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=4adbce25e8e4487caa00d740c3b88473, user_id=a8cf90f11cad4262944d84826169770b, role_id=f889b15cab8c46f58be00f84143aac60)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:00.260487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c97b1-af7e-4abb-81fa-8491289e52d8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:00.294152 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 116/241] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 1 16:18:59 2022] PUT /identity/v3/projects/4adbce25e8e4487caa00d740c3b88473/users/a8cf90f11cad4262944d84826169770b/roles/f889b15cab8c46f58be00f84143aac60 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:19:00.294621 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83050000-ca04-4c45-9a90-ab158b9f27fa None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:00.295669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c97b1-af7e-4abb-81fa-8491289e52d8 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:00.422818 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b2ade-6096-4fdd-967f-22acbfa6a3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:00.423799 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b2ade-6096-4fdd-967f-22acbfa6a3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:00.424284 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b2ade-6096-4fdd-967f-22acbfa6a3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:00.424802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b2ade-6096-4fdd-967f-22acbfa6a3c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:00.581383 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:00.587410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c97b1-af7e-4abb-81fa-8491289e52d8 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:00.633816 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49db9dc-284f-4911-9d29-8b28f1a277f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:00.634482 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49db9dc-284f-4911-9d29-8b28f1a277f2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:00.634762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49db9dc-284f-4911-9d29-8b28f1a277f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:00.635083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49db9dc-284f-4911-9d29-8b28f1a277f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:00.638579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49db9dc-284f-4911-9d29-8b28f1a277f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:00.640098 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49db9dc-284f-4911-9d29-8b28f1a277f2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:00.641896 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 117/242] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:00.647742 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49db9dc-284f-4911-9d29-8b28f1a277f2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:00.662272 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b2ade-6096-4fdd-967f-22acbfa6a3c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:00.665308 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b2ade-6096-4fdd-967f-22acbfa6a3c7 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:00.769110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49db9dc-284f-4911-9d29-8b28f1a277f2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:00.794916 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:00.811912 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38021d53-c242-4bd4-aa4a-72fbc0588d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:00.812543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38021d53-c242-4bd4-aa4a-72fbc0588d5f None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:00.813046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38021d53-c242-4bd4-aa4a-72fbc0588d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:00.813436 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38021d53-c242-4bd4-aa4a-72fbc0588d5f None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:00.814065 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38021d53-c242-4bd4-aa4a-72fbc0588d5f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:00.815571 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38021d53-c242-4bd4-aa4a-72fbc0588d5f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:00.869408 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 126/243] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 843 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:00.873928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 118/244] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 1 16:19:00 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:19:00.883439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b2ade-6096-4fdd-967f-22acbfa6a3c7 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:01.052699 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b2ade-6096-4fdd-967f-22acbfa6a3c7 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:01.069076 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea93c3-6dd2-4212-a426-6bdf697a7319 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:01.070168 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea93c3-6dd2-4212-a426-6bdf697a7319 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:01.070996 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea93c3-6dd2-4212-a426-6bdf697a7319 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:01.074675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 119/245] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:01 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:01.086004 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0c1b9-1a68-43f3-b3e4-029f861481c2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:01.087116 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0c1b9-1a68-43f3-b3e4-029f861481c2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:01.094441 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0c1b9-1a68-43f3-b3e4-029f861481c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:01.119218 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0db0c1b9-1a68-43f3-b3e4-029f861481c2 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:01.121518 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0db0c1b9-1a68-43f3-b3e4-029f861481c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:01.157584 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:01.167056 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57807c10-8fd8-4b3f-91dd-21de34e11a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:01.168766 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57807c10-8fd8-4b3f-91dd-21de34e11a7d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:01.169614 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57807c10-8fd8-4b3f-91dd-21de34e11a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:01.170551 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57807c10-8fd8-4b3f-91dd-21de34e11a7d None admin] PATH_INFO: `/v3/projects/4adbce25e8e4487caa00d740c3b88473` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:01.173782 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57807c10-8fd8-4b3f-91dd-21de34e11a7d None admin] RBAC: Authorizing `identity:get_project(project_id=4adbce25e8e4487caa00d740c3b88473)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:01.180668 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57807c10-8fd8-4b3f-91dd-21de34e11a7d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:01.182331 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 127/246] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:00 2022] GET /identity/v3/projects/4adbce25e8e4487caa00d740c3b88473 => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:01.191386 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57807c10-8fd8-4b3f-91dd-21de34e11a7d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:01.231138 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:01.288480 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 120/247] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:01.357382 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57807c10-8fd8-4b3f-91dd-21de34e11a7d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:01.406913 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8bd56-568b-42bb-994c-2ee562077962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:01.407584 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8bd56-568b-42bb-994c-2ee562077962 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:01.407859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8bd56-568b-42bb-994c-2ee562077962 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:01.408128 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8bd56-568b-42bb-994c-2ee562077962 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:01.408904 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8bd56-568b-42bb-994c-2ee562077962 None admin] RBAC: Adding query filter params (role.id=2b507beec2294bd293287825491de4bc, scope.project.id=4adbce25e8e4487caa00d740c3b88473, user.id=22ca99c68fe847d38726a57e8c6f3b41) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:01.409205 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8bd56-568b-42bb-994c-2ee562077962 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:01.410692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8bd56-568b-42bb-994c-2ee562077962 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:01.420778 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 128/248] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:01 2022] GET /identity/v3/role_assignments?user.id=22ca99c68fe847d38726a57e8c6f3b41&scope.project.id=4adbce25e8e4487caa00d740c3b88473&role.id=2b507beec2294bd293287825491de4bc => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:01.596347 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0c1b9-1a68-43f3-b3e4-029f861481c2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:01.740486 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0c1b9-1a68-43f3-b3e4-029f861481c2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:01.784564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40caace9-e589-4697-bb27-0d730faac764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:01.785263 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40caace9-e589-4697-bb27-0d730faac764 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:01.785541 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40caace9-e589-4697-bb27-0d730faac764 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:01.785814 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40caace9-e589-4697-bb27-0d730faac764 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:01.799991 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40caace9-e589-4697-bb27-0d730faac764 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:01.805361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-40caace9-e589-4697-bb27-0d730faac764 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:01.805361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:01.805361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:01.805361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:01.805361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:01.805361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:01.805361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:01.805361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:01.805361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:01.805361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:01.805361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:01.805361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:01.805361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:01.805361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:01.805361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:01.805361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:01.807564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:01.807564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:01.807564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:01.807564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:01.807564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:01.807564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:01.807564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:01.807564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:01.807564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:01.807564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:01.807564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:01.807564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:01.807564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:01.807564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:01.807564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:01.807564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:01.808349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:01.808349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:01.808349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:01.808349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:01.808349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:01.808349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:01.808349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:01.808349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:01.808349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:01.808349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:01.808349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:01.808349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:01.808349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 121/249] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:01.816773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8bd56-568b-42bb-994c-2ee562077962 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:01.935503 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:01.947909 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8bd56-568b-42bb-994c-2ee562077962 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:01.988886 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def8977-f14f-4908-b4b7-e93545f7a2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:01.989520 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def8977-f14f-4908-b4b7-e93545f7a2d6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:01.989799 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def8977-f14f-4908-b4b7-e93545f7a2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:01.990075 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def8977-f14f-4908-b4b7-e93545f7a2d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:01.990939 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def8977-f14f-4908-b4b7-e93545f7a2d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:01.991193 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def8977-f14f-4908-b4b7-e93545f7a2d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:01.992611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def8977-f14f-4908-b4b7-e93545f7a2d6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:02.003535 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 129/250] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:02.009389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40caace9-e589-4697-bb27-0d730faac764 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:02.027581 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:02.138518 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40caace9-e589-4697-bb27-0d730faac764 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:02.179905 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4038cf5-94c6-4613-b273-2772fe5ff1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:02.180566 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4038cf5-94c6-4613-b273-2772fe5ff1d5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:02.180890 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4038cf5-94c6-4613-b273-2772fe5ff1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:02.181518 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4038cf5-94c6-4613-b273-2772fe5ff1d5 None admin] PATH_INFO: `/v3/users/5b8f8c6818104fa2854af819d6a1bd2e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:02.182842 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4038cf5-94c6-4613-b273-2772fe5ff1d5 None admin] RBAC: Authorizing `identity:get_user(user_id=5b8f8c6818104fa2854af819d6a1bd2e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:02.184452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4038cf5-94c6-4613-b273-2772fe5ff1d5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:02.186533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 122/251] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:02 2022] GET /identity/v3/users/5b8f8c6818104fa2854af819d6a1bd2e => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:02.192940 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def8977-f14f-4908-b4b7-e93545f7a2d6 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:02.251641 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d65355-a8bc-4927-990a-946a1ceafd44 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:02.251948 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d65355-a8bc-4927-990a-946a1ceafd44 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:02.252152 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d65355-a8bc-4927-990a-946a1ceafd44 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:02.253971 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 123/252] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:19:02.260308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd985e7-13c5-4b34-8861-d8315d71dae6 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:02.260639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd985e7-13c5-4b34-8861-d8315d71dae6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:02.260924 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd985e7-13c5-4b34-8861-d8315d71dae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:02.314452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-cdd985e7-13c5-4b34-8861-d8315d71dae6 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:02.315716 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cdd985e7-13c5-4b34-8861-d8315d71dae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:02.317117 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def8977-f14f-4908-b4b7-e93545f7a2d6 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:02.421923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 124/253] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:02.432656 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb7253-323a-4cf2-8eb8-d59fb0097f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:02.433780 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb7253-323a-4cf2-8eb8-d59fb0097f1f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:02.434280 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb7253-323a-4cf2-8eb8-d59fb0097f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:02.434764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb7253-323a-4cf2-8eb8-d59fb0097f1f None admin] PATH_INFO: `/v3/projects/4adbce25e8e4487caa00d740c3b88473` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:02.445180 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb7253-323a-4cf2-8eb8-d59fb0097f1f None admin] RBAC: Authorizing `identity:get_project(project_id=4adbce25e8e4487caa00d740c3b88473)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:02.447772 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb7253-323a-4cf2-8eb8-d59fb0097f1f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:02.451525 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 130/254] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:02 2022] GET /identity/v3/projects/4adbce25e8e4487caa00d740c3b88473 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:02.457665 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd985e7-13c5-4b34-8861-d8315d71dae6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:02.481895 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:02.625994 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd985e7-13c5-4b34-8861-d8315d71dae6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:02.678942 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72bdd1-670f-4039-8b18-7dc102d92991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:02.679631 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72bdd1-670f-4039-8b18-7dc102d92991 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:02.679909 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72bdd1-670f-4039-8b18-7dc102d92991 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:02.680184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72bdd1-670f-4039-8b18-7dc102d92991 None admin] PATH_INFO: `/v3/projects/4adbce25e8e4487caa00d740c3b88473/users/5b8f8c6818104fa2854af819d6a1bd2e/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:02.683520 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72bdd1-670f-4039-8b18-7dc102d92991 None admin] RBAC: Authorizing `identity:create_grant(project_id=4adbce25e8e4487caa00d740c3b88473, user_id=5b8f8c6818104fa2854af819d6a1bd2e, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:02.685072 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72bdd1-670f-4039-8b18-7dc102d92991 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:02.714720 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 125/255] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 1 16:19:02 2022] PUT /identity/v3/projects/4adbce25e8e4487caa00d740c3b88473/users/5b8f8c6818104fa2854af819d6a1bd2e/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:19:03.006795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb7253-323a-4cf2-8eb8-d59fb0097f1f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:03.058192 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:03.181094 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb7253-323a-4cf2-8eb8-d59fb0097f1f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:03.245770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502201dd-d3e8-4d01-b577-baba235c0748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:03.246831 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502201dd-d3e8-4d01-b577-baba235c0748 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:03.247311 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502201dd-d3e8-4d01-b577-baba235c0748 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:03.247781 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502201dd-d3e8-4d01-b577-baba235c0748 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:03.283122 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502201dd-d3e8-4d01-b577-baba235c0748 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:03.293821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-502201dd-d3e8-4d01-b577-baba235c0748 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:19:03.293821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:03.293821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:03.293821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:03.293821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:03.293821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:03.293821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:03.293821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:03.293821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:03.293821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:03.293821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:03.293821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:03.293821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:03.293821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:03.293821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:03.293821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:03.295870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:03.295870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:03.295870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:03.295870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:03.295870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:03.295870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:03.295870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:03.295870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:03.295870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:03.295870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:03.295870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:03.295870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:03.295870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:03.295870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:03.295870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:03.295870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:03.298873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:03.298873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:03.298873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:03.298873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:03.298873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:03.298873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:03.298873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:03.298873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:03.298873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:03.298873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:03.298873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:19:03.298873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:03.298873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 131/256] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:19:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:03.310349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72bdd1-670f-4039-8b18-7dc102d92991 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:03.442733 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:03.456218 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a6875-3679-4965-a8e3-f8f25f08544d None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:03.457247 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a6875-3679-4965-a8e3-f8f25f08544d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:03.458021 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a6875-3679-4965-a8e3-f8f25f08544d None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:03.467609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 132/257] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:03 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:03.476120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b50e4-08f3-4971-b553-da2292377d08 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:03.477071 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b50e4-08f3-4971-b553-da2292377d08 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:03.477858 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b50e4-08f3-4971-b553-da2292377d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:03.489815 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72bdd1-670f-4039-8b18-7dc102d92991 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:03.542542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-622b50e4-08f3-4971-b553-da2292377d08 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:03.545306 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-622b50e4-08f3-4971-b553-da2292377d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:03.607304 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ffa30-c0f4-4cdb-9401-8e7fb0ae0b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:03.608372 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ffa30-c0f4-4cdb-9401-8e7fb0ae0b0c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:03.608899 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ffa30-c0f4-4cdb-9401-8e7fb0ae0b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:03.609401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ffa30-c0f4-4cdb-9401-8e7fb0ae0b0c None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:03.611160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ffa30-c0f4-4cdb-9401-8e7fb0ae0b0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:03.611481 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ffa30-c0f4-4cdb-9401-8e7fb0ae0b0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:03.621172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ffa30-c0f4-4cdb-9401-8e7fb0ae0b0c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:03.636787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 126/258] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:03.645309 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ffa30-c0f4-4cdb-9401-8e7fb0ae0b0c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:03.819061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 133/259] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:03.925750 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ffa30-c0f4-4cdb-9401-8e7fb0ae0b0c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:03.972302 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:03.981392 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea76b84-2ba1-42e7-b710-22bc8daed733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:03.982061 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea76b84-2ba1-42e7-b710-22bc8daed733 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:03.982343 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea76b84-2ba1-42e7-b710-22bc8daed733 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:03.982619 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea76b84-2ba1-42e7-b710-22bc8daed733 None admin] PATH_INFO: `/v3/users/a8cf90f11cad4262944d84826169770b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:03.986948 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea76b84-2ba1-42e7-b710-22bc8daed733 None admin] RBAC: Authorizing `identity:get_user(user_id=a8cf90f11cad4262944d84826169770b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:03.988646 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea76b84-2ba1-42e7-b710-22bc8daed733 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:03.990437 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 127/260] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:03 2022] GET /identity/v3/users/a8cf90f11cad4262944d84826169770b => generated 283 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:03.999671 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b50e4-08f3-4971-b553-da2292377d08 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:04.035970 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:04.188229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b50e4-08f3-4971-b553-da2292377d08 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:04.232801 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9fb4e-e866-4e09-8783-05585ddf697c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:04.233449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9fb4e-e866-4e09-8783-05585ddf697c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:04.233732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9fb4e-e866-4e09-8783-05585ddf697c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:04.234008 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9fb4e-e866-4e09-8783-05585ddf697c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:04.334433 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9fb4e-e866-4e09-8783-05585ddf697c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:04.335944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9fb4e-e866-4e09-8783-05585ddf697c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:04.352003 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:04.463462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 134/261] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:04.472056 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea76b84-2ba1-42e7-b710-22bc8daed733 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:04.600454 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea76b84-2ba1-42e7-b710-22bc8daed733 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:04.606550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9fb4e-e866-4e09-8783-05585ddf697c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:04.646536 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf702d-a4ca-4e4d-b44b-a8830f633623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:04.647197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf702d-a4ca-4e4d-b44b-a8830f633623 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:04.647481 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf702d-a4ca-4e4d-b44b-a8830f633623 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:04.647763 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf702d-a4ca-4e4d-b44b-a8830f633623 None admin] PATH_INFO: `/v3/projects/4adbce25e8e4487caa00d740c3b88473` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:04.649878 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf702d-a4ca-4e4d-b44b-a8830f633623 None admin] RBAC: Authorizing `identity:get_project(project_id=4adbce25e8e4487caa00d740c3b88473)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:04.651396 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf702d-a4ca-4e4d-b44b-a8830f633623 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:04.653516 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 128/262] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:04 2022] GET /identity/v3/projects/4adbce25e8e4487caa00d740c3b88473 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:04.671189 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf702d-a4ca-4e4d-b44b-a8830f633623 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:04.787405 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:04.847245 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf702d-a4ca-4e4d-b44b-a8830f633623 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:04.913966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1b80c-d07f-4534-858d-089600a77b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:04.915021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1b80c-d07f-4534-858d-089600a77b88 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:04.915452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1b80c-d07f-4534-858d-089600a77b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:04.915874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1b80c-d07f-4534-858d-089600a77b88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:04.916880 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1b80c-d07f-4534-858d-089600a77b88 None admin] RBAC: Adding query filter params (role.id=a8896546a02c42489ef73c7ad7c43542, scope.project.id=4adbce25e8e4487caa00d740c3b88473, user.id=a8cf90f11cad4262944d84826169770b) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:04.918102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1b80c-d07f-4534-858d-089600a77b88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:04.919834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1b80c-d07f-4534-858d-089600a77b88 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:04.936066 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 129/263] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:04 2022] GET /identity/v3/role_assignments?user.id=a8cf90f11cad4262944d84826169770b&scope.project.id=4adbce25e8e4487caa00d740c3b88473&role.id=a8896546a02c42489ef73c7ad7c43542 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:04.973488 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b944211-2d92-4904-8fde-16f1cedb2b84 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:04.974031 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b944211-2d92-4904-8fde-16f1cedb2b84 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:04.974454 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b944211-2d92-4904-8fde-16f1cedb2b84 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:04.976019 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 130/264] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:19:04.982016 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3c0e9-ffb0-4213-a98c-d41aeb38ad9f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:04.982668 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3c0e9-ffb0-4213-a98c-d41aeb38ad9f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:04.983091 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3c0e9-ffb0-4213-a98c-d41aeb38ad9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:05.004120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9fb4e-e866-4e09-8783-05585ddf697c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:05.026166 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-59b3c0e9-ffb0-4213-a98c-d41aeb38ad9f None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:05.026764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:05.029144 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-59b3c0e9-ffb0-4213-a98c-d41aeb38ad9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:05.153851 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd693e8-8052-4282-947a-e81ef09e5079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:05.154624 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd693e8-8052-4282-947a-e81ef09e5079 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:05.154759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd693e8-8052-4282-947a-e81ef09e5079 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:05.155118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd693e8-8052-4282-947a-e81ef09e5079 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:05.181243 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 131/265] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:19:05.197410 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd693e8-8052-4282-947a-e81ef09e5079 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:05.202486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-7bd693e8-8052-4282-947a-e81ef09e5079 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:05.202486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:05.202486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:05.202486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:05.202486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:05.202486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:05.202486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:05.202486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:05.202486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:05.202486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:05.202486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:05.202486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:05.202486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:05.202486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:05.202486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:05.202486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:05.205241 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:05.205241 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:05.205241 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:05.205241 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:05.205241 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:05.205241 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:05.205241 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:05.205241 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:05.205241 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:05.205241 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:05.205241 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:05.205241 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:05.205241 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:05.205241 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:05.205241 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:05.205241 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:05.208053 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:05.208053 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:05.208053 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:05.208053 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:05.208053 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:05.208053 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:05.208053 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:05.208053 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:05.208053 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:05.208053 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:05.208053 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:05.208053 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:05.208053 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 135/266] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 1 16:19:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 598 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:19:05.213523 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3c0e9-ffb0-4213-a98c-d41aeb38ad9f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:05.253868 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8903c-3587-4969-9eb2-2244df8650e8 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:05.254292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8903c-3587-4969-9eb2-2244df8650e8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:05.254528 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8903c-3587-4969-9eb2-2244df8650e8 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:05.255818 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 136/267] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:05.274153 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc70afd-0f31-4d44-8f5a-c97b9cb33b75 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:05.274424 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc70afd-0f31-4d44-8f5a-c97b9cb33b75 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:05.274693 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc70afd-0f31-4d44-8f5a-c97b9cb33b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:05.309481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-bbc70afd-0f31-4d44-8f5a-c97b9cb33b75 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:05.310675 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-bbc70afd-0f31-4d44-8f5a-c97b9cb33b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:05.359544 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:05.489964 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3c0e9-ffb0-4213-a98c-d41aeb38ad9f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:05.524242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 137/268] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:05.568529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc70afd-0f31-4d44-8f5a-c97b9cb33b75 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:05.577705 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba93cc5-afa2-4741-a01a-261dad86c090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:05.578388 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba93cc5-afa2-4741-a01a-261dad86c090 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:05.578666 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba93cc5-afa2-4741-a01a-261dad86c090 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:05.578990 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba93cc5-afa2-4741-a01a-261dad86c090 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:05.579687 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba93cc5-afa2-4741-a01a-261dad86c090 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:05.579992 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba93cc5-afa2-4741-a01a-261dad86c090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:05.581512 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba93cc5-afa2-4741-a01a-261dad86c090 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:05.591391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 132/269] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:05.600844 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba93cc5-afa2-4741-a01a-261dad86c090 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:05.729684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba93cc5-afa2-4741-a01a-261dad86c090 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:05.762687 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:05.772859 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f94e0-557f-4d42-b136-8ed89edf82ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:05.774104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f94e0-557f-4d42-b136-8ed89edf82ec None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:05.774620 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f94e0-557f-4d42-b136-8ed89edf82ec None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:05.775098 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f94e0-557f-4d42-b136-8ed89edf82ec None admin] PATH_INFO: `/v3/users/a8cf90f11cad4262944d84826169770b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:05.776775 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f94e0-557f-4d42-b136-8ed89edf82ec None admin] RBAC: Authorizing `identity:get_user(user_id=a8cf90f11cad4262944d84826169770b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:05.778593 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f94e0-557f-4d42-b136-8ed89edf82ec None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:05.780647 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 133/270] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:05 2022] GET /identity/v3/users/a8cf90f11cad4262944d84826169770b => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:05.792896 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f94e0-557f-4d42-b136-8ed89edf82ec None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:05.841244 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:05.851335 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc70afd-0f31-4d44-8f5a-c97b9cb33b75 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:05.962543 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d911179-0622-4340-ac88-7901ea243aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:05.964238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d911179-0622-4340-ac88-7901ea243aef None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:05.965008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f94e0-557f-4d42-b136-8ed89edf82ec None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:05.965382 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d911179-0622-4340-ac88-7901ea243aef None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:05.966147 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d911179-0622-4340-ac88-7901ea243aef None admin] PATH_INFO: `/v3/roles/member` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:05.988511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d911179-0622-4340-ac88-7901ea243aef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:05.999739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-2d911179-0622-4340-ac88-7901ea243aef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:05.999739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:05.999739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:05.999739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:05.999739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:05.999739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:05.999739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:05.999739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:05.999739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:05.999739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:05.999739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:05.999739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:05.999739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:05.999739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:05.999739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:05.999739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:06.001876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:06.001876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:06.001876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:06.001876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:06.001876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:06.001876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:06.001876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:06.001876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:06.001876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:06.001876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:06.001876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:06.001876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:06.001876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:06.001876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:06.001876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:06.001876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:06.003486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:06.003486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:06.003486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:06.003486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:06.003486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:06.003486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:06.003486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:06.003486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:06.003486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:06.003486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:06.003486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:06.003486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:06.012828 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 138/271] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 441 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:06.019080 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d911179-0622-4340-ac88-7901ea243aef None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:06.046951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39703c02-4709-44fc-a291-f1326e5fde06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:06.048086 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39703c02-4709-44fc-a291-f1326e5fde06 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:06.048641 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39703c02-4709-44fc-a291-f1326e5fde06 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:06.049139 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39703c02-4709-44fc-a291-f1326e5fde06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:06.181587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:06.200596 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39703c02-4709-44fc-a291-f1326e5fde06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:06.203242 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39703c02-4709-44fc-a291-f1326e5fde06 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:06.258856 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d911179-0622-4340-ac88-7901ea243aef None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:06.306028 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad91869-e3eb-4349-a256-4645f60eaf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:06.306998 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad91869-e3eb-4349-a256-4645f60eaf5d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:06.307472 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad91869-e3eb-4349-a256-4645f60eaf5d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:06.307907 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad91869-e3eb-4349-a256-4645f60eaf5d None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:06.308827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad91869-e3eb-4349-a256-4645f60eaf5d None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:06.309135 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad91869-e3eb-4349-a256-4645f60eaf5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:06.310588 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad91869-e3eb-4349-a256-4645f60eaf5d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:06.322929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 139/272] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:06.328113 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ec91e-3ede-4d24-8699-bbf3a15ea6be None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:06.328516 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ec91e-3ede-4d24-8699-bbf3a15ea6be None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:06.329022 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ec91e-3ede-4d24-8699-bbf3a15ea6be None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:06.331043 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 140/273] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:06.339047 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ec91e-3ede-4d24-8699-bbf3a15ea6be None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:06.350463 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 134/274] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:06.351360 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39703c02-4709-44fc-a291-f1326e5fde06 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:06.376779 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:06.459723 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:06.473757 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39703c02-4709-44fc-a291-f1326e5fde06 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:06.483948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ec91e-3ede-4d24-8699-bbf3a15ea6be None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:06.520801 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc699e57-c288-4d5c-aeaa-fb9564f1a8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:06.521614 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc699e57-c288-4d5c-aeaa-fb9564f1a8ef None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:06.521756 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc699e57-c288-4d5c-aeaa-fb9564f1a8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:06.521959 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc699e57-c288-4d5c-aeaa-fb9564f1a8ef None admin] PATH_INFO: `/v3/users/37325220b21c4d64b4d538c3cd240792` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:06.529565 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916d707-de44-4b2e-8acb-3eb51c1b9dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:06.530224 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916d707-de44-4b2e-8acb-3eb51c1b9dfb None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:06.530498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916d707-de44-4b2e-8acb-3eb51c1b9dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:06.531396 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916d707-de44-4b2e-8acb-3eb51c1b9dfb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:06.537615 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc699e57-c288-4d5c-aeaa-fb9564f1a8ef None admin] RBAC: Authorizing `identity:get_user(user_id=37325220b21c4d64b4d538c3cd240792)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:06.539175 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc699e57-c288-4d5c-aeaa-fb9564f1a8ef None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:06.540979 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 135/275] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:06 2022] GET /identity/v3/users/37325220b21c4d64b4d538c3cd240792 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:06.542243 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c100c0-e16d-4334-955a-d406f715a1d5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:06.542525 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c100c0-e16d-4334-955a-d406f715a1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:06.542775 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c100c0-e16d-4334-955a-d406f715a1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:06.548541 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916d707-de44-4b2e-8acb-3eb51c1b9dfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:06.553609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-f916d707-de44-4b2e-8acb-3eb51c1b9dfb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:19:06.553609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:06.553609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:06.553609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:06.553609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:06.553609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:06.553609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:06.553609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:06.553609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:06.553609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:06.553609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:06.553609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:06.553609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:06.553609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:06.553609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:06.553609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:06.554663 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:06.554663 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:06.554663 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:06.554663 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:06.554663 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:06.554663 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:06.554663 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:06.554663 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:06.554663 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:06.554663 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:06.554663 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:06.554663 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:06.554663 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:06.554663 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:06.554663 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:06.554663 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:06.555449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:06.555449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:06.555449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:06.555449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:06.555449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:06.555449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:06.555449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:06.555449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:06.555449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:06.555449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:06.555449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:19:06.555449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:06.555449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 141/276] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:06.556127 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916d707-de44-4b2e-8acb-3eb51c1b9dfb None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:06.563017 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c0c100c0-e16d-4334-955a-d406f715a1d5 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:06.564905 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c0c100c0-e16d-4334-955a-d406f715a1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:06.652528 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 136/277] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:06.654887 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252799c-5e84-45b9-900d-2f5cab6246aa None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:06.655370 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252799c-5e84-45b9-900d-2f5cab6246aa None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:06.655847 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252799c-5e84-45b9-900d-2f5cab6246aa None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:06.658475 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 137/278] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:06.659935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252799c-5e84-45b9-900d-2f5cab6246aa None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:06.703022 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:06.739533 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916d707-de44-4b2e-8acb-3eb51c1b9dfb None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:06.761675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:06.787063 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252799c-5e84-45b9-900d-2f5cab6246aa None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:06.812013 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e7b8b-57dd-4255-b6b1-1fc20f60cfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:06.813283 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e7b8b-57dd-4255-b6b1-1fc20f60cfb1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:06.813783 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e7b8b-57dd-4255-b6b1-1fc20f60cfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:06.814273 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e7b8b-57dd-4255-b6b1-1fc20f60cfb1 None admin] PATH_INFO: `/v3/projects/4adbce25e8e4487caa00d740c3b88473` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:06.816869 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e7b8b-57dd-4255-b6b1-1fc20f60cfb1 None admin] RBAC: Authorizing `identity:get_project(project_id=4adbce25e8e4487caa00d740c3b88473)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:06.819983 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e7b8b-57dd-4255-b6b1-1fc20f60cfb1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:06.828301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 142/279] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:06 2022] GET /identity/v3/projects/4adbce25e8e4487caa00d740c3b88473 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:06.828301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e7b8b-57dd-4255-b6b1-1fc20f60cfb1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:06.833968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ac936-507a-447e-b9ee-5f6b5457239c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:06.834596 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ac936-507a-447e-b9ee-5f6b5457239c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:06.834877 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ac936-507a-447e-b9ee-5f6b5457239c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:06.835139 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ac936-507a-447e-b9ee-5f6b5457239c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:06.835883 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ac936-507a-447e-b9ee-5f6b5457239c None admin] RBAC: Adding query filter params (role.id=76a38a2307da45bcb511ef106076613d, user.id=37325220b21c4d64b4d538c3cd240792, scope.system=all) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:06.836290 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ac936-507a-447e-b9ee-5f6b5457239c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:06.837803 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ac936-507a-447e-b9ee-5f6b5457239c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:06.846372 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 138/280] 10.222.0.52 () {56 vars in 1308 bytes} [Thu Sep 1 16:19:06 2022] GET /identity/v3/role_assignments?user.id=37325220b21c4d64b4d538c3cd240792&scope.system=all&role.id=76a38a2307da45bcb511ef106076613d => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:06.847261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631484a-e63d-4540-a6dd-5caf7596c542 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:06.847691 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631484a-e63d-4540-a6dd-5caf7596c542 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:06.847939 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631484a-e63d-4540-a6dd-5caf7596c542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:06.869900 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2631484a-e63d-4540-a6dd-5caf7596c542 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:06.871146 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2631484a-e63d-4540-a6dd-5caf7596c542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:06.986542 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 139/281] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:06.987999 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631484a-e63d-4540-a6dd-5caf7596c542 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:07.044731 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e7b8b-57dd-4255-b6b1-1fc20f60cfb1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:07.102636 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04244ed1-a042-45e5-ae7a-6798d9be9757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:07.103688 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04244ed1-a042-45e5-ae7a-6798d9be9757 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:07.104170 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04244ed1-a042-45e5-ae7a-6798d9be9757 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:07.104684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04244ed1-a042-45e5-ae7a-6798d9be9757 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:07.105655 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04244ed1-a042-45e5-ae7a-6798d9be9757 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:07.106187 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04244ed1-a042-45e5-ae7a-6798d9be9757 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:07.107846 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04244ed1-a042-45e5-ae7a-6798d9be9757 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:07.123805 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 143/282] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:07.125262 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04244ed1-a042-45e5-ae7a-6798d9be9757 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:07.152895 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:07.163117 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:07.223748 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631484a-e63d-4540-a6dd-5caf7596c542 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:07.310923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78fe38-b139-42e5-a162-f6a7d6273b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:07.312885 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78fe38-b139-42e5-a162-f6a7d6273b99 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:07.313787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78fe38-b139-42e5-a162-f6a7d6273b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:07.314517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78fe38-b139-42e5-a162-f6a7d6273b99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:07.316556 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78fe38-b139-42e5-a162-f6a7d6273b99 None admin] RBAC: Adding query filter params (role.id=f889b15cab8c46f58be00f84143aac60, scope.project.id=4adbce25e8e4487caa00d740c3b88473, user.id=a8cf90f11cad4262944d84826169770b) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:07.317522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78fe38-b139-42e5-a162-f6a7d6273b99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:07.318987 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04244ed1-a042-45e5-ae7a-6798d9be9757 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:07.321897 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78fe38-b139-42e5-a162-f6a7d6273b99 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:07.335608 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 140/283] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:06 2022] GET /identity/v3/role_assignments?user.id=a8cf90f11cad4262944d84826169770b&scope.project.id=4adbce25e8e4487caa00d740c3b88473&role.id=f889b15cab8c46f58be00f84143aac60 => generated 608 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:07.337658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78fe38-b139-42e5-a162-f6a7d6273b99 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:07.361532 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3858376-957a-47ac-86af-2886fc6186ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:07.362204 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3858376-957a-47ac-86af-2886fc6186ae None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:07.362485 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3858376-957a-47ac-86af-2886fc6186ae None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:07.362749 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3858376-957a-47ac-86af-2886fc6186ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:07.364268 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3858376-957a-47ac-86af-2886fc6186ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:07.365826 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3858376-957a-47ac-86af-2886fc6186ae None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:07.367622 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 144/284] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:07.378059 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3858376-957a-47ac-86af-2886fc6186ae None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:07.554285 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:07.577583 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3858376-957a-47ac-86af-2886fc6186ae None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:07.602365 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78fe38-b139-42e5-a162-f6a7d6273b99 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:07.638612 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fda2e-4859-4642-b622-a02abeed19bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:07.639246 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fda2e-4859-4642-b622-a02abeed19bf None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:07.639526 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fda2e-4859-4642-b622-a02abeed19bf None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:07.639799 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fda2e-4859-4642-b622-a02abeed19bf None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:07.643419 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fda2e-4859-4642-b622-a02abeed19bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:07.643419 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fda2e-4859-4642-b622-a02abeed19bf None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:07.665716 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173b893-302d-49bc-a4cb-d958f74b0d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:07.666907 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173b893-302d-49bc-a4cb-d958f74b0d5d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:07.667408 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173b893-302d-49bc-a4cb-d958f74b0d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:07.667968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173b893-302d-49bc-a4cb-d958f74b0d5d None admin] PATH_INFO: `/v3/users/22ca99c68fe847d38726a57e8c6f3b41` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:07.668751 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 145/285] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 1 16:19:07 2022] POST /identity/v3/users => generated 293 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:19:07.669843 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fda2e-4859-4642-b622-a02abeed19bf None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:07.670375 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173b893-302d-49bc-a4cb-d958f74b0d5d None admin] RBAC: Authorizing `identity:get_user(user_id=22ca99c68fe847d38726a57e8c6f3b41)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:07.674621 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173b893-302d-49bc-a4cb-d958f74b0d5d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:07.678134 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 141/286] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:07 2022] GET /identity/v3/users/22ca99c68fe847d38726a57e8c6f3b41 => generated 297 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:07.686038 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173b893-302d-49bc-a4cb-d958f74b0d5d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:07.703456 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:07.819322 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173b893-302d-49bc-a4cb-d958f74b0d5d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:07.842602 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fda2e-4859-4642-b622-a02abeed19bf None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:07.862174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a80124-d9ae-42a2-a8c2-f3b3469d4891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:07.862938 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a80124-d9ae-42a2-a8c2-f3b3469d4891 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:07.863304 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a80124-d9ae-42a2-a8c2-f3b3469d4891 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:07.863647 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a80124-d9ae-42a2-a8c2-f3b3469d4891 None admin] PATH_INFO: `/v3/projects/4adbce25e8e4487caa00d740c3b88473` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:07.865148 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a80124-d9ae-42a2-a8c2-f3b3469d4891 None admin] RBAC: Authorizing `identity:get_project(project_id=4adbce25e8e4487caa00d740c3b88473)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:07.867021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a80124-d9ae-42a2-a8c2-f3b3469d4891 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:07.869039 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 142/287] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:07 2022] GET /identity/v3/projects/4adbce25e8e4487caa00d740c3b88473 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:07.876450 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a80124-d9ae-42a2-a8c2-f3b3469d4891 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:07.890973 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbe9ea-baa8-4912-b700-f0a4e25bf4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:07.892650 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbe9ea-baa8-4912-b700-f0a4e25bf4ed None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:07.893001 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbe9ea-baa8-4912-b700-f0a4e25bf4ed None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:07.893269 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbe9ea-baa8-4912-b700-f0a4e25bf4ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:07.896756 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:07.910862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbe9ea-baa8-4912-b700-f0a4e25bf4ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:07.916169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-adfbe9ea-baa8-4912-b700-f0a4e25bf4ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:07.916169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:07.916169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:07.916169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:07.916169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:07.916169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:07.916169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:07.916169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:07.916169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:07.916169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:07.916169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:07.916169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:07.916169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:07.916169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:07.916169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:07.916169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:07.917238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:07.917238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:07.917238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:07.917238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:07.917238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:07.917238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:07.917238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:07.917238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:07.917238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:07.917238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:07.917238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:07.917238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:07.917238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:07.917238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:07.917238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:07.917238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:07.918109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:07.918109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:07.918109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:07.918109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:07.918109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:07.918109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:07.918109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:07.918109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:07.918109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:07.918109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:07.918109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:07.918109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:07.920137 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 146/288] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:07.926539 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbe9ea-baa8-4912-b700-f0a4e25bf4ed None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:07.979458 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:08.025110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a80124-d9ae-42a2-a8c2-f3b3469d4891 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:08.089927 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4179f4-c513-4032-b51d-ffdca1e34725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:08.090768 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4179f4-c513-4032-b51d-ffdca1e34725 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:08.091109 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4179f4-c513-4032-b51d-ffdca1e34725 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:08.091464 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4179f4-c513-4032-b51d-ffdca1e34725 None admin] PATH_INFO: `/v3/projects/4adbce25e8e4487caa00d740c3b88473/users/22ca99c68fe847d38726a57e8c6f3b41/roles/2b507beec2294bd293287825491de4bc` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:08.093922 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4179f4-c513-4032-b51d-ffdca1e34725 None admin] RBAC: Authorizing `identity:create_grant(project_id=4adbce25e8e4487caa00d740c3b88473, user_id=22ca99c68fe847d38726a57e8c6f3b41, role_id=2b507beec2294bd293287825491de4bc)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:08.096031 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4179f4-c513-4032-b51d-ffdca1e34725 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:08.117381 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 143/289] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 1 16:19:07 2022] PUT /identity/v3/projects/4adbce25e8e4487caa00d740c3b88473/users/22ca99c68fe847d38726a57e8c6f3b41/roles/2b507beec2294bd293287825491de4bc => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:19:08.152598 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbe9ea-baa8-4912-b700-f0a4e25bf4ed None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:08.231094 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cfe69-bd1d-4a2f-8e95-310a0e731ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:08.232190 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cfe69-bd1d-4a2f-8e95-310a0e731ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:08.232736 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cfe69-bd1d-4a2f-8e95-310a0e731ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:08.233257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cfe69-bd1d-4a2f-8e95-310a0e731ff6 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:08.234538 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cfe69-bd1d-4a2f-8e95-310a0e731ff6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:08.235607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cfe69-bd1d-4a2f-8e95-310a0e731ff6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:08.238380 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cfe69-bd1d-4a2f-8e95-310a0e731ff6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:08.256238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 147/290] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:08.265829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4179f4-c513-4032-b51d-ffdca1e34725 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:08.483958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4179f4-c513-4032-b51d-ffdca1e34725 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:08.571549 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9c4f6-bf85-44f2-8c95-6526af0e5d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:08.572789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9c4f6-bf85-44f2-8c95-6526af0e5d98 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:08.573301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9c4f6-bf85-44f2-8c95-6526af0e5d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:08.573846 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9c4f6-bf85-44f2-8c95-6526af0e5d98 None admin] PATH_INFO: `/v3/users/5b8f8c6818104fa2854af819d6a1bd2e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:08.578110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9c4f6-bf85-44f2-8c95-6526af0e5d98 None admin] RBAC: Authorizing `identity:get_user(user_id=5b8f8c6818104fa2854af819d6a1bd2e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:08.579812 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9c4f6-bf85-44f2-8c95-6526af0e5d98 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:08.581606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 144/291] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:08 2022] GET /identity/v3/users/5b8f8c6818104fa2854af819d6a1bd2e => generated 297 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:08.589011 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cfe69-bd1d-4a2f-8e95-310a0e731ff6 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:08.769274 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:08.856168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cfe69-bd1d-4a2f-8e95-310a0e731ff6 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:08.936957 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99101f4-5213-45e6-bb08-1865cdf9760d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:08.937855 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99101f4-5213-45e6-bb08-1865cdf9760d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:08.938372 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99101f4-5213-45e6-bb08-1865cdf9760d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:08.938686 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99101f4-5213-45e6-bb08-1865cdf9760d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:09.096074 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99101f4-5213-45e6-bb08-1865cdf9760d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:09.102936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99101f4-5213-45e6-bb08-1865cdf9760d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:09.237419 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:09.358460 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 148/292] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 771 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:09.365782 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9c4f6-bf85-44f2-8c95-6526af0e5d98 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:09.370652 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:09.603925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9c4f6-bf85-44f2-8c95-6526af0e5d98 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:09.674674 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3881e1-e3be-485e-9522-16bf070016ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:09.675712 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3881e1-e3be-485e-9522-16bf070016ef None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:09.676504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3881e1-e3be-485e-9522-16bf070016ef None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:09.677031 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3881e1-e3be-485e-9522-16bf070016ef None admin] PATH_INFO: `/v3/projects/4adbce25e8e4487caa00d740c3b88473` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:09.679418 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3881e1-e3be-485e-9522-16bf070016ef None admin] RBAC: Authorizing `identity:get_project(project_id=4adbce25e8e4487caa00d740c3b88473)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:09.682390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3881e1-e3be-485e-9522-16bf070016ef None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:09.685671 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 145/293] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:09 2022] GET /identity/v3/projects/4adbce25e8e4487caa00d740c3b88473 => generated 302 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:09.696799 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99101f4-5213-45e6-bb08-1865cdf9760d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:09.748368 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81fdf7-e0b9-4be8-bace-19123a3fe844 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:09.748911 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81fdf7-e0b9-4be8-bace-19123a3fe844 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:09.749412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81fdf7-e0b9-4be8-bace-19123a3fe844 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:09.753019 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 146/294] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:09.760005 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b54a6d-cffc-4c52-bd9f-72bfc9a8b6ee None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:09.760508 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b54a6d-cffc-4c52-bd9f-72bfc9a8b6ee None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:09.761039 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b54a6d-cffc-4c52-bd9f-72bfc9a8b6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:09.817323 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f9b54a6d-cffc-4c52-bd9f-72bfc9a8b6ee None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:09.819444 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f9b54a6d-cffc-4c52-bd9f-72bfc9a8b6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:09.991920 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 147/295] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:19:09.992727 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:10.028886 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99101f4-5213-45e6-bb08-1865cdf9760d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:10.143632 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ac674-d280-428b-8adb-f92ddd2ae357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:10.144821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ac674-d280-428b-8adb-f92ddd2ae357 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:10.145597 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ac674-d280-428b-8adb-f92ddd2ae357 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:10.146110 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ac674-d280-428b-8adb-f92ddd2ae357 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:10.147717 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ac674-d280-428b-8adb-f92ddd2ae357 None admin] RBAC: Adding query filter params (role.id=76a38a2307da45bcb511ef106076613d, scope.project.id=4adbce25e8e4487caa00d740c3b88473, user.id=5b8f8c6818104fa2854af819d6a1bd2e) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:10.148313 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ac674-d280-428b-8adb-f92ddd2ae357 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:10.151297 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ac674-d280-428b-8adb-f92ddd2ae357 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:10.169513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 149/296] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:09 2022] GET /identity/v3/role_assignments?user.id=5b8f8c6818104fa2854af819d6a1bd2e&scope.project.id=4adbce25e8e4487caa00d740c3b88473&role.id=76a38a2307da45bcb511ef106076613d => generated 608 bytes in 474 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:10.298255 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b54a6d-cffc-4c52-bd9f-72bfc9a8b6ee None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:10.450643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b54a6d-cffc-4c52-bd9f-72bfc9a8b6ee None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:10.493529 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd6030-310c-403e-9efb-e48635afd5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:10.494175 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd6030-310c-403e-9efb-e48635afd5e4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:10.494448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd6030-310c-403e-9efb-e48635afd5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:10.494719 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd6030-310c-403e-9efb-e48635afd5e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:10.512341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd6030-310c-403e-9efb-e48635afd5e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:10.523852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-48dd6030-310c-403e-9efb-e48635afd5e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:10.523852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:10.523852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:10.523852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:10.523852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:10.523852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:10.523852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:10.523852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:10.523852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:10.523852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:10.523852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:10.523852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:10.523852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:10.523852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:10.523852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:10.523852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:10.524867 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:10.524867 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:10.524867 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:10.524867 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:10.524867 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:10.524867 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:10.524867 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:10.524867 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:10.524867 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:10.524867 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:10.524867 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:10.524867 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:10.524867 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:10.524867 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:10.524867 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:10.524867 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:10.525658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:10.525658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:10.525658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:10.525658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:10.525658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:10.525658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:10.525658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:10.525658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:10.525658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:10.525658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:10.525658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:10.525658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:10.526757 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 148/297] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:10.532979 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ac674-d280-428b-8adb-f92ddd2ae357 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:10.579751 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:10.586192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b2c9b-9c02-4ac6-9d75-3ea0dcbc6c37 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:10.587565 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b2c9b-9c02-4ac6-9d75-3ea0dcbc6c37 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:10.588391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b2c9b-9c02-4ac6-9d75-3ea0dcbc6c37 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:10.591796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 149/298] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:10 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:19:10.597758 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136a1bd-5ee2-4335-863e-5985b3de3f05 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:10.598030 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136a1bd-5ee2-4335-863e-5985b3de3f05 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:10.598530 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136a1bd-5ee2-4335-863e-5985b3de3f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:10.630221 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b136a1bd-5ee2-4335-863e-5985b3de3f05 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:10.634763 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b136a1bd-5ee2-4335-863e-5985b3de3f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:10.684205 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ac674-d280-428b-8adb-f92ddd2ae357 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:10.719163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:10.730335 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176e4b0-444b-4d35-bdbc-c39c604b8d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:10.731726 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176e4b0-444b-4d35-bdbc-c39c604b8d9f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:10.732155 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176e4b0-444b-4d35-bdbc-c39c604b8d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:10.732713 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176e4b0-444b-4d35-bdbc-c39c604b8d9f None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:10.733577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176e4b0-444b-4d35-bdbc-c39c604b8d9f None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:10.734009 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176e4b0-444b-4d35-bdbc-c39c604b8d9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:10.736167 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176e4b0-444b-4d35-bdbc-c39c604b8d9f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:10.740572 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 150/299] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:10.749292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 150/300] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:10.758035 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136a1bd-5ee2-4335-863e-5985b3de3f05 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:10.901397 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136a1bd-5ee2-4335-863e-5985b3de3f05 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:10.972259 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70739e-9285-4e12-b1ee-01197409582f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:10.973676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70739e-9285-4e12-b1ee-01197409582f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:10.974169 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70739e-9285-4e12-b1ee-01197409582f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:10.974661 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70739e-9285-4e12-b1ee-01197409582f None admin] PATH_INFO: `/v3/users/37325220b21c4d64b4d538c3cd240792` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:10.978836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70739e-9285-4e12-b1ee-01197409582f None admin] RBAC: Authorizing `identity:get_user(user_id=37325220b21c4d64b4d538c3cd240792)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:10.985655 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70739e-9285-4e12-b1ee-01197409582f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:10.989438 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 151/301] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:10 2022] GET /identity/v3/users/37325220b21c4d64b4d538c3cd240792 => generated 293 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:10.998414 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176e4b0-444b-4d35-bdbc-c39c604b8d9f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:11.043511 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70739e-9285-4e12-b1ee-01197409582f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:11.133320 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:11.158457 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:11.183281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176e4b0-444b-4d35-bdbc-c39c604b8d9f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:11.183642 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70739e-9285-4e12-b1ee-01197409582f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:11.226231 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16257283-ee6f-4c71-8f74-5d43a20e61a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:11.227086 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16257283-ee6f-4c71-8f74-5d43a20e61a8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:11.227352 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16257283-ee6f-4c71-8f74-5d43a20e61a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:11.236191 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16257283-ee6f-4c71-8f74-5d43a20e61a8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:11.243471 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30e594-0bd3-4464-9c25-74b681688589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:11.244600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30e594-0bd3-4464-9c25-74b681688589 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:11.245401 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30e594-0bd3-4464-9c25-74b681688589 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:11.245890 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30e594-0bd3-4464-9c25-74b681688589 None admin] PATH_INFO: `/v3/system/users/37325220b21c4d64b4d538c3cd240792/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:11.248502 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30e594-0bd3-4464-9c25-74b681688589 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=37325220b21c4d64b4d538c3cd240792, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:11.250877 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16257283-ee6f-4c71-8f74-5d43a20e61a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:11.251985 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30e594-0bd3-4464-9c25-74b681688589 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:11.256746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-16257283-ee6f-4c71-8f74-5d43a20e61a8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:19:11.256746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:11.256746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:11.256746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:11.256746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:11.256746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:11.256746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:11.256746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:11.256746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:11.256746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:11.256746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:11.256746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:11.256746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:11.256746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:11.256746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:11.256746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:11.257837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:11.257837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:11.257837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:11.257837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:11.257837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:11.257837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:11.257837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:11.257837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:11.257837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:11.257837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:11.257837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:11.257837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:11.257837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:11.257837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:11.257837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:11.257837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:11.258898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:11.258898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:11.258898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:11.258898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:11.258898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:11.258898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:11.258898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:11.258898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:11.258898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:11.258898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:11.258898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:19:11.258898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:11.261333 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 152/302] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:19:11.263036 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0be03-11b5-4c49-9d4d-78e7c2c4154c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:11.263309 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0be03-11b5-4c49-9d4d-78e7c2c4154c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:11.263803 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0be03-11b5-4c49-9d4d-78e7c2c4154c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:11.266476 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 153/303] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:11.267999 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0be03-11b5-4c49-9d4d-78e7c2c4154c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:11.282150 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 151/304] 10.222.0.52 () {58 vars in 1334 bytes} [Thu Sep 1 16:19:10 2022] PUT /identity/v3/system/users/37325220b21c4d64b4d538c3cd240792/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:19:11.284847 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f595e0-db97-4e9a-a45b-56afb347cea1 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:11.285363 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f595e0-db97-4e9a-a45b-56afb347cea1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:11.285851 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f595e0-db97-4e9a-a45b-56afb347cea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:11.316018 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-61f595e0-db97-4e9a-a45b-56afb347cea1 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:11.317645 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-61f595e0-db97-4e9a-a45b-56afb347cea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:11.449315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0be03-11b5-4c49-9d4d-78e7c2c4154c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:11.477987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:11.479496 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 152/305] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:11.499013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e54b5-2334-4f75-9e70-3d418225e550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:11.499642 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e54b5-2334-4f75-9e70-3d418225e550 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:11.499917 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e54b5-2334-4f75-9e70-3d418225e550 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:11.500185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e54b5-2334-4f75-9e70-3d418225e550 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:11.501725 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e54b5-2334-4f75-9e70-3d418225e550 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:11.502260 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e54b5-2334-4f75-9e70-3d418225e550 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:11.505404 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e54b5-2334-4f75-9e70-3d418225e550 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:11.522752 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 154/306] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:11.531370 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f595e0-db97-4e9a-a45b-56afb347cea1 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:11.703476 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:11.749536 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f595e0-db97-4e9a-a45b-56afb347cea1 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:11.819696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8586852-7e79-4039-a32b-2ec9d58da25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:11.821121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8586852-7e79-4039-a32b-2ec9d58da25e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:11.821885 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8586852-7e79-4039-a32b-2ec9d58da25e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:11.822640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8586852-7e79-4039-a32b-2ec9d58da25e None admin] PATH_INFO: `/v3/users/22ca99c68fe847d38726a57e8c6f3b41` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:11.825217 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8586852-7e79-4039-a32b-2ec9d58da25e None admin] RBAC: Authorizing `identity:get_user(user_id=22ca99c68fe847d38726a57e8c6f3b41)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:11.828296 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8586852-7e79-4039-a32b-2ec9d58da25e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:11.832709 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 153/307] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:11 2022] GET /identity/v3/users/22ca99c68fe847d38726a57e8c6f3b41 => generated 297 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:11.847062 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e54b5-2334-4f75-9e70-3d418225e550 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:11.928608 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8586852-7e79-4039-a32b-2ec9d58da25e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:12.042078 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e54b5-2334-4f75-9e70-3d418225e550 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:12.093966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64714e23-20aa-4e44-8139-5342e707a6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:12.095263 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64714e23-20aa-4e44-8139-5342e707a6fa None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:12.095541 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64714e23-20aa-4e44-8139-5342e707a6fa None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:12.095810 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64714e23-20aa-4e44-8139-5342e707a6fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:12.129345 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8586852-7e79-4039-a32b-2ec9d58da25e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:12.157900 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:12.183127 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64714e23-20aa-4e44-8139-5342e707a6fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:12.184664 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64714e23-20aa-4e44-8139-5342e707a6fa None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:12.184876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5363c-9d93-4962-a1fb-ff2b13040ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:12.185971 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5363c-9d93-4962-a1fb-ff2b13040ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:12.186465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5363c-9d93-4962-a1fb-ff2b13040ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:12.186944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5363c-9d93-4962-a1fb-ff2b13040ef8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:12.189403 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5363c-9d93-4962-a1fb-ff2b13040ef8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:12.190916 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5363c-9d93-4962-a1fb-ff2b13040ef8 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:12.192701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 154/308] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:12.194028 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b1e72-0823-45ba-b9ee-fbddc94cd0e7 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:12.194457 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b1e72-0823-45ba-b9ee-fbddc94cd0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:12.194735 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b1e72-0823-45ba-b9ee-fbddc94cd0e7 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:12.196666 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 155/309] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:12.202257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b1e72-0823-45ba-b9ee-fbddc94cd0e7 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:12.240643 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:12.394691 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b1e72-0823-45ba-b9ee-fbddc94cd0e7 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:12.403129 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 155/310] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:12.403129 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5896f-b6f9-4a78-bf9a-28629ee424a0 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:12.403129 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5896f-b6f9-4a78-bf9a-28629ee424a0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:12.403129 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5896f-b6f9-4a78-bf9a-28629ee424a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:12.432784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4cb5896f-b6f9-4a78-bf9a-28629ee424a0 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:12.435195 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4cb5896f-b6f9-4a78-bf9a-28629ee424a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:12.448867 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0440a-8ffa-4bb9-b296-85bfc69c98c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:12.449496 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0440a-8ffa-4bb9-b296-85bfc69c98c6 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:12.449768 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0440a-8ffa-4bb9-b296-85bfc69c98c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:12.450041 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0440a-8ffa-4bb9-b296-85bfc69c98c6 None admin] PATH_INFO: `/v3/groups` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:12.450700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0440a-8ffa-4bb9-b296-85bfc69c98c6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:12.452211 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0440a-8ffa-4bb9-b296-85bfc69c98c6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:12.475740 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 156/311] 10.222.0.52 () {60 vars in 1134 bytes} [Thu Sep 1 16:19:12 2022] POST /identity/v3/groups => generated 229 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:19:12.476451 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0440a-8ffa-4bb9-b296-85bfc69c98c6 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:12.598371 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:12.617660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 156/312] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:12.651705 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0440a-8ffa-4bb9-b296-85bfc69c98c6 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:12.722480 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b3e69-cc1c-432e-8a4c-d145d9da2a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:12.724101 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b3e69-cc1c-432e-8a4c-d145d9da2a67 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:12.724920 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b3e69-cc1c-432e-8a4c-d145d9da2a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:12.725680 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b3e69-cc1c-432e-8a4c-d145d9da2a67 None admin] PATH_INFO: `/v3/projects/4adbce25e8e4487caa00d740c3b88473` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:12.728194 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b3e69-cc1c-432e-8a4c-d145d9da2a67 None admin] RBAC: Authorizing `identity:get_project(project_id=4adbce25e8e4487caa00d740c3b88473)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:12.731386 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b3e69-cc1c-432e-8a4c-d145d9da2a67 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:12.735563 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 157/313] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:12 2022] GET /identity/v3/projects/4adbce25e8e4487caa00d740c3b88473 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:12.745649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5896f-b6f9-4a78-bf9a-28629ee424a0 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:12.769932 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:12.915300 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b3e69-cc1c-432e-8a4c-d145d9da2a67 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:12.967461 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5896f-b6f9-4a78-bf9a-28629ee424a0 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:13.033408 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c69bcd-b5f7-43dd-a555-252782641873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:13.035322 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c69bcd-b5f7-43dd-a555-252782641873 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:13.035790 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c69bcd-b5f7-43dd-a555-252782641873 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:13.036275 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c69bcd-b5f7-43dd-a555-252782641873 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:13.037260 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c69bcd-b5f7-43dd-a555-252782641873 None admin] RBAC: Adding query filter params (role.id=2b507beec2294bd293287825491de4bc, scope.project.id=4adbce25e8e4487caa00d740c3b88473, user.id=22ca99c68fe847d38726a57e8c6f3b41) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:13.037758 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c69bcd-b5f7-43dd-a555-252782641873 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:13.039445 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c69bcd-b5f7-43dd-a555-252782641873 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:13.049059 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 157/314] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:12 2022] GET /identity/v3/role_assignments?user.id=22ca99c68fe847d38726a57e8c6f3b41&scope.project.id=4adbce25e8e4487caa00d740c3b88473&role.id=2b507beec2294bd293287825491de4bc => generated 608 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:13.089294 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b3e69-cc1c-432e-8a4c-d145d9da2a67 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:13.133093 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ae917-4490-49cf-8f07-80df5900aca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:13.134194 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ae917-4490-49cf-8f07-80df5900aca1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:13.134703 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ae917-4490-49cf-8f07-80df5900aca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:13.135189 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ae917-4490-49cf-8f07-80df5900aca1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:13.149407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ae917-4490-49cf-8f07-80df5900aca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:13.155486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-e28ae917-4490-49cf-8f07-80df5900aca1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:19:13.155486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:13.155486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:13.155486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:13.155486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:13.155486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:13.155486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:13.155486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:13.155486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:13.155486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:13.155486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:13.155486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:13.155486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:13.155486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:13.155486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:13.155486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:13.156482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:13.156482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:13.156482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:13.156482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:13.156482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:13.156482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:13.156482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:13.156482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:13.156482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:13.156482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:13.156482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:13.156482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:13.156482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:13.156482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:13.156482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:13.156482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:13.157878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:13.157878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:13.157878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:13.157878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:13.157878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:13.157878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:13.157878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:13.157878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:13.157878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:13.157878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:13.157878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:19:13.157878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:13.165162 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 158/315] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:13.167653 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c69bcd-b5f7-43dd-a555-252782641873 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:13.277489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:13.317353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c69bcd-b5f7-43dd-a555-252782641873 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:13.364075 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75d5b8-3ff2-46db-a6f9-dea48bb8fa35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:13.365183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75d5b8-3ff2-46db-a6f9-dea48bb8fa35 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:13.365679 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75d5b8-3ff2-46db-a6f9-dea48bb8fa35 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:13.366223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75d5b8-3ff2-46db-a6f9-dea48bb8fa35 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:13.367208 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75d5b8-3ff2-46db-a6f9-dea48bb8fa35 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:13.367737 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75d5b8-3ff2-46db-a6f9-dea48bb8fa35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:13.369428 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75d5b8-3ff2-46db-a6f9-dea48bb8fa35 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:13.384807 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 158/316] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:13.388265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ae917-4490-49cf-8f07-80df5900aca1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:13.392658 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:13.536873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ae917-4490-49cf-8f07-80df5900aca1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:13.601445 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701dad5-29af-458d-a94f-4e9986e1bc8c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:13.601746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701dad5-29af-458d-a94f-4e9986e1bc8c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:13.602020 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701dad5-29af-458d-a94f-4e9986e1bc8c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:13.603404 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 159/317] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:19:13.606570 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede85bc-1a7e-49cd-a29d-1b9ffb65bda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:13.607665 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede85bc-1a7e-49cd-a29d-1b9ffb65bda2 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:13.608169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede85bc-1a7e-49cd-a29d-1b9ffb65bda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:13.608695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede85bc-1a7e-49cd-a29d-1b9ffb65bda2 None admin] PATH_INFO: `/v3/users/0908db8fb0e345ba918ecbf7da1c1758` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:13.609487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fb157-dc59-49fa-a041-6a648ef12723 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:13.609754 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fb157-dc59-49fa-a041-6a648ef12723 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:13.610720 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fb157-dc59-49fa-a041-6a648ef12723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:13.631476 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-082fb157-dc59-49fa-a041-6a648ef12723 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:13.632756 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-082fb157-dc59-49fa-a041-6a648ef12723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:13.639336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede85bc-1a7e-49cd-a29d-1b9ffb65bda2 None admin] RBAC: Authorizing `identity:get_user(user_id=0908db8fb0e345ba918ecbf7da1c1758)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:13.641824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede85bc-1a7e-49cd-a29d-1b9ffb65bda2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:13.645319 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 159/318] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:13 2022] GET /identity/v3/users/0908db8fb0e345ba918ecbf7da1c1758 => generated 293 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:13.651977 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede85bc-1a7e-49cd-a29d-1b9ffb65bda2 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:13.740221 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 160/319] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:13.770729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:13.829275 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede85bc-1a7e-49cd-a29d-1b9ffb65bda2 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:13.872920 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdf999-26a9-4930-83da-222c80a1739a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:13.873912 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdf999-26a9-4930-83da-222c80a1739a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:13.874385 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdf999-26a9-4930-83da-222c80a1739a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:13.874865 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdf999-26a9-4930-83da-222c80a1739a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:13.876355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bdf999-26a9-4930-83da-222c80a1739a None admin] RBAC: Adding query filter params (role.id=2b507beec2294bd293287825491de4bc, user.id=0908db8fb0e345ba918ecbf7da1c1758, scope.system=all) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:13.876917 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bdf999-26a9-4930-83da-222c80a1739a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:13.878604 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bdf999-26a9-4930-83da-222c80a1739a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:13.888863 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 160/320] 10.222.0.52 () {56 vars in 1308 bytes} [Thu Sep 1 16:19:13 2022] GET /identity/v3/role_assignments?user.id=0908db8fb0e345ba918ecbf7da1c1758&scope.system=all&role.id=2b507beec2294bd293287825491de4bc => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:14.025398 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082fb157-dc59-49fa-a041-6a648ef12723 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:14.116560 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:14.161027 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082fb157-dc59-49fa-a041-6a648ef12723 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:14.206465 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d40fe8-971b-4ed3-8fbf-6da43522eca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:14.207291 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d40fe8-971b-4ed3-8fbf-6da43522eca1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:14.207697 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d40fe8-971b-4ed3-8fbf-6da43522eca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:14.208100 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d40fe8-971b-4ed3-8fbf-6da43522eca1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:14.221626 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d40fe8-971b-4ed3-8fbf-6da43522eca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:14.226939 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-49d40fe8-971b-4ed3-8fbf-6da43522eca1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:14.226939 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:14.226939 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:14.226939 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:14.226939 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:14.226939 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:14.226939 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:14.226939 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:14.226939 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:14.226939 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:14.226939 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:14.226939 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:14.226939 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:14.226939 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:14.226939 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:14.226939 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:14.232722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:14.232722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:14.232722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:14.232722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:14.232722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:14.232722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:14.232722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:14.232722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:14.232722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:14.232722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:14.232722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:14.232722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:14.232722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:14.232722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:14.232722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:14.232722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:14.234643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:14.234643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:14.234643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:14.234643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:14.234643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:14.234643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:14.234643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:14.234643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:14.234643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:14.234643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:14.234643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:14.234643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:14.234643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 161/321] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:14.237375 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdf999-26a9-4930-83da-222c80a1739a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:14.362994 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdf999-26a9-4930-83da-222c80a1739a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:14.395724 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:14.409790 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc7d20-0a51-4853-afaf-46dc25d3cfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:14.410409 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc7d20-0a51-4853-afaf-46dc25d3cfa7 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:14.410684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc7d20-0a51-4853-afaf-46dc25d3cfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:14.410948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc7d20-0a51-4853-afaf-46dc25d3cfa7 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:14.411634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc7d20-0a51-4853-afaf-46dc25d3cfa7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:14.411929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc7d20-0a51-4853-afaf-46dc25d3cfa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:14.413399 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc7d20-0a51-4853-afaf-46dc25d3cfa7 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:14.423697 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 161/322] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:14.429901 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d40fe8-971b-4ed3-8fbf-6da43522eca1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:14.640832 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d40fe8-971b-4ed3-8fbf-6da43522eca1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:14.692838 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:14.710281 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1710f-5b9e-4747-9ebf-a39a2f836106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:14.711343 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1710f-5b9e-4747-9ebf-a39a2f836106 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:14.711834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1710f-5b9e-4747-9ebf-a39a2f836106 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:14.712238 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1710f-5b9e-4747-9ebf-a39a2f836106 None admin] PATH_INFO: `/v3/users/37325220b21c4d64b4d538c3cd240792` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:14.714457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1710f-5b9e-4747-9ebf-a39a2f836106 None admin] RBAC: Authorizing `identity:get_user(user_id=37325220b21c4d64b4d538c3cd240792)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:14.717285 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1710f-5b9e-4747-9ebf-a39a2f836106 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:14.721086 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 162/323] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:14 2022] GET /identity/v3/users/37325220b21c4d64b4d538c3cd240792 => generated 293 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:14.730695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc7d20-0a51-4853-afaf-46dc25d3cfa7 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:14.934028 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc7d20-0a51-4853-afaf-46dc25d3cfa7 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:14.987241 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f2a0a-b047-470e-a207-1147c78737c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:14.987791 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f2a0a-b047-470e-a207-1147c78737c7 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:14.988177 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f2a0a-b047-470e-a207-1147c78737c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:14.988451 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f2a0a-b047-470e-a207-1147c78737c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:14.989264 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f2a0a-b047-470e-a207-1147c78737c7 None admin] RBAC: Adding query filter params (role.id=76a38a2307da45bcb511ef106076613d, user.id=37325220b21c4d64b4d538c3cd240792, scope.system=all) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:14.989572 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f2a0a-b047-470e-a207-1147c78737c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:14.991058 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f2a0a-b047-470e-a207-1147c78737c7 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:15.005955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 162/324] 10.222.0.52 () {56 vars in 1308 bytes} [Thu Sep 1 16:19:14 2022] GET /identity/v3/role_assignments?user.id=37325220b21c4d64b4d538c3cd240792&scope.system=all&role.id=76a38a2307da45bcb511ef106076613d => generated 510 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:15.077795 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2e96e-b00f-4136-992c-8499b5794de5 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:15.078133 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2e96e-b00f-4136-992c-8499b5794de5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:15.078351 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2e96e-b00f-4136-992c-8499b5794de5 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:15.080368 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 163/325] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:15.086154 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bb4ac-3cd1-4e26-b08c-177d46a96c0c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:15.086656 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bb4ac-3cd1-4e26-b08c-177d46a96c0c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:15.086966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bb4ac-3cd1-4e26-b08c-177d46a96c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:15.107705 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-492bb4ac-3cd1-4e26-b08c-177d46a96c0c None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:15.108990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-492bb4ac-3cd1-4e26-b08c-177d46a96c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:15.165706 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:15.220170 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 163/326] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:15.496918 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2e96e-b00f-4136-992c-8499b5794de5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:15.626794 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2e96e-b00f-4136-992c-8499b5794de5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:15.675631 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e22641-ea94-4ec6-954f-6130a5f70cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:15.676683 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e22641-ea94-4ec6-954f-6130a5f70cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:15.677067 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e22641-ea94-4ec6-954f-6130a5f70cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:15.677434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e22641-ea94-4ec6-954f-6130a5f70cc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:15.678832 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e22641-ea94-4ec6-954f-6130a5f70cc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:15.680446 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e22641-ea94-4ec6-954f-6130a5f70cc5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:15.682266 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 164/327] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:15.689525 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bb4ac-3cd1-4e26-b08c-177d46a96c0c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:15.827186 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bb4ac-3cd1-4e26-b08c-177d46a96c0c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:15.871445 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad397c5-d627-411a-97e5-1e5efdb0032e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:15.872073 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad397c5-d627-411a-97e5-1e5efdb0032e None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:15.872355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad397c5-d627-411a-97e5-1e5efdb0032e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:15.872667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad397c5-d627-411a-97e5-1e5efdb0032e None admin] PATH_INFO: `/v3/groups` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:15.873306 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad397c5-d627-411a-97e5-1e5efdb0032e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:15.874798 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad397c5-d627-411a-97e5-1e5efdb0032e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:15.894525 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 164/328] 10.222.0.52 () {60 vars in 1134 bytes} [Thu Sep 1 16:19:15 2022] POST /identity/v3/groups => generated 226 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:19:16.123181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b59fb-ce2a-42c6-b3cf-92bc72091bcf None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:16.123400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b59fb-ce2a-42c6-b3cf-92bc72091bcf None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:16.123638 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b59fb-ce2a-42c6-b3cf-92bc72091bcf None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:16.125069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 165/329] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:16.132067 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad367d4-17a2-40c8-a00d-b72194ca11b6 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:16.132475 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad367d4-17a2-40c8-a00d-b72194ca11b6 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:16.132905 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad367d4-17a2-40c8-a00d-b72194ca11b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:16.154393 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-aad367d4-17a2-40c8-a00d-b72194ca11b6 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:16.155632 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-aad367d4-17a2-40c8-a00d-b72194ca11b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:16.203488 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:16.272150 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 165/330] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:16.560332 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b59fb-ce2a-42c6-b3cf-92bc72091bcf None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:16.662021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:16.740094 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b59fb-ce2a-42c6-b3cf-92bc72091bcf None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:16.793815 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ea97b-9646-4fc7-ae9f-9a8045277259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:16.795431 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ea97b-9646-4fc7-ae9f-9a8045277259 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:16.796225 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ea97b-9646-4fc7-ae9f-9a8045277259 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:16.796957 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ea97b-9646-4fc7-ae9f-9a8045277259 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:16.830277 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ea97b-9646-4fc7-ae9f-9a8045277259 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:16.840762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-354ea97b-9646-4fc7-ae9f-9a8045277259 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:19:16.840762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:16.840762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:16.840762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:16.840762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:16.840762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:16.840762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:16.840762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:16.840762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:16.840762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:16.840762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:16.840762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:16.840762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:16.840762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:16.840762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:16.840762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:16.842521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:16.842521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:16.842521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:16.842521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:16.842521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:16.842521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:16.842521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:16.842521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:16.842521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:16.842521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:16.842521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:16.842521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:16.842521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:16.842521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:16.842521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:16.842521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:16.844030 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:16.844030 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:16.844030 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:16.844030 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:16.844030 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:16.844030 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:16.844030 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:16.844030 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:16.844030 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:16.844030 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:16.844030 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:19:16.844030 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:16.849919 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 166/331] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:16.862389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad367d4-17a2-40c8-a00d-b72194ca11b6 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:17.101047 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad367d4-17a2-40c8-a00d-b72194ca11b6 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:17.180482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb08cf7-6acf-494d-bff6-df268806e9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:17.182158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb08cf7-6acf-494d-bff6-df268806e9dd None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:17.182967 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb08cf7-6acf-494d-bff6-df268806e9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:17.183759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb08cf7-6acf-494d-bff6-df268806e9dd None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:17.185805 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb08cf7-6acf-494d-bff6-df268806e9dd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:17.186734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb08cf7-6acf-494d-bff6-df268806e9dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:17.190499 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb08cf7-6acf-494d-bff6-df268806e9dd None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:17.209654 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 166/332] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:17.218248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ea97b-9646-4fc7-ae9f-9a8045277259 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:17.376167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ea97b-9646-4fc7-ae9f-9a8045277259 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:17.405374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:17.420875 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761e9cb-84f8-4df6-aae3-63b6bc6616ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:17.421932 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761e9cb-84f8-4df6-aae3-63b6bc6616ed None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:17.422476 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761e9cb-84f8-4df6-aae3-63b6bc6616ed None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:17.422954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761e9cb-84f8-4df6-aae3-63b6bc6616ed None admin] PATH_INFO: `/v3/users/0908db8fb0e345ba918ecbf7da1c1758` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:17.424481 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761e9cb-84f8-4df6-aae3-63b6bc6616ed None admin] RBAC: Authorizing `identity:get_user(user_id=0908db8fb0e345ba918ecbf7da1c1758)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:17.426664 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761e9cb-84f8-4df6-aae3-63b6bc6616ed None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:17.429120 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 167/333] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:17 2022] GET /identity/v3/users/0908db8fb0e345ba918ecbf7da1c1758 => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:17.439692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb08cf7-6acf-494d-bff6-df268806e9dd None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:17.514034 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:17.661945 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb08cf7-6acf-494d-bff6-df268806e9dd None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:17.734495 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265abaa9-dcca-489a-af4e-f56d7a5d87e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:17.736209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265abaa9-dcca-489a-af4e-f56d7a5d87e6 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:17.736707 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265abaa9-dcca-489a-af4e-f56d7a5d87e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:17.737165 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265abaa9-dcca-489a-af4e-f56d7a5d87e6 None admin] PATH_INFO: `/v3/system/users/0908db8fb0e345ba918ecbf7da1c1758/roles/2b507beec2294bd293287825491de4bc` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:17.742094 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265abaa9-dcca-489a-af4e-f56d7a5d87e6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0908db8fb0e345ba918ecbf7da1c1758, role_id=2b507beec2294bd293287825491de4bc)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:17.744863 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265abaa9-dcca-489a-af4e-f56d7a5d87e6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:17.763620 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 167/334] 10.222.0.52 () {58 vars in 1334 bytes} [Thu Sep 1 16:19:17 2022] PUT /identity/v3/system/users/0908db8fb0e345ba918ecbf7da1c1758/roles/2b507beec2294bd293287825491de4bc => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:19:19.011561 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf262ce-9405-4da3-8648-db6a94a39d0b None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:19.013198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf262ce-9405-4da3-8648-db6a94a39d0b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:19.013999 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf262ce-9405-4da3-8648-db6a94a39d0b None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:19.017632 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 168/335] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:19.024645 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ead12-5657-4821-b2c5-35b115b3c4f7 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:19.025394 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ead12-5657-4821-b2c5-35b115b3c4f7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:19.025634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ead12-5657-4821-b2c5-35b115b3c4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:19.066189 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-bc8ead12-5657-4821-b2c5-35b115b3c4f7 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:19.073034 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-bc8ead12-5657-4821-b2c5-35b115b3c4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:19.236348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 168/336] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:19.506878 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e828c2-10b4-4ea6-a497-9285cc4bebc5 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:19.507595 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e828c2-10b4-4ea6-a497-9285cc4bebc5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:19.508135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e828c2-10b4-4ea6-a497-9285cc4bebc5 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:19.510454 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 169/337] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:19:19.518528 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d8109-4612-48d7-a627-5a4f33dfb41b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:19.519191 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d8109-4612-48d7-a627-5a4f33dfb41b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:19.519734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d8109-4612-48d7-a627-5a4f33dfb41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:19.545866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-313d8109-4612-48d7-a627-5a4f33dfb41b None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:19.547646 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-313d8109-4612-48d7-a627-5a4f33dfb41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:19.567070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:19.643237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 169/338] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:20.150723 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e828c2-10b4-4ea6-a497-9285cc4bebc5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:20.300844 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e828c2-10b4-4ea6-a497-9285cc4bebc5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:20.352561 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276ee13-197c-4220-b864-d7207f80ac90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:20.353640 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276ee13-197c-4220-b864-d7207f80ac90 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:20.354121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276ee13-197c-4220-b864-d7207f80ac90 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:20.354623 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276ee13-197c-4220-b864-d7207f80ac90 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:20.372823 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276ee13-197c-4220-b864-d7207f80ac90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:20.378951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-3276ee13-197c-4220-b864-d7207f80ac90 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:20.378951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:20.378951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:20.378951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:20.378951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:20.378951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:20.378951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:20.378951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:20.378951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:20.378951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:20.378951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:20.378951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:20.378951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:20.378951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:20.378951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:20.378951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:20.379888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:20.379888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:20.379888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:20.379888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:20.379888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:20.379888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:20.379888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:20.379888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:20.379888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:20.379888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:20.379888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:20.379888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:20.379888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:20.379888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:20.379888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:20.379888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:20.380716 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:20.380716 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:20.380716 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:20.380716 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:20.380716 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:20.380716 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:20.380716 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:20.380716 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:20.380716 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:20.380716 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:20.380716 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:20.380716 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:20.383148 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 170/339] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 1 16:19:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:19:20.390320 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d8109-4612-48d7-a627-5a4f33dfb41b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:20.432605 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd8774-7ba0-4230-9fdf-1e74a6cc374c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:20.433308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd8774-7ba0-4230-9fdf-1e74a6cc374c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:20.433639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd8774-7ba0-4230-9fdf-1e74a6cc374c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:20.435529 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 171/340] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:20.461664 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d69cc-49b7-4a91-8b14-02ce72d8199f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:20.461973 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d69cc-49b7-4a91-8b14-02ce72d8199f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:20.462381 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d69cc-49b7-4a91-8b14-02ce72d8199f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:20.488485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-221d69cc-49b7-4a91-8b14-02ce72d8199f None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:20.489895 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-221d69cc-49b7-4a91-8b14-02ce72d8199f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:20.623145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:20.655312 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d8109-4612-48d7-a627-5a4f33dfb41b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:20.699932 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 172/341] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 01 16:19:20.701577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d69cc-49b7-4a91-8b14-02ce72d8199f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:20.707543 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74141ed-2f4f-4fd7-952c-02ae0b5eadf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:20.708180 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74141ed-2f4f-4fd7-952c-02ae0b5eadf0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:20.708462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74141ed-2f4f-4fd7-952c-02ae0b5eadf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:20.708818 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74141ed-2f4f-4fd7-952c-02ae0b5eadf0 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:20.709563 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74141ed-2f4f-4fd7-952c-02ae0b5eadf0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:20.709866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74141ed-2f4f-4fd7-952c-02ae0b5eadf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:20.711312 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74141ed-2f4f-4fd7-952c-02ae0b5eadf0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:20.731478 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 170/342] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:20.740578 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74141ed-2f4f-4fd7-952c-02ae0b5eadf0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:20.763414 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:20.872281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74141ed-2f4f-4fd7-952c-02ae0b5eadf0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:20.920461 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea9a66-8094-4dca-916a-478080db7292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:20.921028 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea9a66-8094-4dca-916a-478080db7292 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:20.921310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea9a66-8094-4dca-916a-478080db7292 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:20.921574 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea9a66-8094-4dca-916a-478080db7292 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:21.004052 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d69cc-49b7-4a91-8b14-02ce72d8199f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:21.009615 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea9a66-8094-4dca-916a-478080db7292 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:21.011135 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea9a66-8094-4dca-916a-478080db7292 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:21.028030 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:21.126760 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962e07f-375b-4e1d-a98c-9809af36ab0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:21.127898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962e07f-375b-4e1d-a98c-9809af36ab0c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:21.128374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962e07f-375b-4e1d-a98c-9809af36ab0c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:21.128875 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962e07f-375b-4e1d-a98c-9809af36ab0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:21.143890 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 171/343] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:21.162469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea9a66-8094-4dca-916a-478080db7292 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:21.165720 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962e07f-375b-4e1d-a98c-9809af36ab0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:21.177621 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-e962e07f-375b-4e1d-a98c-9809af36ab0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:21.177621 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:21.177621 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:21.177621 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:21.177621 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:21.177621 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:21.177621 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:21.177621 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:21.177621 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:21.177621 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:21.177621 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:21.177621 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:21.177621 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:21.177621 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:21.177621 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:21.177621 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:21.178659 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:21.178659 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:21.178659 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:21.178659 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:21.178659 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:21.178659 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:21.178659 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:21.178659 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:21.178659 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:21.178659 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:21.178659 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:21.178659 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:21.178659 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:21.178659 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:21.178659 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:21.178659 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:21.179549 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:21.179549 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:21.179549 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:21.179549 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:21.179549 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:21.179549 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:21.179549 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:21.179549 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:21.179549 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:21.179549 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:21.179549 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:21.179549 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:21.179549 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 173/344] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 479 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:21.188593 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962e07f-375b-4e1d-a98c-9809af36ab0c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:21.323854 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:21.325541 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea9a66-8094-4dca-916a-478080db7292 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:21.347313 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:21.383068 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485f727-43bc-403a-b26f-0e35b039d9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:21.384029 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485f727-43bc-403a-b26f-0e35b039d9d9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:21.384461 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485f727-43bc-403a-b26f-0e35b039d9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:21.384916 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485f727-43bc-403a-b26f-0e35b039d9d9 None admin] PATH_INFO: `/v3/projects/c6ec2c26955d46c3a767d88695f36411` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:21.387203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485f727-43bc-403a-b26f-0e35b039d9d9 None admin] RBAC: Authorizing `identity:get_project(project_id=c6ec2c26955d46c3a767d88695f36411)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:21.388899 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485f727-43bc-403a-b26f-0e35b039d9d9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:21.392173 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 172/345] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:21 2022] GET /identity/v3/projects/c6ec2c26955d46c3a767d88695f36411 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:21.401517 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485f727-43bc-403a-b26f-0e35b039d9d9 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:21.508329 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962e07f-375b-4e1d-a98c-9809af36ab0c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:21.595181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88a0af-2ee1-411e-a086-d8aaba3e8051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:21.596071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88a0af-2ee1-411e-a086-d8aaba3e8051 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:21.596529 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88a0af-2ee1-411e-a086-d8aaba3e8051 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:21.596970 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88a0af-2ee1-411e-a086-d8aaba3e8051 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:21.597833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88a0af-2ee1-411e-a086-d8aaba3e8051 None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:21.598291 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88a0af-2ee1-411e-a086-d8aaba3e8051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:21.599876 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88a0af-2ee1-411e-a086-d8aaba3e8051 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:21.622425 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 174/346] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:21.623751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88a0af-2ee1-411e-a086-d8aaba3e8051 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:21.644521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485f727-43bc-403a-b26f-0e35b039d9d9 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:21.699179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6b91d-06a3-4417-a0d5-07b81443af6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:21.700450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6b91d-06a3-4417-a0d5-07b81443af6b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:21.701109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6b91d-06a3-4417-a0d5-07b81443af6b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:21.701543 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6b91d-06a3-4417-a0d5-07b81443af6b None admin] PATH_INFO: `/v3/groups/f8d5e262d5f44cabacb5a22407a74168` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:21.713242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6b91d-06a3-4417-a0d5-07b81443af6b None admin] RBAC: Authorizing `identity:get_group(group_id=f8d5e262d5f44cabacb5a22407a74168)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:21.715458 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6b91d-06a3-4417-a0d5-07b81443af6b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:21.717731 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 173/347] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:21 2022] GET /identity/v3/groups/f8d5e262d5f44cabacb5a22407a74168 => generated 226 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:21.718770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6b91d-06a3-4417-a0d5-07b81443af6b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:21.820418 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:21.874837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88a0af-2ee1-411e-a086-d8aaba3e8051 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:21.878550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:21.951062 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534904e2-f7b6-4f7a-b053-e5bc4abe55f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:21.952096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534904e2-f7b6-4f7a-b053-e5bc4abe55f3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:21.952540 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534904e2-f7b6-4f7a-b053-e5bc4abe55f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:21.953027 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534904e2-f7b6-4f7a-b053-e5bc4abe55f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:21.955805 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6b91d-06a3-4417-a0d5-07b81443af6b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:21.974266 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534904e2-f7b6-4f7a-b053-e5bc4abe55f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:21.984234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-534904e2-f7b6-4f7a-b053-e5bc4abe55f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:21.984234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:21.984234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:21.984234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:21.984234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:21.984234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:21.984234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:21.984234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:21.984234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:21.984234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:21.984234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:21.984234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:21.984234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:21.984234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:21.984234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:21.984234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:21.985273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:21.985273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:21.985273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:21.985273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:21.985273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:21.985273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:21.985273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:21.985273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:21.985273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:21.985273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:21.985273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:21.985273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:21.985273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:21.985273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:21.985273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:21.985273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:21.986078 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:21.986078 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:21.986078 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:21.986078 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:21.986078 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:21.986078 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:21.986078 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:21.986078 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:21.986078 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:21.986078 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:21.986078 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:21.986078 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:21.986693 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 175/348] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:21.988924 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534904e2-f7b6-4f7a-b053-e5bc4abe55f3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:22.023489 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ceb594-bae7-4298-9050-8b76b8992109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:22.024336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ceb594-bae7-4298-9050-8b76b8992109 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:22.024499 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ceb594-bae7-4298-9050-8b76b8992109 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:22.024997 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ceb594-bae7-4298-9050-8b76b8992109 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:22.151093 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ceb594-bae7-4298-9050-8b76b8992109 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:22.151093 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ceb594-bae7-4298-9050-8b76b8992109 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:22.205528 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534904e2-f7b6-4f7a-b053-e5bc4abe55f3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:22.229080 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:22.264481 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187221e4-18c8-4f4b-a1e7-3d0612c3b4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:22.265441 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187221e4-18c8-4f4b-a1e7-3d0612c3b4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:22.265932 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187221e4-18c8-4f4b-a1e7-3d0612c3b4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:22.266878 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187221e4-18c8-4f4b-a1e7-3d0612c3b4e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:22.267818 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187221e4-18c8-4f4b-a1e7-3d0612c3b4e5 None admin] RBAC: Adding query filter params (group.id=f8d5e262d5f44cabacb5a22407a74168, role.id=f889b15cab8c46f58be00f84143aac60, scope.project.id=c6ec2c26955d46c3a767d88695f36411) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:22.268125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187221e4-18c8-4f4b-a1e7-3d0612c3b4e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:22.269850 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187221e4-18c8-4f4b-a1e7-3d0612c3b4e5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:22.277438 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 176/349] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Sep 1 16:19:21 2022] GET /identity/v3/role_assignments?group.id=f8d5e262d5f44cabacb5a22407a74168&scope.project.id=c6ec2c26955d46c3a767d88695f36411&role.id=f889b15cab8c46f58be00f84143aac60 => generated 260 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:22.279082 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37940c-bd4d-44a6-9292-3e228166451f None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:22.279659 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37940c-bd4d-44a6-9292-3e228166451f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:22.280114 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37940c-bd4d-44a6-9292-3e228166451f None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:22.282710 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 177/350] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:22.284223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f90aa-9e51-4333-b170-644cc478b58b None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:22.284814 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f90aa-9e51-4333-b170-644cc478b58b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:22.285258 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f90aa-9e51-4333-b170-644cc478b58b None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:22.291605 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 178/351] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:22.292984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f90aa-9e51-4333-b170-644cc478b58b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:22.335892 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:22.375078 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 174/352] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:22.377465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563796a-a1c1-49d4-a358-921318f245bc None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:22.378040 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563796a-a1c1-49d4-a358-921318f245bc None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:22.378610 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563796a-a1c1-49d4-a358-921318f245bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:22.403037 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9563796a-a1c1-49d4-a358-921318f245bc None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:22.405212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9563796a-a1c1-49d4-a358-921318f245bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:22.516596 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f90aa-9e51-4333-b170-644cc478b58b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:22.538287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 175/353] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:22.540932 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d243f81-aff9-4cab-96d1-066b92f2f574 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:22.541514 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d243f81-aff9-4cab-96d1-066b92f2f574 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:22.541943 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d243f81-aff9-4cab-96d1-066b92f2f574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:22.567243 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5d243f81-aff9-4cab-96d1-066b92f2f574 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:22.568763 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5d243f81-aff9-4cab-96d1-066b92f2f574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:22.569544 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168239a5-aec3-47bf-a0f6-1ae20d3be2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:22.570464 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168239a5-aec3-47bf-a0f6-1ae20d3be2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:22.570953 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168239a5-aec3-47bf-a0f6-1ae20d3be2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:22.571444 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168239a5-aec3-47bf-a0f6-1ae20d3be2c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:22.572347 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168239a5-aec3-47bf-a0f6-1ae20d3be2c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:22.572923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168239a5-aec3-47bf-a0f6-1ae20d3be2c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:22.574564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168239a5-aec3-47bf-a0f6-1ae20d3be2c0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:22.595833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 179/354] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:22.602558 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168239a5-aec3-47bf-a0f6-1ae20d3be2c0 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:22.661349 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 176/355] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:22.662900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6584c-5500-495b-9d26-42d9ef7cfa39 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:22.663357 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6584c-5500-495b-9d26-42d9ef7cfa39 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:22.663920 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6584c-5500-495b-9d26-42d9ef7cfa39 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:22.666649 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 177/356] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:22.668851 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6584c-5500-495b-9d26-42d9ef7cfa39 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:22.676599 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:22.805141 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6584c-5500-495b-9d26-42d9ef7cfa39 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:22.852661 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbca4f9-1739-498c-ac10-def14058ba37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:22.853540 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbca4f9-1739-498c-ac10-def14058ba37 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:22.853993 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbca4f9-1739-498c-ac10-def14058ba37 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:22.854413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbca4f9-1739-498c-ac10-def14058ba37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:22.913363 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:22.939701 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168239a5-aec3-47bf-a0f6-1ae20d3be2c0 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:22.945792 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbca4f9-1739-498c-ac10-def14058ba37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:22.948805 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbca4f9-1739-498c-ac10-def14058ba37 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:22.961565 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:23.014643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13007d-1111-4b38-b68c-ed0ea1deb555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:23.015748 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13007d-1111-4b38-b68c-ed0ea1deb555 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:23.016824 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13007d-1111-4b38-b68c-ed0ea1deb555 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:23.017297 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13007d-1111-4b38-b68c-ed0ea1deb555 None admin] PATH_INFO: `/v3/projects/c6ec2c26955d46c3a767d88695f36411` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:23.019325 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13007d-1111-4b38-b68c-ed0ea1deb555 None admin] RBAC: Authorizing `identity:get_project(project_id=c6ec2c26955d46c3a767d88695f36411)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:23.021119 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13007d-1111-4b38-b68c-ed0ea1deb555 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:23.023349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 180/357] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:22 2022] GET /identity/v3/projects/c6ec2c26955d46c3a767d88695f36411 => generated 298 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:23.024898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb9e3d-d7aa-4756-808c-4b2cd6d90360 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:23.025519 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb9e3d-d7aa-4756-808c-4b2cd6d90360 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:23.025988 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb9e3d-d7aa-4756-808c-4b2cd6d90360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:23.070495 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f7bb9e3d-d7aa-4756-808c-4b2cd6d90360 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:23.072639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f7bb9e3d-d7aa-4756-808c-4b2cd6d90360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:23.085293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 178/358] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:23.086918 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbca4f9-1739-498c-ac10-def14058ba37 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:23.233428 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbca4f9-1739-498c-ac10-def14058ba37 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:23.238636 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:23.271779 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 181/359] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:23.275163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb9e3d-d7aa-4756-808c-4b2cd6d90360 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:23.288380 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adef5e-1a4f-4d4b-83aa-ad9e1c453e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:23.289441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adef5e-1a4f-4d4b-83aa-ad9e1c453e09 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:23.289927 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adef5e-1a4f-4d4b-83aa-ad9e1c453e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:23.290431 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adef5e-1a4f-4d4b-83aa-ad9e1c453e09 None admin] PATH_INFO: `/v3/groups/f8d5e262d5f44cabacb5a22407a74168` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:23.292017 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adef5e-1a4f-4d4b-83aa-ad9e1c453e09 None admin] RBAC: Authorizing `identity:get_group(group_id=f8d5e262d5f44cabacb5a22407a74168)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:23.293881 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adef5e-1a4f-4d4b-83aa-ad9e1c453e09 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:23.296427 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 179/360] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:23 2022] GET /identity/v3/groups/f8d5e262d5f44cabacb5a22407a74168 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:23.305533 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adef5e-1a4f-4d4b-83aa-ad9e1c453e09 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:23.485661 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:23.511743 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb9e3d-d7aa-4756-808c-4b2cd6d90360 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:23.521250 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adef5e-1a4f-4d4b-83aa-ad9e1c453e09 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:23.576562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc58cb-9ce1-4cbb-95a9-8db9d0406f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:23.577924 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc58cb-9ce1-4cbb-95a9-8db9d0406f8d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:23.579220 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc58cb-9ce1-4cbb-95a9-8db9d0406f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:23.579876 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc58cb-9ce1-4cbb-95a9-8db9d0406f8d None admin] PATH_INFO: `/v3/projects/4adbce25e8e4487caa00d740c3b88473` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:23.582137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc58cb-9ce1-4cbb-95a9-8db9d0406f8d None admin] RBAC: Authorizing `identity:get_project(project_id=4adbce25e8e4487caa00d740c3b88473)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:23.585017 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc58cb-9ce1-4cbb-95a9-8db9d0406f8d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:23.588296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 182/361] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:23 2022] GET /identity/v3/projects/4adbce25e8e4487caa00d740c3b88473 => generated 302 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:23.590127 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc58cb-9ce1-4cbb-95a9-8db9d0406f8d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:23.600240 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade50d4-5f58-4da3-a7af-f8ff9657f696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:23.601307 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade50d4-5f58-4da3-a7af-f8ff9657f696 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:23.601833 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade50d4-5f58-4da3-a7af-f8ff9657f696 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:23.602471 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade50d4-5f58-4da3-a7af-f8ff9657f696 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:23.624306 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade50d4-5f58-4da3-a7af-f8ff9657f696 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:23.635584 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-5ade50d4-5f58-4da3-a7af-f8ff9657f696 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:23.635584 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:23.635584 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:23.635584 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:23.635584 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:23.635584 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:23.635584 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:23.635584 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:23.635584 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:23.635584 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:23.635584 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:23.635584 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:23.635584 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:23.635584 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:23.635584 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:23.635584 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:23.640417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:23.640417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:23.640417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:23.640417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:23.640417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:23.640417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:23.640417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:23.640417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:23.640417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:23.640417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:23.640417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:23.640417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:23.640417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:23.640417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:23.640417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:23.640417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:23.642651 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:23.642651 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:23.642651 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:23.642651 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:23.642651 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:23.642651 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:23.642651 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:23.642651 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:23.642651 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:23.642651 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:23.642651 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:23.642651 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:23.646862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 180/362] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 1 16:19:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:23.648686 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade50d4-5f58-4da3-a7af-f8ff9657f696 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:23.704988 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:23.789947 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc58cb-9ce1-4cbb-95a9-8db9d0406f8d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:23.849489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e64d65-0c4a-4ef0-8d67-33cc0d3298a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:23.850440 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e64d65-0c4a-4ef0-8d67-33cc0d3298a8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:23.850811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e64d65-0c4a-4ef0-8d67-33cc0d3298a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:23.851545 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e64d65-0c4a-4ef0-8d67-33cc0d3298a8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:23.866020 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e64d65-0c4a-4ef0-8d67-33cc0d3298a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:23.867202 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade50d4-5f58-4da3-a7af-f8ff9657f696 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:23.871616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-f9e64d65-0c4a-4ef0-8d67-33cc0d3298a8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:19:23.871616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:23.871616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:23.871616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:23.871616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:23.871616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:23.871616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:23.871616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:23.871616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:23.871616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:23.871616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:23.871616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:23.871616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:23.871616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:23.871616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:23.871616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:23.872569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:23.872569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:23.872569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:23.872569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:23.872569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:23.872569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:23.872569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:23.872569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:23.872569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:23.872569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:23.872569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:23.872569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:23.872569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:23.872569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:23.872569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:23.872569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:23.873389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:23.873389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:23.873389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:23.873389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:23.873389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:23.873389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:23.873389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:23.873389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:23.873389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:23.873389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:23.873389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:19:23.873389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:23.875931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 183/363] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:23.876992 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e64d65-0c4a-4ef0-8d67-33cc0d3298a8 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:23.898167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:23.931373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d207da-f2a5-41f2-ad01-ee259c946fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:23.932006 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d207da-f2a5-41f2-ad01-ee259c946fbe None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:23.932286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d207da-f2a5-41f2-ad01-ee259c946fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:23.932555 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d207da-f2a5-41f2-ad01-ee259c946fbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:23.933344 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d207da-f2a5-41f2-ad01-ee259c946fbe None admin] RBAC: Adding query filter params (group.id=f8d5e262d5f44cabacb5a22407a74168, role.id=76a38a2307da45bcb511ef106076613d, scope.project.id=c6ec2c26955d46c3a767d88695f36411) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:23.933643 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d207da-f2a5-41f2-ad01-ee259c946fbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:23.935316 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d207da-f2a5-41f2-ad01-ee259c946fbe None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:23.944174 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 181/364] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Sep 1 16:19:23 2022] GET /identity/v3/role_assignments?group.id=f8d5e262d5f44cabacb5a22407a74168&scope.project.id=c6ec2c26955d46c3a767d88695f36411&role.id=76a38a2307da45bcb511ef106076613d => generated 260 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:23.946082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d207da-f2a5-41f2-ad01-ee259c946fbe None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:24.038398 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e64d65-0c4a-4ef0-8d67-33cc0d3298a8 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:24.086734 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40145f71-aab7-495c-9b54-b8765594b562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:24.087510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40145f71-aab7-495c-9b54-b8765594b562 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:24.087862 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40145f71-aab7-495c-9b54-b8765594b562 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:24.088896 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40145f71-aab7-495c-9b54-b8765594b562 None admin] PATH_INFO: `/v3/groups/f8d5e262d5f44cabacb5a22407a74168` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:24.090305 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40145f71-aab7-495c-9b54-b8765594b562 None admin] RBAC: Authorizing `identity:get_group(group_id=f8d5e262d5f44cabacb5a22407a74168)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:24.091980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40145f71-aab7-495c-9b54-b8765594b562 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:24.095500 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 184/365] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:23 2022] GET /identity/v3/groups/f8d5e262d5f44cabacb5a22407a74168 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:24.096843 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40145f71-aab7-495c-9b54-b8765594b562 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:24.113182 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d207da-f2a5-41f2-ad01-ee259c946fbe None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:24.117179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:24.177727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e8faf-29ec-4475-8b43-1348b0f80c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:24.178443 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e8faf-29ec-4475-8b43-1348b0f80c16 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:24.178727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e8faf-29ec-4475-8b43-1348b0f80c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:24.179000 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e8faf-29ec-4475-8b43-1348b0f80c16 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:24.179699 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e8faf-29ec-4475-8b43-1348b0f80c16 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:24.180001 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e8faf-29ec-4475-8b43-1348b0f80c16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:24.181735 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e8faf-29ec-4475-8b43-1348b0f80c16 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:24.200454 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 182/366] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:24.200454 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e8faf-29ec-4475-8b43-1348b0f80c16 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:24.270635 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:24.311833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40145f71-aab7-495c-9b54-b8765594b562 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:24.369338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e8faf-29ec-4475-8b43-1348b0f80c16 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:24.372062 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c4fab-8bff-4f6c-9524-f7c7a8fd7c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:24.373725 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c4fab-8bff-4f6c-9524-f7c7a8fd7c0b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:24.374427 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c4fab-8bff-4f6c-9524-f7c7a8fd7c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:24.375095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c4fab-8bff-4f6c-9524-f7c7a8fd7c0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:24.398503 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c4fab-8bff-4f6c-9524-f7c7a8fd7c0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:24.412798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-b81c4fab-8bff-4f6c-9524-f7c7a8fd7c0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:19:24.412798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:24.412798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:24.412798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:24.412798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:24.412798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:24.412798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:24.412798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:24.412798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:24.412798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:24.412798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:24.412798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:24.412798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:24.412798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:24.412798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:24.412798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:24.414800 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:24.414800 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:24.414800 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:24.414800 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:24.414800 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:24.414800 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:24.414800 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:24.414800 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:24.414800 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:24.414800 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:24.414800 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:24.414800 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:24.414800 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:24.414800 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:24.414800 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:24.414800 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:24.416678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:24.416678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:24.416678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:24.416678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:24.416678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:24.416678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:24.416678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:24.416678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:24.416678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:24.416678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:24.416678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:19:24.416678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:24.426519 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 185/367] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:19:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:24.426519 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c4fab-8bff-4f6c-9524-f7c7a8fd7c0b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:24.429639 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462389b-fa7b-4559-a28d-330125c21b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:24.429639 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462389b-fa7b-4559-a28d-330125c21b3f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:24.429639 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462389b-fa7b-4559-a28d-330125c21b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:24.429639 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462389b-fa7b-4559-a28d-330125c21b3f None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:24.430666 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462389b-fa7b-4559-a28d-330125c21b3f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:24.430666 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462389b-fa7b-4559-a28d-330125c21b3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:24.431137 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462389b-fa7b-4559-a28d-330125c21b3f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:24.443020 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 183/368] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:24.443899 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462389b-fa7b-4559-a28d-330125c21b3f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:24.472039 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:24.575658 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462389b-fa7b-4559-a28d-330125c21b3f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:24.619738 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ef042-df4f-4881-9550-07bec3deb261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:24.620414 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ef042-df4f-4881-9550-07bec3deb261 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:24.620733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ef042-df4f-4881-9550-07bec3deb261 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:24.621239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ef042-df4f-4881-9550-07bec3deb261 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:24.661783 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c4fab-8bff-4f6c-9524-f7c7a8fd7c0b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:24.705927 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ef042-df4f-4881-9550-07bec3deb261 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:24.708141 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ef042-df4f-4881-9550-07bec3deb261 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:24.711707 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670dfff1-798d-48bc-ab2a-e5072f024a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:24.712552 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dfff1-798d-48bc-ab2a-e5072f024a29 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:24.714008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dfff1-798d-48bc-ab2a-e5072f024a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:24.714462 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dfff1-798d-48bc-ab2a-e5072f024a29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:24.715360 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670dfff1-798d-48bc-ab2a-e5072f024a29 None admin] RBAC: Adding query filter params (group.id=f8d5e262d5f44cabacb5a22407a74168, role.id=76a38a2307da45bcb511ef106076613d, scope.project.id=4adbce25e8e4487caa00d740c3b88473) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:24.715817 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670dfff1-798d-48bc-ab2a-e5072f024a29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:24.717498 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670dfff1-798d-48bc-ab2a-e5072f024a29 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:24.724508 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 186/369] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Sep 1 16:19:24 2022] GET /identity/v3/role_assignments?group.id=f8d5e262d5f44cabacb5a22407a74168&scope.project.id=4adbce25e8e4487caa00d740c3b88473&role.id=76a38a2307da45bcb511ef106076613d => generated 260 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:24.725751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670dfff1-798d-48bc-ab2a-e5072f024a29 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:24.736082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:24.737602 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:24.846308 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 184/370] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:24.851724 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ef042-df4f-4881-9550-07bec3deb261 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:24.880181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670dfff1-798d-48bc-ab2a-e5072f024a29 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:24.933362 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90456147-f971-4c7b-bcbf-d14c5fcbba34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:24.933929 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90456147-f971-4c7b-bcbf-d14c5fcbba34 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:24.934206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90456147-f971-4c7b-bcbf-d14c5fcbba34 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:24.934476 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90456147-f971-4c7b-bcbf-d14c5fcbba34 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:24.935455 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90456147-f971-4c7b-bcbf-d14c5fcbba34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:24.935455 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90456147-f971-4c7b-bcbf-d14c5fcbba34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:24.937000 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90456147-f971-4c7b-bcbf-d14c5fcbba34 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:24.952795 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 187/371] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:24.954482 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90456147-f971-4c7b-bcbf-d14c5fcbba34 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:24.997783 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ef042-df4f-4881-9550-07bec3deb261 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:25.027338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:25.055976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f1b6a-f98b-470f-ad22-5d5440cd7fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:25.056943 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f1b6a-f98b-470f-ad22-5d5440cd7fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:25.057364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f1b6a-f98b-470f-ad22-5d5440cd7fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:25.057776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f1b6a-f98b-470f-ad22-5d5440cd7fd2 None admin] PATH_INFO: `/v3/users/0908db8fb0e345ba918ecbf7da1c1758` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:25.059275 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f1b6a-f98b-470f-ad22-5d5440cd7fd2 None admin] RBAC: Authorizing `identity:get_user(user_id=0908db8fb0e345ba918ecbf7da1c1758)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:25.060996 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f1b6a-f98b-470f-ad22-5d5440cd7fd2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:25.063623 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 185/372] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:19:24 2022] GET /identity/v3/users/0908db8fb0e345ba918ecbf7da1c1758 => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:25.070209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f1b6a-f98b-470f-ad22-5d5440cd7fd2 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:25.085562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:25.111184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90456147-f971-4c7b-bcbf-d14c5fcbba34 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:25.160793 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2c75a-ac6c-471d-91e9-e5174d78f2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:25.161895 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2c75a-ac6c-471d-91e9-e5174d78f2ab None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:25.162384 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2c75a-ac6c-471d-91e9-e5174d78f2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:25.162854 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2c75a-ac6c-471d-91e9-e5174d78f2ab None admin] PATH_INFO: `/v3/projects/4adbce25e8e4487caa00d740c3b88473` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:25.164457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2c75a-ac6c-471d-91e9-e5174d78f2ab None admin] RBAC: Authorizing `identity:get_project(project_id=4adbce25e8e4487caa00d740c3b88473)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:25.166441 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2c75a-ac6c-471d-91e9-e5174d78f2ab None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:25.173056 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 188/373] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:24 2022] GET /identity/v3/projects/4adbce25e8e4487caa00d740c3b88473 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:25.174388 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2c75a-ac6c-471d-91e9-e5174d78f2ab None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:25.237664 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f1b6a-f98b-470f-ad22-5d5440cd7fd2 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:25.291110 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775ee3b-2172-40e2-8ce9-498d5d5610ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:25.291921 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775ee3b-2172-40e2-8ce9-498d5d5610ae None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:25.292270 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775ee3b-2172-40e2-8ce9-498d5d5610ae None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:25.292555 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775ee3b-2172-40e2-8ce9-498d5d5610ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:25.314488 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2c75a-ac6c-471d-91e9-e5174d78f2ab None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:25.381675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebeeec2-6cd7-4b5d-a6cc-4733924c8410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:25.382111 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebeeec2-6cd7-4b5d-a6cc-4733924c8410 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:25.382263 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebeeec2-6cd7-4b5d-a6cc-4733924c8410 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:25.382550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebeeec2-6cd7-4b5d-a6cc-4733924c8410 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:25.383300 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebeeec2-6cd7-4b5d-a6cc-4733924c8410 None admin] RBAC: Adding query filter params (role.id=2b507beec2294bd293287825491de4bc, user.id=0908db8fb0e345ba918ecbf7da1c1758, scope.system=all) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:25.383611 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebeeec2-6cd7-4b5d-a6cc-4733924c8410 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:25.385471 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebeeec2-6cd7-4b5d-a6cc-4733924c8410 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:25.388140 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:25.399586 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:25.412341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 189/374] 10.222.0.52 () {56 vars in 1308 bytes} [Thu Sep 1 16:19:25 2022] GET /identity/v3/role_assignments?user.id=0908db8fb0e345ba918ecbf7da1c1758&scope.system=all&role.id=2b507beec2294bd293287825491de4bc => generated 510 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:25.412341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebeeec2-6cd7-4b5d-a6cc-4733924c8410 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:25.445552 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775ee3b-2172-40e2-8ce9-498d5d5610ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:25.448819 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775ee3b-2172-40e2-8ce9-498d5d5610ae None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:25.589979 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebeeec2-6cd7-4b5d-a6cc-4733924c8410 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:25.650146 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3267e-07fb-4499-81d8-282dbe75bba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:25.650703 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3267e-07fb-4499-81d8-282dbe75bba6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:25.650972 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3267e-07fb-4499-81d8-282dbe75bba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:25.651244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3267e-07fb-4499-81d8-282dbe75bba6 None admin] PATH_INFO: `/v3/groups/f8d5e262d5f44cabacb5a22407a74168` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:25.653771 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc3267e-07fb-4499-81d8-282dbe75bba6 None admin] RBAC: Authorizing `identity:get_group(group_id=f8d5e262d5f44cabacb5a22407a74168)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:25.655372 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc3267e-07fb-4499-81d8-282dbe75bba6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:25.658083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 190/375] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:25 2022] GET /identity/v3/groups/f8d5e262d5f44cabacb5a22407a74168 => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:25.673851 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3267e-07fb-4499-81d8-282dbe75bba6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:25.706394 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 186/376] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:25.712601 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775ee3b-2172-40e2-8ce9-498d5d5610ae None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:25.846569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:25.912492 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:25.936585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3267e-07fb-4499-81d8-282dbe75bba6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:25.939854 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775ee3b-2172-40e2-8ce9-498d5d5610ae None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:26.015145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74eb6b-e061-4fa7-9086-ca286f82829c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:26.016427 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74eb6b-e061-4fa7-9086-ca286f82829c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:26.016770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240af2d5-ce31-4c45-ada1-ff8d38d2a5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:26.016940 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74eb6b-e061-4fa7-9086-ca286f82829c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:26.017213 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74eb6b-e061-4fa7-9086-ca286f82829c None admin] PATH_INFO: `/v3/projects/3ac22d8b2a234cb4ae28b76d9f5e893d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:26.018598 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74eb6b-e061-4fa7-9086-ca286f82829c None admin] RBAC: Authorizing `identity:get_project(project_id=3ac22d8b2a234cb4ae28b76d9f5e893d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:26.018765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240af2d5-ce31-4c45-ada1-ff8d38d2a5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:26.019532 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240af2d5-ce31-4c45-ada1-ff8d38d2a5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:26.020097 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74eb6b-e061-4fa7-9086-ca286f82829c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:26.020586 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240af2d5-ce31-4c45-ada1-ff8d38d2a5e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:26.022241 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240af2d5-ce31-4c45-ada1-ff8d38d2a5e8 None admin] RBAC: Adding query filter params (group.id=f8d5e262d5f44cabacb5a22407a74168, role.id=f889b15cab8c46f58be00f84143aac60, scope.project.id=4adbce25e8e4487caa00d740c3b88473) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:26.022435 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 187/377] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:25 2022] GET /identity/v3/projects/3ac22d8b2a234cb4ae28b76d9f5e893d => generated 344 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:26.023267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240af2d5-ce31-4c45-ada1-ff8d38d2a5e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:26.023595 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b3d9d-cb28-405c-b8e8-4e1702148bdd None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:26.023853 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b3d9d-cb28-405c-b8e8-4e1702148bdd None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:26.024134 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b3d9d-cb28-405c-b8e8-4e1702148bdd None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:26.025547 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 188/378] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:26.027707 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240af2d5-ce31-4c45-ada1-ff8d38d2a5e8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:26.030454 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b3d9d-cb28-405c-b8e8-4e1702148bdd None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:26.060234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 191/379] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Sep 1 16:19:25 2022] GET /identity/v3/role_assignments?group.id=f8d5e262d5f44cabacb5a22407a74168&scope.project.id=4adbce25e8e4487caa00d740c3b88473&role.id=f889b15cab8c46f58be00f84143aac60 => generated 260 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:26.064669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42000962-cd35-4f8d-bfd4-0db367ad5cbd None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:26.064669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42000962-cd35-4f8d-bfd4-0db367ad5cbd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:26.064669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42000962-cd35-4f8d-bfd4-0db367ad5cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:26.092444 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-42000962-cd35-4f8d-bfd4-0db367ad5cbd None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:26.093813 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-42000962-cd35-4f8d-bfd4-0db367ad5cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:26.249286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b3d9d-cb28-405c-b8e8-4e1702148bdd None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:26.287176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 192/380] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:26.327798 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fb551-8a38-4d7b-8682-87254e585ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:26.329486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fb551-8a38-4d7b-8682-87254e585ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:26.329968 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fb551-8a38-4d7b-8682-87254e585ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:26.330437 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fb551-8a38-4d7b-8682-87254e585ba9 None admin] PATH_INFO: `/v3/groups/6c164c0d27d940b89c9b632e65e846c3` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:26.342168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fb551-8a38-4d7b-8682-87254e585ba9 None admin] RBAC: Authorizing `identity:get_group(group_id=6c164c0d27d940b89c9b632e65e846c3)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:26.345485 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fb551-8a38-4d7b-8682-87254e585ba9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:26.348793 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 189/381] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:26 2022] GET /identity/v3/groups/6c164c0d27d940b89c9b632e65e846c3 => generated 229 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:26.358090 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42000962-cd35-4f8d-bfd4-0db367ad5cbd None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:26.480131 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:26.582413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42000962-cd35-4f8d-bfd4-0db367ad5cbd None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:26.658096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146f337-c3dd-4d09-abbe-544a0f78f7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:26.659596 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146f337-c3dd-4d09-abbe-544a0f78f7d1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:26.660373 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146f337-c3dd-4d09-abbe-544a0f78f7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:26.661133 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146f337-c3dd-4d09-abbe-544a0f78f7d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:26.662848 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146f337-c3dd-4d09-abbe-544a0f78f7d1 None admin] RBAC: Adding query filter params (group.id=6c164c0d27d940b89c9b632e65e846c3, role.id=a8896546a02c42489ef73c7ad7c43542, scope.project.id=3ac22d8b2a234cb4ae28b76d9f5e893d) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:26.663789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146f337-c3dd-4d09-abbe-544a0f78f7d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:26.666807 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146f337-c3dd-4d09-abbe-544a0f78f7d1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:26.683601 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 193/382] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Sep 1 16:19:26 2022] GET /identity/v3/role_assignments?group.id=6c164c0d27d940b89c9b632e65e846c3&scope.project.id=3ac22d8b2a234cb4ae28b76d9f5e893d&role.id=a8896546a02c42489ef73c7ad7c43542 => generated 260 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:26.884768 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fb551-8a38-4d7b-8682-87254e585ba9 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:26.921984 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:27.045214 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fb551-8a38-4d7b-8682-87254e585ba9 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:27.113584 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966d035-092e-402a-b3c9-fcb51cf57460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:27.114272 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966d035-092e-402a-b3c9-fcb51cf57460 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:27.114555 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966d035-092e-402a-b3c9-fcb51cf57460 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:27.114901 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966d035-092e-402a-b3c9-fcb51cf57460 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:27.136181 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966d035-092e-402a-b3c9-fcb51cf57460 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:27.142565 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-2966d035-092e-402a-b3c9-fcb51cf57460 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:27.142565 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:27.142565 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:27.142565 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:27.142565 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:27.142565 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:27.142565 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:27.142565 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:27.142565 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:27.142565 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:27.142565 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:27.142565 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:27.142565 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:27.142565 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:27.142565 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:27.142565 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:27.144216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:27.144216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:27.144216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:27.144216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:27.144216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:27.144216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:27.144216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:27.144216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:27.144216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:27.144216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:27.144216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:27.144216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:27.144216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:27.144216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:27.144216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:27.144216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:27.146083 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:27.146083 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:27.146083 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:27.146083 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:27.146083 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:27.146083 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:27.146083 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:27.146083 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:27.146083 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:27.146083 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:27.146083 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:27.146083 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:27.146083 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 190/383] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 1 16:19:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:27.154469 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146f337-c3dd-4d09-abbe-544a0f78f7d1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:27.404925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146f337-c3dd-4d09-abbe-544a0f78f7d1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:27.465034 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:27.503967 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c00db-0b96-485b-a2e7-6b7bee7d4988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:27.505106 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c00db-0b96-485b-a2e7-6b7bee7d4988 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:27.505679 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c00db-0b96-485b-a2e7-6b7bee7d4988 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:27.506301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c00db-0b96-485b-a2e7-6b7bee7d4988 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:27.507631 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c00db-0b96-485b-a2e7-6b7bee7d4988 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:27.508194 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c00db-0b96-485b-a2e7-6b7bee7d4988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:27.511056 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c00db-0b96-485b-a2e7-6b7bee7d4988 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:27.538944 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 194/384] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:27.558691 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966d035-092e-402a-b3c9-fcb51cf57460 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:27.703836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd1732-40b0-448a-8d39-41719eb29246 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:27.704381 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd1732-40b0-448a-8d39-41719eb29246 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:27.704919 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd1732-40b0-448a-8d39-41719eb29246 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:27.708023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 195/385] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:27.720488 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:27.724609 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94965eb2-18f8-4256-9526-63568da81548 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:27.725557 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94965eb2-18f8-4256-9526-63568da81548 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:27.726788 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94965eb2-18f8-4256-9526-63568da81548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:27.756659 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966d035-092e-402a-b3c9-fcb51cf57460 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:27.773800 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-94965eb2-18f8-4256-9526-63568da81548 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:27.775479 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-94965eb2-18f8-4256-9526-63568da81548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:27.834152 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd13b12-cd07-4305-a390-d5efc5ccd788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:27.835257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd13b12-cd07-4305-a390-d5efc5ccd788 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:27.835747 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd13b12-cd07-4305-a390-d5efc5ccd788 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:27.836231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd13b12-cd07-4305-a390-d5efc5ccd788 None admin] PATH_INFO: `/v3/groups/f8d5e262d5f44cabacb5a22407a74168` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:27.838782 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd13b12-cd07-4305-a390-d5efc5ccd788 None admin] RBAC: Authorizing `identity:get_group(group_id=f8d5e262d5f44cabacb5a22407a74168)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:27.841805 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd13b12-cd07-4305-a390-d5efc5ccd788 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:27.845507 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 191/386] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:27 2022] GET /identity/v3/groups/f8d5e262d5f44cabacb5a22407a74168 => generated 226 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:27.855597 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd13b12-cd07-4305-a390-d5efc5ccd788 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:28.002815 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 196/387] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:28.141780 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd13b12-cd07-4305-a390-d5efc5ccd788 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:28.236744 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283371bf-af0f-4850-a940-bb723a8036a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:28.237848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283371bf-af0f-4850-a940-bb723a8036a3 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:28.238333 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283371bf-af0f-4850-a940-bb723a8036a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:28.238823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283371bf-af0f-4850-a940-bb723a8036a3 None admin] PATH_INFO: `/v3/projects/c6ec2c26955d46c3a767d88695f36411` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:28.246106 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283371bf-af0f-4850-a940-bb723a8036a3 None admin] RBAC: Authorizing `identity:get_project(project_id=c6ec2c26955d46c3a767d88695f36411)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:28.249030 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283371bf-af0f-4850-a940-bb723a8036a3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:28.253597 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 192/388] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:27 2022] GET /identity/v3/projects/c6ec2c26955d46c3a767d88695f36411 => generated 298 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:28.262365 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94965eb2-18f8-4256-9526-63568da81548 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:28.484985 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94965eb2-18f8-4256-9526-63568da81548 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:28.489211 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd5865-1054-4346-ad22-65b4751c7619 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:28.489688 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd5865-1054-4346-ad22-65b4751c7619 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:28.490156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd5865-1054-4346-ad22-65b4751c7619 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:28.497248 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 193/389] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:28 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:19:28.511086 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294833d-5c05-4763-8225-26ba2637af6c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:28.511464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294833d-5c05-4763-8225-26ba2637af6c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:28.511794 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294833d-5c05-4763-8225-26ba2637af6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:28.525257 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:28.535138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212e41f-2934-4937-8230-2e92ea39a702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:28.535830 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212e41f-2934-4937-8230-2e92ea39a702 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:28.536121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212e41f-2934-4937-8230-2e92ea39a702 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:28.536402 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212e41f-2934-4937-8230-2e92ea39a702 None admin] PATH_INFO: `/v3/projects/c6ec2c26955d46c3a767d88695f36411/groups/f8d5e262d5f44cabacb5a22407a74168/roles/f889b15cab8c46f58be00f84143aac60` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:28.540916 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212e41f-2934-4937-8230-2e92ea39a702 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6ec2c26955d46c3a767d88695f36411, group_id=f8d5e262d5f44cabacb5a22407a74168, role_id=f889b15cab8c46f58be00f84143aac60)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:28.542384 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212e41f-2934-4937-8230-2e92ea39a702 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:28.573257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9294833d-5c05-4763-8225-26ba2637af6c None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:28.575269 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 197/390] 10.222.0.52 () {58 vars in 1442 bytes} [Thu Sep 1 16:19:28 2022] PUT /identity/v3/projects/c6ec2c26955d46c3a767d88695f36411/groups/f8d5e262d5f44cabacb5a22407a74168/roles/f889b15cab8c46f58be00f84143aac60 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:19:28.576127 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9294833d-5c05-4763-8225-26ba2637af6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:28.605823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:28.661405 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212e41f-2934-4937-8230-2e92ea39a702 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:28.803970 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 194/391] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:28.889930 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212e41f-2934-4937-8230-2e92ea39a702 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:28.942119 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39d2f0-0902-475b-83ae-c163ed699be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:28.942777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39d2f0-0902-475b-83ae-c163ed699be2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:28.943060 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39d2f0-0902-475b-83ae-c163ed699be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:28.943339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39d2f0-0902-475b-83ae-c163ed699be2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:28.957079 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39d2f0-0902-475b-83ae-c163ed699be2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:28.962195 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-6f39d2f0-0902-475b-83ae-c163ed699be2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:28.962195 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:28.962195 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:28.962195 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:28.962195 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:28.962195 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:28.962195 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:28.962195 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:28.962195 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:28.962195 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:28.962195 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:28.962195 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:28.962195 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:28.962195 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:28.962195 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:28.962195 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:28.963808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:28.963808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:28.963808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:28.963808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:28.963808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:28.963808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:28.963808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:28.963808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:28.963808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:28.963808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:28.963808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:28.963808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:28.963808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:28.963808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:28.963808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:28.963808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:28.965374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:28.965374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:28.965374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:28.965374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:28.965374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:28.965374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:28.965374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:28.965374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:28.965374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:28.965374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:28.965374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:28.965374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:28.965374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 198/392] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:19:28.974461 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294833d-5c05-4763-8225-26ba2637af6c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:29.254169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294833d-5c05-4763-8225-26ba2637af6c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:29.303490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39d2f0-0902-475b-83ae-c163ed699be2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:29.355194 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fde652-779f-48cc-adee-821cec2c0d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:29.356060 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fde652-779f-48cc-adee-821cec2c0d5f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:29.356351 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fde652-779f-48cc-adee-821cec2c0d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:29.356655 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fde652-779f-48cc-adee-821cec2c0d5f None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:29.357964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fde652-779f-48cc-adee-821cec2c0d5f None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:29.358275 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fde652-779f-48cc-adee-821cec2c0d5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:29.360675 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fde652-779f-48cc-adee-821cec2c0d5f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:29.397444 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 195/393] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:29.407302 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fde652-779f-48cc-adee-821cec2c0d5f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:29.418283 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:29.473054 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:29.557490 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fde652-779f-48cc-adee-821cec2c0d5f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:29.599576 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710b740-52a3-4bd5-8c46-b2b069b95f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:29.600735 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710b740-52a3-4bd5-8c46-b2b069b95f4c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:29.601292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710b740-52a3-4bd5-8c46-b2b069b95f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:29.601771 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710b740-52a3-4bd5-8c46-b2b069b95f4c None admin] PATH_INFO: `/v3/groups/f8d5e262d5f44cabacb5a22407a74168` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:29.603299 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710b740-52a3-4bd5-8c46-b2b069b95f4c None admin] RBAC: Authorizing `identity:get_group(group_id=f8d5e262d5f44cabacb5a22407a74168)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:29.605236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710b740-52a3-4bd5-8c46-b2b069b95f4c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:29.607611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 196/394] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:29 2022] GET /identity/v3/groups/f8d5e262d5f44cabacb5a22407a74168 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:29.623606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710b740-52a3-4bd5-8c46-b2b069b95f4c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:29.703803 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39d2f0-0902-475b-83ae-c163ed699be2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:29.836743 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cb1bf-facf-4fdb-bcd9-de9a0323a938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:29.838059 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cb1bf-facf-4fdb-bcd9-de9a0323a938 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:29.838554 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cb1bf-facf-4fdb-bcd9-de9a0323a938 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:29.839283 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cb1bf-facf-4fdb-bcd9-de9a0323a938 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:29.853069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:29.872502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903cb1bf-facf-4fdb-bcd9-de9a0323a938 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:29.878182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-903cb1bf-facf-4fdb-bcd9-de9a0323a938 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:29.878182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:29.878182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:29.878182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:29.878182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:29.878182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:29.878182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:29.878182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:29.878182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:29.878182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:29.878182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:29.878182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:29.878182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:29.878182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:29.878182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:29.878182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:29.879143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:29.879143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:29.879143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:29.879143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:29.879143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:29.879143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:29.879143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:29.879143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:29.879143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:29.879143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:29.879143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:29.879143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:29.879143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:29.879143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:29.879143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:29.879143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:29.879923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:29.879923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:29.879923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:29.879923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:29.879923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:29.879923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:29.879923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:29.879923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:29.879923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:29.879923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:29.879923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:29.879923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:29.879923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 199/395] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 577 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:29.886954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cb1bf-facf-4fdb-bcd9-de9a0323a938 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:29.904975 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710b740-52a3-4bd5-8c46-b2b069b95f4c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:29.972853 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85695652-adec-46e3-8b09-6c029293b033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:29.974401 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85695652-adec-46e3-8b09-6c029293b033 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:29.975132 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85695652-adec-46e3-8b09-6c029293b033 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:29.975903 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85695652-adec-46e3-8b09-6c029293b033 None admin] PATH_INFO: `/v3/projects/c6ec2c26955d46c3a767d88695f36411` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:29.978633 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85695652-adec-46e3-8b09-6c029293b033 None admin] RBAC: Authorizing `identity:get_project(project_id=c6ec2c26955d46c3a767d88695f36411)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:29.981486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85695652-adec-46e3-8b09-6c029293b033 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:29.986263 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 197/396] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:29 2022] GET /identity/v3/projects/c6ec2c26955d46c3a767d88695f36411 => generated 298 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:29.988648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4dc17-dae3-4139-802c-1944fcbe3fb2 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:29.989306 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4dc17-dae3-4139-802c-1944fcbe3fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:29.989928 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4dc17-dae3-4139-802c-1944fcbe3fb2 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:29.992529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 198/397] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:30.002652 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f86b9-2dce-4ace-bedf-cda2fb2d58b4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:30.003426 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f86b9-2dce-4ace-bedf-cda2fb2d58b4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:30.004115 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f86b9-2dce-4ace-bedf-cda2fb2d58b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:30.028748 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:30.036827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-cd4f86b9-2dce-4ace-bedf-cda2fb2d58b4 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:30.038762 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cd4f86b9-2dce-4ace-bedf-cda2fb2d58b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:30.041720 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cb1bf-facf-4fdb-bcd9-de9a0323a938 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:30.115847 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d5a13-a352-44e7-87b5-dac4bb93e62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:30.117379 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d5a13-a352-44e7-87b5-dac4bb93e62f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:30.118179 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d5a13-a352-44e7-87b5-dac4bb93e62f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:30.119032 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d5a13-a352-44e7-87b5-dac4bb93e62f None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:30.120787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d5a13-a352-44e7-87b5-dac4bb93e62f None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:30.121652 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d5a13-a352-44e7-87b5-dac4bb93e62f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:30.124725 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d5a13-a352-44e7-87b5-dac4bb93e62f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:30.130861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 199/398] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:30.131831 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f86b9-2dce-4ace-bedf-cda2fb2d58b4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:30.144400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 200/399] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:30.155015 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d5a13-a352-44e7-87b5-dac4bb93e62f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:30.300930 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d5a13-a352-44e7-87b5-dac4bb93e62f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:30.321120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:30.354061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f86b9-2dce-4ace-bedf-cda2fb2d58b4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:30.357809 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce0374-3240-435b-a962-7d7d6eef6c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:30.358749 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce0374-3240-435b-a962-7d7d6eef6c6f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:30.359175 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce0374-3240-435b-a962-7d7d6eef6c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:30.360203 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce0374-3240-435b-a962-7d7d6eef6c6f None admin] PATH_INFO: `/v3/groups/f8d5e262d5f44cabacb5a22407a74168` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:30.361712 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce0374-3240-435b-a962-7d7d6eef6c6f None admin] RBAC: Authorizing `identity:get_group(group_id=f8d5e262d5f44cabacb5a22407a74168)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:30.363378 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce0374-3240-435b-a962-7d7d6eef6c6f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:30.365669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 201/400] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:30 2022] GET /identity/v3/groups/f8d5e262d5f44cabacb5a22407a74168 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:30.367399 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f576b2b-9807-4086-ae34-61c78d1ce468 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:30.367912 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f576b2b-9807-4086-ae34-61c78d1ce468 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:30.368490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f576b2b-9807-4086-ae34-61c78d1ce468 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:30.370438 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 202/401] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:30.373080 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f576b2b-9807-4086-ae34-61c78d1ce468 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:30.401519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce2947-cdbe-4cf1-ae6d-4e73a15fd8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:30.402217 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce2947-cdbe-4cf1-ae6d-4e73a15fd8a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:30.402500 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce2947-cdbe-4cf1-ae6d-4e73a15fd8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:30.402779 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce2947-cdbe-4cf1-ae6d-4e73a15fd8a0 None admin] PATH_INFO: `/v3/projects/c6ec2c26955d46c3a767d88695f36411/groups/f8d5e262d5f44cabacb5a22407a74168/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:30.406103 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce2947-cdbe-4cf1-ae6d-4e73a15fd8a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6ec2c26955d46c3a767d88695f36411, group_id=f8d5e262d5f44cabacb5a22407a74168, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:30.407481 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:30.407669 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce2947-cdbe-4cf1-ae6d-4e73a15fd8a0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:30.432705 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 200/402] 10.222.0.52 () {58 vars in 1442 bytes} [Thu Sep 1 16:19:30 2022] PUT /identity/v3/projects/c6ec2c26955d46c3a767d88695f36411/groups/f8d5e262d5f44cabacb5a22407a74168/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:19:30.432705 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd1ee7-8bea-4d63-890c-3eaac0f30759 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:30.432705 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd1ee7-8bea-4d63-890c-3eaac0f30759 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:30.432705 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd1ee7-8bea-4d63-890c-3eaac0f30759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:30.475178 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e2cd1ee7-8bea-4d63-890c-3eaac0f30759 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:30.476541 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e2cd1ee7-8bea-4d63-890c-3eaac0f30759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:30.557705 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f576b2b-9807-4086-ae34-61c78d1ce468 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:30.605950 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31d3f6-94ad-48b3-805f-39370ab2fff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:30.607022 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31d3f6-94ad-48b3-805f-39370ab2fff4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:30.607519 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31d3f6-94ad-48b3-805f-39370ab2fff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:30.608029 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31d3f6-94ad-48b3-805f-39370ab2fff4 None admin] PATH_INFO: `/v3/projects/4adbce25e8e4487caa00d740c3b88473` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:30.609768 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31d3f6-94ad-48b3-805f-39370ab2fff4 None admin] RBAC: Authorizing `identity:get_project(project_id=4adbce25e8e4487caa00d740c3b88473)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:30.612398 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31d3f6-94ad-48b3-805f-39370ab2fff4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:30.614962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 203/403] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:30 2022] GET /identity/v3/projects/4adbce25e8e4487caa00d740c3b88473 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:30.626379 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31d3f6-94ad-48b3-805f-39370ab2fff4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:30.650580 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 201/404] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:30.699822 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd1ee7-8bea-4d63-890c-3eaac0f30759 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:30.770580 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:30.784997 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31d3f6-94ad-48b3-805f-39370ab2fff4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:30.792922 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:30.840423 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c60ba-a025-4458-a19d-5ecb6dbb9e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:30.841348 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c60ba-a025-4458-a19d-5ecb6dbb9e38 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:30.841634 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c60ba-a025-4458-a19d-5ecb6dbb9e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:30.841915 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c60ba-a025-4458-a19d-5ecb6dbb9e38 None admin] PATH_INFO: `/v3/projects/4adbce25e8e4487caa00d740c3b88473/groups/f8d5e262d5f44cabacb5a22407a74168/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:30.845263 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c60ba-a025-4458-a19d-5ecb6dbb9e38 None admin] RBAC: Authorizing `identity:create_grant(project_id=4adbce25e8e4487caa00d740c3b88473, group_id=f8d5e262d5f44cabacb5a22407a74168, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:30.847648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c60ba-a025-4458-a19d-5ecb6dbb9e38 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:30.866798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 204/405] 10.222.0.52 () {58 vars in 1442 bytes} [Thu Sep 1 16:19:30 2022] PUT /identity/v3/projects/4adbce25e8e4487caa00d740c3b88473/groups/f8d5e262d5f44cabacb5a22407a74168/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:19:30.881149 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd1ee7-8bea-4d63-890c-3eaac0f30759 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:30.930240 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329a034-b2d3-4217-a99d-e495d7040f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:30.931036 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329a034-b2d3-4217-a99d-e495d7040f74 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:30.931331 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329a034-b2d3-4217-a99d-e495d7040f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:30.931580 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329a034-b2d3-4217-a99d-e495d7040f74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:30.946223 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329a034-b2d3-4217-a99d-e495d7040f74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:30.958282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-1329a034-b2d3-4217-a99d-e495d7040f74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:19:30.958282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:30.958282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:30.958282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:30.958282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:30.958282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:30.958282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:30.958282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:30.958282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:30.958282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:30.958282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:30.958282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:30.958282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:30.958282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:30.958282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:30.958282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:30.959242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:30.959242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:30.959242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:30.959242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:30.959242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:30.959242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:30.959242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:30.959242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:30.959242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:30.959242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:30.959242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:30.959242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:30.959242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:30.959242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:30.959242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:30.959242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:30.960045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:30.960045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:30.960045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:30.960045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:30.960045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:30.960045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:30.960045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:30.960045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:30.960045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:30.960045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:30.960045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:19:30.960045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:30.965280 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 202/406] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:19:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:19:30.971256 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c60ba-a025-4458-a19d-5ecb6dbb9e38 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:31.122251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c60ba-a025-4458-a19d-5ecb6dbb9e38 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:31.166743 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c124fb3-b00b-4114-ac0a-30a812f6e116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:31.167291 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c124fb3-b00b-4114-ac0a-30a812f6e116 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:31.167574 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c124fb3-b00b-4114-ac0a-30a812f6e116 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:31.167852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c124fb3-b00b-4114-ac0a-30a812f6e116 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:31.168550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c124fb3-b00b-4114-ac0a-30a812f6e116 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:31.168961 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c124fb3-b00b-4114-ac0a-30a812f6e116 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:31.170490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c124fb3-b00b-4114-ac0a-30a812f6e116 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:31.181606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 205/407] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:31.188742 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329a034-b2d3-4217-a99d-e495d7040f74 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:31.240271 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c124fb3-b00b-4114-ac0a-30a812f6e116 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:31.261688 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:31.395176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c124fb3-b00b-4114-ac0a-30a812f6e116 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:31.436909 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329a034-b2d3-4217-a99d-e495d7040f74 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:31.443587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa321887-0af7-44c5-9763-b7ed70ea7878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:31.444658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa321887-0af7-44c5-9763-b7ed70ea7878 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:31.445141 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa321887-0af7-44c5-9763-b7ed70ea7878 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:31.445639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa321887-0af7-44c5-9763-b7ed70ea7878 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:31.501898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa321887-0af7-44c5-9763-b7ed70ea7878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:31.504883 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:31.507389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-fa321887-0af7-44c5-9763-b7ed70ea7878 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:31.507389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:31.507389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:31.507389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:31.507389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:31.507389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:31.507389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:31.507389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:31.507389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:31.507389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:31.507389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:31.507389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:31.507389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:31.507389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:31.507389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:31.507389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:31.509684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:31.509684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:31.509684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:31.509684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:31.509684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:31.509684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:31.509684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:31.509684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:31.509684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:31.509684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:31.509684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:31.509684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:31.509684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:31.509684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:31.509684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:31.509684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:31.511478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:31.511478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:31.511478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:31.511478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:31.511478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:31.511478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:31.511478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:31.511478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:31.511478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:31.511478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:31.511478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:31.511478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:31.511478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 206/408] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 1 16:19:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:31.515229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa321887-0af7-44c5-9763-b7ed70ea7878 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:31.539091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46b273-9503-4d26-83da-89fa9838fd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:31.539746 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46b273-9503-4d26-83da-89fa9838fd96 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:31.540019 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46b273-9503-4d26-83da-89fa9838fd96 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:31.540282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46b273-9503-4d26-83da-89fa9838fd96 None admin] PATH_INFO: `/v3/groups/6c164c0d27d940b89c9b632e65e846c3` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:31.541649 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46b273-9503-4d26-83da-89fa9838fd96 None admin] RBAC: Authorizing `identity:get_group(group_id=6c164c0d27d940b89c9b632e65e846c3)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:31.543121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46b273-9503-4d26-83da-89fa9838fd96 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:31.545342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 203/409] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:31 2022] GET /identity/v3/groups/6c164c0d27d940b89c9b632e65e846c3 => generated 229 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:31.551345 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46b273-9503-4d26-83da-89fa9838fd96 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:31.676914 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:31.759025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa321887-0af7-44c5-9763-b7ed70ea7878 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:31.773225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46b273-9503-4d26-83da-89fa9838fd96 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:31.813155 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98950be7-0121-43da-9010-8528e03a53a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:31.813817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98950be7-0121-43da-9010-8528e03a53a3 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:31.814097 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98950be7-0121-43da-9010-8528e03a53a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:31.814369 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98950be7-0121-43da-9010-8528e03a53a3 None admin] PATH_INFO: `/v3/projects/3ac22d8b2a234cb4ae28b76d9f5e893d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:31.815620 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98950be7-0121-43da-9010-8528e03a53a3 None admin] RBAC: Authorizing `identity:get_project(project_id=3ac22d8b2a234cb4ae28b76d9f5e893d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:31.817171 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98950be7-0121-43da-9010-8528e03a53a3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:31.819258 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 204/410] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:31 2022] GET /identity/v3/projects/3ac22d8b2a234cb4ae28b76d9f5e893d => generated 344 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:31.820562 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e715548-4d69-4fd7-a6a8-820335d107b4 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:31.820864 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e715548-4d69-4fd7-a6a8-820335d107b4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:31.821136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e715548-4d69-4fd7-a6a8-820335d107b4 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:31.822494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 205/411] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:31.827725 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e715548-4d69-4fd7-a6a8-820335d107b4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:31.832804 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f264d-49cd-4db9-9737-53c82ed91215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:31.833862 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f264d-49cd-4db9-9737-53c82ed91215 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:31.834314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f264d-49cd-4db9-9737-53c82ed91215 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:31.834805 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f264d-49cd-4db9-9737-53c82ed91215 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:31.836030 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f264d-49cd-4db9-9737-53c82ed91215 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:31.836576 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f264d-49cd-4db9-9737-53c82ed91215 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:31.839511 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f264d-49cd-4db9-9737-53c82ed91215 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:31.857884 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 207/412] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:31.874500 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6a5e8-fdbf-4a55-ab84-070b0c12a6ae None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:31.875029 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6a5e8-fdbf-4a55-ab84-070b0c12a6ae None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:31.875808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6a5e8-fdbf-4a55-ab84-070b0c12a6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:31.914164 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6ee6a5e8-fdbf-4a55-ab84-070b0c12a6ae None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:31.916542 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6ee6a5e8-fdbf-4a55-ab84-070b0c12a6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:31.917516 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:31.967170 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e715548-4d69-4fd7-a6a8-820335d107b4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:32.007085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86ff34-12e5-4316-86eb-69d92ab3de85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:32.007785 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86ff34-12e5-4316-86eb-69d92ab3de85 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:32.008064 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86ff34-12e5-4316-86eb-69d92ab3de85 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:32.008328 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86ff34-12e5-4316-86eb-69d92ab3de85 None admin] PATH_INFO: `/v3/projects/3ac22d8b2a234cb4ae28b76d9f5e893d/groups/6c164c0d27d940b89c9b632e65e846c3/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:32.010586 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86ff34-12e5-4316-86eb-69d92ab3de85 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ac22d8b2a234cb4ae28b76d9f5e893d, group_id=6c164c0d27d940b89c9b632e65e846c3, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:32.012007 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86ff34-12e5-4316-86eb-69d92ab3de85 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:32.031775 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 206/413] 10.222.0.52 () {58 vars in 1442 bytes} [Thu Sep 1 16:19:31 2022] PUT /identity/v3/projects/3ac22d8b2a234cb4ae28b76d9f5e893d/groups/6c164c0d27d940b89c9b632e65e846c3/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:19:32.032874 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86ff34-12e5-4316-86eb-69d92ab3de85 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:32.059434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 208/414] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:32.161004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86ff34-12e5-4316-86eb-69d92ab3de85 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:32.185122 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:32.202544 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e8c07-8a22-4170-a23c-3943002e603f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:32.203861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e8c07-8a22-4170-a23c-3943002e603f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:32.204144 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e8c07-8a22-4170-a23c-3943002e603f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:32.204419 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e8c07-8a22-4170-a23c-3943002e603f None admin] PATH_INFO: `/v3/groups/f8d5e262d5f44cabacb5a22407a74168` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:32.205841 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e8c07-8a22-4170-a23c-3943002e603f None admin] RBAC: Authorizing `identity:get_group(group_id=f8d5e262d5f44cabacb5a22407a74168)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:32.207486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e8c07-8a22-4170-a23c-3943002e603f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:32.209333 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 207/415] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:32 2022] GET /identity/v3/groups/f8d5e262d5f44cabacb5a22407a74168 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:32.215228 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6a5e8-fdbf-4a55-ab84-070b0c12a6ae None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:32.287998 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:32.333681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6a5e8-fdbf-4a55-ab84-070b0c12a6ae None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:32.373243 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a103a29-e80e-4011-ab40-d9eee595c12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:32.373957 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a103a29-e80e-4011-ab40-d9eee595c12b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:32.374235 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a103a29-e80e-4011-ab40-d9eee595c12b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:32.374506 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a103a29-e80e-4011-ab40-d9eee595c12b None admin] PATH_INFO: `/v3/projects/4adbce25e8e4487caa00d740c3b88473` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:32.376015 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a103a29-e80e-4011-ab40-d9eee595c12b None admin] RBAC: Authorizing `identity:get_project(project_id=4adbce25e8e4487caa00d740c3b88473)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:32.377539 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a103a29-e80e-4011-ab40-d9eee595c12b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:32.379228 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 209/416] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:32 2022] GET /identity/v3/projects/4adbce25e8e4487caa00d740c3b88473 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:32.381721 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e8c07-8a22-4170-a23c-3943002e603f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:32.385407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a103a29-e80e-4011-ab40-d9eee595c12b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:32.521442 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e8c07-8a22-4170-a23c-3943002e603f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:32.584047 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb1d1e-766d-4878-955c-a57fb10ed5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:32.585382 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb1d1e-766d-4878-955c-a57fb10ed5d1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:32.587492 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb1d1e-766d-4878-955c-a57fb10ed5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:32.588033 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb1d1e-766d-4878-955c-a57fb10ed5d1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:32.610214 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a103a29-e80e-4011-ab40-d9eee595c12b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:32.627894 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb1d1e-766d-4878-955c-a57fb10ed5d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:32.646336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-afcb1d1e-766d-4878-955c-a57fb10ed5d1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:32.646336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:32.646336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:32.646336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:32.646336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:32.646336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:32.646336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:32.646336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:32.646336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:32.646336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:32.646336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:32.646336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:32.646336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:32.646336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:32.646336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:32.646336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:32.647287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:32.647287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:32.647287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:32.647287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:32.647287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:32.647287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:32.647287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:32.647287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:32.647287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:32.647287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:32.647287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:32.647287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:32.647287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:32.647287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:32.647287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:32.647287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:32.648090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:32.648090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:32.648090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:32.648090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:32.648090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:32.648090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:32.648090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:32.648090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:32.648090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:32.648090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:32.648090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:32.648090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:32.648753 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 208/417] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 1 16:19:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:32.659186 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb1d1e-766d-4878-955c-a57fb10ed5d1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:32.681030 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:32.693926 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bdeaf-e070-456c-b585-34be74a3ffa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:32.694612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bdeaf-e070-456c-b585-34be74a3ffa1 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:32.694900 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bdeaf-e070-456c-b585-34be74a3ffa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:32.695169 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bdeaf-e070-456c-b585-34be74a3ffa1 None admin] PATH_INFO: `/v3/projects/4adbce25e8e4487caa00d740c3b88473/groups/f8d5e262d5f44cabacb5a22407a74168/roles/f889b15cab8c46f58be00f84143aac60` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:32.700916 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280bdeaf-e070-456c-b585-34be74a3ffa1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4adbce25e8e4487caa00d740c3b88473, group_id=f8d5e262d5f44cabacb5a22407a74168, role_id=f889b15cab8c46f58be00f84143aac60)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:32.702415 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280bdeaf-e070-456c-b585-34be74a3ffa1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:32.735887 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 210/418] 10.222.0.52 () {58 vars in 1442 bytes} [Thu Sep 1 16:19:32 2022] PUT /identity/v3/projects/4adbce25e8e4487caa00d740c3b88473/groups/f8d5e262d5f44cabacb5a22407a74168/roles/f889b15cab8c46f58be00f84143aac60 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:19:32.799733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:32.923343 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb1d1e-766d-4878-955c-a57fb10ed5d1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:33.003499 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee1905-b0c6-43ae-ad39-ae7d8b1bf7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:33.005146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee1905-b0c6-43ae-ad39-ae7d8b1bf7cb None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:33.005957 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee1905-b0c6-43ae-ad39-ae7d8b1bf7cb None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:33.006817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee1905-b0c6-43ae-ad39-ae7d8b1bf7cb None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:33.008469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee1905-b0c6-43ae-ad39-ae7d8b1bf7cb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:33.009365 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee1905-b0c6-43ae-ad39-ae7d8b1bf7cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:33.012399 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee1905-b0c6-43ae-ad39-ae7d8b1bf7cb None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:33.034570 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 209/419] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:33.045863 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bdeaf-e070-456c-b585-34be74a3ffa1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:33.190127 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bdeaf-e070-456c-b585-34be74a3ffa1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:33.231491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5decc4-c670-4c4f-bccc-b65735e8d837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:33.232133 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5decc4-c670-4c4f-bccc-b65735e8d837 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:33.232420 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5decc4-c670-4c4f-bccc-b65735e8d837 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:33.232727 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5decc4-c670-4c4f-bccc-b65735e8d837 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:33.309412 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e422f0a-1066-47f7-9e0a-88433831608c None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:33.310331 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e422f0a-1066-47f7-9e0a-88433831608c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:33.311180 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e422f0a-1066-47f7-9e0a-88433831608c None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:33.315091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 210/420] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:33.324782 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cca97-12c5-46b6-bcb5-4a7ca0742317 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:33.325751 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cca97-12c5-46b6-bcb5-4a7ca0742317 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:33.326521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cca97-12c5-46b6-bcb5-4a7ca0742317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:33.329096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:33.353638 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5decc4-c670-4c4f-bccc-b65735e8d837 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:33.355198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5decc4-c670-4c4f-bccc-b65735e8d837 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:33.361861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-542cca97-12c5-46b6-bcb5-4a7ca0742317 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:33.364514 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-542cca97-12c5-46b6-bcb5-4a7ca0742317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:33.511377 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 211/421] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:33.559758 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 211/422] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:33.582830 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cca97-12c5-46b6-bcb5-4a7ca0742317 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:33.673788 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:33.703656 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58122d87-3eaa-45f7-9db8-880813a93a71 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:33.704072 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58122d87-3eaa-45f7-9db8-880813a93a71 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:33.704226 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58122d87-3eaa-45f7-9db8-880813a93a71 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:33.706029 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 212/423] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:33.711425 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79031d67-1efa-404d-9ce9-ed80465292a3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:33.711816 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79031d67-1efa-404d-9ce9-ed80465292a3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:33.711964 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79031d67-1efa-404d-9ce9-ed80465292a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:33.754768 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-79031d67-1efa-404d-9ce9-ed80465292a3 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:33.756029 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-79031d67-1efa-404d-9ce9-ed80465292a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:33.791145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cca97-12c5-46b6-bcb5-4a7ca0742317 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:33.874263 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143db9bd-11ea-431d-bd2a-d3b0444156eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:33.876174 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143db9bd-11ea-431d-bd2a-d3b0444156eb None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:33.876692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143db9bd-11ea-431d-bd2a-d3b0444156eb None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:33.877180 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143db9bd-11ea-431d-bd2a-d3b0444156eb None admin] PATH_INFO: `/v3/projects/c6ec2c26955d46c3a767d88695f36411` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:33.879630 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143db9bd-11ea-431d-bd2a-d3b0444156eb None admin] RBAC: Authorizing `identity:get_project(project_id=c6ec2c26955d46c3a767d88695f36411)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:33.882512 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143db9bd-11ea-431d-bd2a-d3b0444156eb None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:33.886312 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 212/424] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:33 2022] GET /identity/v3/projects/c6ec2c26955d46c3a767d88695f36411 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:33.895534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143db9bd-11ea-431d-bd2a-d3b0444156eb None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:33.957045 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 213/425] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:33.957923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79031d67-1efa-404d-9ce9-ed80465292a3 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:33.987223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:34.079002 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79031d67-1efa-404d-9ce9-ed80465292a3 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:34.126879 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143db9bd-11ea-431d-bd2a-d3b0444156eb None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:34.147251 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:34.155694 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fabcb-3bc1-4e05-b678-5fde312d0e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:34.156462 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fabcb-3bc1-4e05-b678-5fde312d0e74 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:34.156767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fabcb-3bc1-4e05-b678-5fde312d0e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:34.157039 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fabcb-3bc1-4e05-b678-5fde312d0e74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:34.177514 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381fabcb-3bc1-4e05-b678-5fde312d0e74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:34.192424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-381fabcb-3bc1-4e05-b678-5fde312d0e74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:34.192424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:34.192424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:34.192424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:34.192424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:34.192424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:34.192424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:34.192424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:34.192424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:34.192424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:34.192424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:34.192424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:34.192424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:34.192424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:34.192424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:34.192424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:34.193407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:34.193407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:34.193407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:34.193407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:34.193407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:34.193407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:34.193407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:34.193407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:34.193407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:34.193407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:34.193407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:34.193407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:34.193407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:34.193407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:34.193407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:34.193407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:34.194685 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:34.194685 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:34.194685 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:34.194685 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:34.194685 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:34.194685 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:34.194685 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:34.194685 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:34.194685 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:34.194685 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:34.194685 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:34.194685 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:34.194685 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 214/426] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:34.205733 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fabcb-3bc1-4e05-b678-5fde312d0e74 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:34.207281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a422ee8-eb18-4fd5-b177-e684cd767cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:34.208395 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a422ee8-eb18-4fd5-b177-e684cd767cbc None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:34.208924 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a422ee8-eb18-4fd5-b177-e684cd767cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:34.209569 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a422ee8-eb18-4fd5-b177-e684cd767cbc None admin] PATH_INFO: `/v3/groups/f8d5e262d5f44cabacb5a22407a74168` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:34.211824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a422ee8-eb18-4fd5-b177-e684cd767cbc None admin] RBAC: Authorizing `identity:get_group(group_id=f8d5e262d5f44cabacb5a22407a74168)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:34.214638 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a422ee8-eb18-4fd5-b177-e684cd767cbc None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:34.218296 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 213/427] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:33 2022] GET /identity/v3/groups/f8d5e262d5f44cabacb5a22407a74168 => generated 226 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:34.226400 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a422ee8-eb18-4fd5-b177-e684cd767cbc None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:34.395468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:34.450330 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fabcb-3bc1-4e05-b678-5fde312d0e74 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:34.507829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f633be2-f33f-4a91-a89e-585d784d9f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:34.508919 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f633be2-f33f-4a91-a89e-585d784d9f61 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:34.509412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f633be2-f33f-4a91-a89e-585d784d9f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:34.509895 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f633be2-f33f-4a91-a89e-585d784d9f61 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:34.510954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f633be2-f33f-4a91-a89e-585d784d9f61 None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:34.511539 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f633be2-f33f-4a91-a89e-585d784d9f61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:34.513386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f633be2-f33f-4a91-a89e-585d784d9f61 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:34.525643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 215/428] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:34.527111 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f633be2-f33f-4a91-a89e-585d784d9f61 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:34.547205 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a422ee8-eb18-4fd5-b177-e684cd767cbc None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:34.588648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cec106-5569-4e5c-aaa6-e3e281d2d074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:34.589541 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cec106-5569-4e5c-aaa6-e3e281d2d074 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:34.589823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cec106-5569-4e5c-aaa6-e3e281d2d074 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:34.590090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cec106-5569-4e5c-aaa6-e3e281d2d074 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:34.590860 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cec106-5569-4e5c-aaa6-e3e281d2d074 None admin] RBAC: Adding query filter params (group.id=f8d5e262d5f44cabacb5a22407a74168, role.id=f889b15cab8c46f58be00f84143aac60, scope.project.id=c6ec2c26955d46c3a767d88695f36411) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:34.591673 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cec106-5569-4e5c-aaa6-e3e281d2d074 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:34.593647 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cec106-5569-4e5c-aaa6-e3e281d2d074 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:34.602994 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 214/429] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Sep 1 16:19:34 2022] GET /identity/v3/role_assignments?group.id=f8d5e262d5f44cabacb5a22407a74168&scope.project.id=c6ec2c26955d46c3a767d88695f36411&role.id=f889b15cab8c46f58be00f84143aac60 => generated 611 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:34.603951 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cec106-5569-4e5c-aaa6-e3e281d2d074 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:34.663781 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:34.751078 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cec106-5569-4e5c-aaa6-e3e281d2d074 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:34.817170 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdc308-733a-4871-918e-224ab832d635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:34.818614 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdc308-733a-4871-918e-224ab832d635 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:34.819343 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdc308-733a-4871-918e-224ab832d635 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:34.820047 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdc308-733a-4871-918e-224ab832d635 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:34.852971 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f633be2-f33f-4a91-a89e-585d784d9f61 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:34.921168 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63795f-9d10-41ac-a82c-ffed32342f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:34.922733 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63795f-9d10-41ac-a82c-ffed32342f99 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:34.923222 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63795f-9d10-41ac-a82c-ffed32342f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:34.923721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63795f-9d10-41ac-a82c-ffed32342f99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:34.938239 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63795f-9d10-41ac-a82c-ffed32342f99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:34.944159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-0e63795f-9d10-41ac-a82c-ffed32342f99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:34.944159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:34.944159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:34.944159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:34.944159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:34.944159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:34.944159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:34.944159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:34.944159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:34.944159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:34.944159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:34.944159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:34.944159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:34.944159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:34.944159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:34.944159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:34.945161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:34.945161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:34.945161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:34.945161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:34.945161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:34.945161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:34.945161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:34.945161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:34.945161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:34.945161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:34.945161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:34.945161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:34.945161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:34.945161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:34.945161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:34.945161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:34.945968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:34.945968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:34.945968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:34.945968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:34.945968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:34.945968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:34.945968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:34.945968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:34.945968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:34.945968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:34.945968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:19:34.945968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:34.948803 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 216/430] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 422 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:34.971066 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fdc308-733a-4871-918e-224ab832d635 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:34.974012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fdc308-733a-4871-918e-224ab832d635 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:34.984864 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63795f-9d10-41ac-a82c-ffed32342f99 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:34.994846 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:35.068276 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:35.150453 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63795f-9d10-41ac-a82c-ffed32342f99 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:35.176689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 215/431] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:35.178656 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a273ee5-063b-49a5-8225-93dfd93dc613 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:35.178938 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a273ee5-063b-49a5-8225-93dfd93dc613 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:35.179214 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a273ee5-063b-49a5-8225-93dfd93dc613 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:35.180805 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 216/432] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:35.185878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a273ee5-063b-49a5-8225-93dfd93dc613 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:35.200840 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b1984-cbdc-436f-a40f-bd6433325342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:35.201343 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b1984-cbdc-436f-a40f-bd6433325342 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:35.201602 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b1984-cbdc-436f-a40f-bd6433325342 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:35.201863 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b1984-cbdc-436f-a40f-bd6433325342 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:35.202560 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b1984-cbdc-436f-a40f-bd6433325342 None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:35.203103 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b1984-cbdc-436f-a40f-bd6433325342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:35.204471 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b1984-cbdc-436f-a40f-bd6433325342 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:35.213860 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 217/433] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:19:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:35.215151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eef0f1-56f0-485e-a350-6e6a15057b99 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:35.215433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eef0f1-56f0-485e-a350-6e6a15057b99 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:35.215711 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eef0f1-56f0-485e-a350-6e6a15057b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:35.237491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e3eef0f1-56f0-485e-a350-6e6a15057b99 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:35.238722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e3eef0f1-56f0-485e-a350-6e6a15057b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:35.316520 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:35.339279 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 218/434] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:35.339489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eef0f1-56f0-485e-a350-6e6a15057b99 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:35.348790 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a273ee5-063b-49a5-8225-93dfd93dc613 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:35.399314 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fb5e5-55c5-47f3-87ca-0ccd71b91737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:35.400721 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fb5e5-55c5-47f3-87ca-0ccd71b91737 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:35.401193 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fb5e5-55c5-47f3-87ca-0ccd71b91737 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:35.402293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fb5e5-55c5-47f3-87ca-0ccd71b91737 None admin] PATH_INFO: `/v3/projects/c6ec2c26955d46c3a767d88695f36411` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:35.404272 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fb5e5-55c5-47f3-87ca-0ccd71b91737 None admin] RBAC: Authorizing `identity:get_project(project_id=c6ec2c26955d46c3a767d88695f36411)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:35.406652 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fb5e5-55c5-47f3-87ca-0ccd71b91737 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:35.414311 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 217/435] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:35 2022] GET /identity/v3/projects/c6ec2c26955d46c3a767d88695f36411 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:35.416377 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fb5e5-55c5-47f3-87ca-0ccd71b91737 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:35.443471 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:35.577469 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eef0f1-56f0-485e-a350-6e6a15057b99 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:35.659642 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fb5e5-55c5-47f3-87ca-0ccd71b91737 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:35.661544 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a24e049-fe49-4ba6-81e8-d297797f7d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:35.662562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24e049-fe49-4ba6-81e8-d297797f7d49 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:35.663092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24e049-fe49-4ba6-81e8-d297797f7d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:35.663616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24e049-fe49-4ba6-81e8-d297797f7d49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:35.739272 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47a1bb-2da8-4813-abbb-e308ea845592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:35.741311 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47a1bb-2da8-4813-abbb-e308ea845592 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:35.741311 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47a1bb-2da8-4813-abbb-e308ea845592 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:35.741658 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47a1bb-2da8-4813-abbb-e308ea845592 None admin] PATH_INFO: `/v3/groups/f8d5e262d5f44cabacb5a22407a74168` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:35.743829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47a1bb-2da8-4813-abbb-e308ea845592 None admin] RBAC: Authorizing `identity:get_group(group_id=f8d5e262d5f44cabacb5a22407a74168)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:35.746381 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47a1bb-2da8-4813-abbb-e308ea845592 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:35.753968 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 218/436] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:35 2022] GET /identity/v3/groups/f8d5e262d5f44cabacb5a22407a74168 => generated 226 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:35.761794 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47a1bb-2da8-4813-abbb-e308ea845592 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:35.807651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:35.820337 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a24e049-fe49-4ba6-81e8-d297797f7d49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:35.822461 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a24e049-fe49-4ba6-81e8-d297797f7d49 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:35.917646 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:35.958140 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47a1bb-2da8-4813-abbb-e308ea845592 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:35.967136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 219/437] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:35.968005 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a24e049-fe49-4ba6-81e8-d297797f7d49 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:36.026275 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c58d3-e832-450a-89bc-7be1bde529cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:36.027230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c58d3-e832-450a-89bc-7be1bde529cf None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:36.027719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c58d3-e832-450a-89bc-7be1bde529cf None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:36.028202 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c58d3-e832-450a-89bc-7be1bde529cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:36.029574 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c58d3-e832-450a-89bc-7be1bde529cf None admin] RBAC: Adding query filter params (group.id=f8d5e262d5f44cabacb5a22407a74168, role.id=76a38a2307da45bcb511ef106076613d, scope.project.id=c6ec2c26955d46c3a767d88695f36411) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:36.030131 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c58d3-e832-450a-89bc-7be1bde529cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:36.033445 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c58d3-e832-450a-89bc-7be1bde529cf None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:36.043126 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 219/438] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Sep 1 16:19:35 2022] GET /identity/v3/role_assignments?group.id=f8d5e262d5f44cabacb5a22407a74168&scope.project.id=c6ec2c26955d46c3a767d88695f36411&role.id=76a38a2307da45bcb511ef106076613d => generated 611 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:36.044296 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37913f-a3cf-4ee4-9302-f69bbe6f7f16 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:36.044739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37913f-a3cf-4ee4-9302-f69bbe6f7f16 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:36.045004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37913f-a3cf-4ee4-9302-f69bbe6f7f16 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:36.046593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 220/439] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:36.051505 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37913f-a3cf-4ee4-9302-f69bbe6f7f16 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:36.103317 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:36.112074 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a24e049-fe49-4ba6-81e8-d297797f7d49 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:36.165361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a3a18-3b83-4477-b449-77806f5be7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:36.166278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a3a18-3b83-4477-b449-77806f5be7ac None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:36.166395 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a3a18-3b83-4477-b449-77806f5be7ac None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:36.166840 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a3a18-3b83-4477-b449-77806f5be7ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:36.187046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a3a18-3b83-4477-b449-77806f5be7ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:36.197460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-9e7a3a18-3b83-4477-b449-77806f5be7ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:19:36.197460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:36.197460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:36.197460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:36.197460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:36.197460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:36.197460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:36.197460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:36.197460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:36.197460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:36.197460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:36.197460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:36.197460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:36.197460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:36.197460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:36.197460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:36.198563 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:36.198563 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:36.198563 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:36.198563 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:36.198563 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:36.198563 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:36.198563 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:36.198563 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:36.198563 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:36.198563 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:36.198563 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:36.198563 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:36.198563 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:36.198563 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:36.198563 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:36.198563 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:36.199414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:36.199414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:36.199414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:36.199414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:36.199414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:36.199414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:36.199414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:36.199414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:36.199414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:36.199414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:36.199414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:19:36.199414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:36.212697 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 220/440] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:19:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:36.212987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61c674-d93e-4f96-a5cb-9adf8ee6e5de None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:36.213409 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61c674-d93e-4f96-a5cb-9adf8ee6e5de None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:36.213818 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61c674-d93e-4f96-a5cb-9adf8ee6e5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:36.245554 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9b61c674-d93e-4f96-a5cb-9adf8ee6e5de None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:36.247679 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9b61c674-d93e-4f96-a5cb-9adf8ee6e5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:36.263386 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37913f-a3cf-4ee4-9302-f69bbe6f7f16 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:36.325298 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180376f-93c5-4976-b9a2-9ae6e47f89b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:36.326887 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180376f-93c5-4976-b9a2-9ae6e47f89b0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:36.327457 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180376f-93c5-4976-b9a2-9ae6e47f89b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:36.327950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180376f-93c5-4976-b9a2-9ae6e47f89b0 None admin] PATH_INFO: `/v3/projects/4adbce25e8e4487caa00d740c3b88473` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:36.329417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180376f-93c5-4976-b9a2-9ae6e47f89b0 None admin] RBAC: Authorizing `identity:get_project(project_id=4adbce25e8e4487caa00d740c3b88473)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:36.330906 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180376f-93c5-4976-b9a2-9ae6e47f89b0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:36.333906 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 221/441] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:36 2022] GET /identity/v3/projects/4adbce25e8e4487caa00d740c3b88473 => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:36.334813 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180376f-93c5-4976-b9a2-9ae6e47f89b0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:36.358534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:36.365358 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 221/442] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:36.366690 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61c674-d93e-4f96-a5cb-9adf8ee6e5de None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:36.518686 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180376f-93c5-4976-b9a2-9ae6e47f89b0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:36.530206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:36.559551 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61c674-d93e-4f96-a5cb-9adf8ee6e5de None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:36.601464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9f6d8-09df-493c-8bf1-68084eb85f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:36.602112 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9f6d8-09df-493c-8bf1-68084eb85f07 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:36.602539 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9f6d8-09df-493c-8bf1-68084eb85f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:36.602892 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9f6d8-09df-493c-8bf1-68084eb85f07 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:36.603821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9f6d8-09df-493c-8bf1-68084eb85f07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:36.604038 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9f6d8-09df-493c-8bf1-68084eb85f07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:36.606620 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9f6d8-09df-493c-8bf1-68084eb85f07 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:36.624765 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 222/443] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:36.627170 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9f6d8-09df-493c-8bf1-68084eb85f07 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:36.633674 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d40f28-d47f-488b-8e17-7a23a72d7f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:36.634720 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d40f28-d47f-488b-8e17-7a23a72d7f86 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:36.635180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d40f28-d47f-488b-8e17-7a23a72d7f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:36.635640 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d40f28-d47f-488b-8e17-7a23a72d7f86 None admin] PATH_INFO: `/v3/groups/f8d5e262d5f44cabacb5a22407a74168` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:36.638585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d40f28-d47f-488b-8e17-7a23a72d7f86 None admin] RBAC: Authorizing `identity:get_group(group_id=f8d5e262d5f44cabacb5a22407a74168)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:36.641714 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d40f28-d47f-488b-8e17-7a23a72d7f86 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:36.643694 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 222/444] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:36 2022] GET /identity/v3/groups/f8d5e262d5f44cabacb5a22407a74168 => generated 226 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:36.650832 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d40f28-d47f-488b-8e17-7a23a72d7f86 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:36.754771 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:36.797191 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9f6d8-09df-493c-8bf1-68084eb85f07 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:36.806375 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d40f28-d47f-488b-8e17-7a23a72d7f86 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:36.841558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11119f4b-b086-4bbb-ad34-ef0395a2dcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:36.842072 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11119f4b-b086-4bbb-ad34-ef0395a2dcd6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:36.842567 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11119f4b-b086-4bbb-ad34-ef0395a2dcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:36.842744 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11119f4b-b086-4bbb-ad34-ef0395a2dcd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:36.856873 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d474711-1966-4aa0-8f87-40295d937c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:36.857423 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d474711-1966-4aa0-8f87-40295d937c63 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:36.857745 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d474711-1966-4aa0-8f87-40295d937c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:36.857973 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d474711-1966-4aa0-8f87-40295d937c63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:36.859237 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d474711-1966-4aa0-8f87-40295d937c63 None admin] RBAC: Adding query filter params (group.id=f8d5e262d5f44cabacb5a22407a74168, role.id=76a38a2307da45bcb511ef106076613d, scope.project.id=4adbce25e8e4487caa00d740c3b88473) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:36.859998 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d474711-1966-4aa0-8f87-40295d937c63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:36.861932 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d474711-1966-4aa0-8f87-40295d937c63 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:36.872714 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 223/445] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Sep 1 16:19:36 2022] GET /identity/v3/role_assignments?group.id=f8d5e262d5f44cabacb5a22407a74168&scope.project.id=4adbce25e8e4487caa00d740c3b88473&role.id=76a38a2307da45bcb511ef106076613d => generated 611 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:36.891642 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d474711-1966-4aa0-8f87-40295d937c63 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:36.927491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:36.958373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11119f4b-b086-4bbb-ad34-ef0395a2dcd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:36.961532 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11119f4b-b086-4bbb-ad34-ef0395a2dcd6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:37.046398 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d474711-1966-4aa0-8f87-40295d937c63 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:37.091978 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:37.126845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6375df-03c4-4d09-a0b1-e8d8dc8c8026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:37.127771 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6375df-03c4-4d09-a0b1-e8d8dc8c8026 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:37.128230 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6375df-03c4-4d09-a0b1-e8d8dc8c8026 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:37.129097 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6375df-03c4-4d09-a0b1-e8d8dc8c8026 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:37.144939 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6375df-03c4-4d09-a0b1-e8d8dc8c8026 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:37.146706 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 223/446] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:37.150732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-4b6375df-03c4-4d09-a0b1-e8d8dc8c8026 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:37.150732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:37.150732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:37.150732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:37.150732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:37.150732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:37.150732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:37.150732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:37.150732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:37.150732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:37.150732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:37.150732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:37.150732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:37.150732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:37.150732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:37.150732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:37.152026 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:37.152026 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:37.152026 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:37.152026 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:37.152026 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:37.152026 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:37.152026 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:37.152026 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:37.152026 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:37.152026 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:37.152026 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:37.152026 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:37.152026 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:37.152026 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:37.152026 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:37.152026 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:37.153874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:37.153874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:37.153874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:37.153874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:37.153874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:37.153874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:37.153874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:37.153874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:37.153874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:37.153874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:37.153874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:37.153874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:37.153874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 224/447] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 1 16:19:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:37.157948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11119f4b-b086-4bbb-ad34-ef0395a2dcd6 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:37.161172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6375df-03c4-4d09-a0b1-e8d8dc8c8026 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:37.306558 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:37.315106 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11119f4b-b086-4bbb-ad34-ef0395a2dcd6 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:37.346379 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6375df-03c4-4d09-a0b1-e8d8dc8c8026 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:37.382279 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bba89b-bbab-48b9-a830-c289aa942bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:37.383269 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bba89b-bbab-48b9-a830-c289aa942bee None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:37.383749 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bba89b-bbab-48b9-a830-c289aa942bee None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:37.384231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bba89b-bbab-48b9-a830-c289aa942bee None admin] PATH_INFO: `/v3/projects/3ac22d8b2a234cb4ae28b76d9f5e893d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:37.386357 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bba89b-bbab-48b9-a830-c289aa942bee None admin] RBAC: Authorizing `identity:get_project(project_id=3ac22d8b2a234cb4ae28b76d9f5e893d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:37.388229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f5ca1-5946-42f8-b7a5-5fb2f04ad809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:37.388876 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f5ca1-5946-42f8-b7a5-5fb2f04ad809 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:37.389091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bba89b-bbab-48b9-a830-c289aa942bee None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:37.389202 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f5ca1-5946-42f8-b7a5-5fb2f04ad809 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:37.389418 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f5ca1-5946-42f8-b7a5-5fb2f04ad809 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:37.390110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f5ca1-5946-42f8-b7a5-5fb2f04ad809 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:37.390968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f5ca1-5946-42f8-b7a5-5fb2f04ad809 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:37.392415 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f5ca1-5946-42f8-b7a5-5fb2f04ad809 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:37.392798 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 224/448] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:37 2022] GET /identity/v3/projects/3ac22d8b2a234cb4ae28b76d9f5e893d => generated 344 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:37.402013 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bba89b-bbab-48b9-a830-c289aa942bee None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:37.403137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 225/449] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:37.412351 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f5ca1-5946-42f8-b7a5-5fb2f04ad809 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:37.481339 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:37.545491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f5ca1-5946-42f8-b7a5-5fb2f04ad809 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:37.585951 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bba89b-bbab-48b9-a830-c289aa942bee None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:37.588058 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c03ef-2ba7-493e-a2a4-2ffb438b2dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:37.588918 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c03ef-2ba7-493e-a2a4-2ffb438b2dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:37.589193 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c03ef-2ba7-493e-a2a4-2ffb438b2dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:37.589636 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c03ef-2ba7-493e-a2a4-2ffb438b2dd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:37.604077 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:37.634636 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a11cdb-d862-4ff6-bf0d-f76ee2318341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:37.635322 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a11cdb-d862-4ff6-bf0d-f76ee2318341 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:37.635769 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a11cdb-d862-4ff6-bf0d-f76ee2318341 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:37.636213 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a11cdb-d862-4ff6-bf0d-f76ee2318341 None admin] PATH_INFO: `/v3/groups/6c164c0d27d940b89c9b632e65e846c3` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:37.638423 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a11cdb-d862-4ff6-bf0d-f76ee2318341 None admin] RBAC: Authorizing `identity:get_group(group_id=6c164c0d27d940b89c9b632e65e846c3)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:37.641601 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a11cdb-d862-4ff6-bf0d-f76ee2318341 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:37.649342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 225/450] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:37 2022] GET /identity/v3/groups/6c164c0d27d940b89c9b632e65e846c3 => generated 229 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:37.650702 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a11cdb-d862-4ff6-bf0d-f76ee2318341 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:37.684538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c03ef-2ba7-493e-a2a4-2ffb438b2dd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:37.686090 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c03ef-2ba7-493e-a2a4-2ffb438b2dd2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:37.767745 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a11cdb-d862-4ff6-bf0d-f76ee2318341 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:37.776201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:37.814057 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b2220-32d0-4cc1-a62a-6dc447e7f093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:37.814784 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b2220-32d0-4cc1-a62a-6dc447e7f093 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:37.815068 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b2220-32d0-4cc1-a62a-6dc447e7f093 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:37.815342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b2220-32d0-4cc1-a62a-6dc447e7f093 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:37.816109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b2220-32d0-4cc1-a62a-6dc447e7f093 None admin] RBAC: Adding query filter params (group.id=6c164c0d27d940b89c9b632e65e846c3, role.id=a8896546a02c42489ef73c7ad7c43542, scope.project.id=3ac22d8b2a234cb4ae28b76d9f5e893d) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:37.816422 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b2220-32d0-4cc1-a62a-6dc447e7f093 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:37.818079 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b2220-32d0-4cc1-a62a-6dc447e7f093 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:37.825610 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 226/451] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Sep 1 16:19:37 2022] GET /identity/v3/role_assignments?group.id=6c164c0d27d940b89c9b632e65e846c3&scope.project.id=3ac22d8b2a234cb4ae28b76d9f5e893d&role.id=a8896546a02c42489ef73c7ad7c43542 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:37.839915 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 226/452] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 16:19:37.846831 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b2220-32d0-4cc1-a62a-6dc447e7f093 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:37.985233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b2220-32d0-4cc1-a62a-6dc447e7f093 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:38.038767 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd854d89-71ca-4156-a62a-6c0c92363648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:38.039792 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd854d89-71ca-4156-a62a-6c0c92363648 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:38.040283 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd854d89-71ca-4156-a62a-6c0c92363648 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:38.040918 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd854d89-71ca-4156-a62a-6c0c92363648 None admin] PATH_INFO: `/v3/projects/4adbce25e8e4487caa00d740c3b88473` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:38.043008 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd854d89-71ca-4156-a62a-6c0c92363648 None admin] RBAC: Authorizing `identity:get_project(project_id=4adbce25e8e4487caa00d740c3b88473)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:38.045847 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd854d89-71ca-4156-a62a-6c0c92363648 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:38.050122 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 227/453] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:19:37 2022] GET /identity/v3/projects/4adbce25e8e4487caa00d740c3b88473 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:38.057059 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c03ef-2ba7-493e-a2a4-2ffb438b2dd2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:38.129624 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:38.202834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c03ef-2ba7-493e-a2a4-2ffb438b2dd2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:38.251288 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540e2da-ca0b-4157-9e02-50035beb9e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:38.252186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540e2da-ca0b-4157-9e02-50035beb9e94 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:38.252665 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540e2da-ca0b-4157-9e02-50035beb9e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:38.253151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540e2da-ca0b-4157-9e02-50035beb9e94 None admin] PATH_INFO: `/v3/groups/f8d5e262d5f44cabacb5a22407a74168` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:38.255219 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540e2da-ca0b-4157-9e02-50035beb9e94 None admin] RBAC: Authorizing `identity:get_group(group_id=f8d5e262d5f44cabacb5a22407a74168)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:38.257862 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540e2da-ca0b-4157-9e02-50035beb9e94 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:38.266297 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 227/454] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 1 16:19:38 2022] GET /identity/v3/groups/f8d5e262d5f44cabacb5a22407a74168 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:38.268019 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd854d89-71ca-4156-a62a-6c0c92363648 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:38.321642 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:38.404748 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd854d89-71ca-4156-a62a-6c0c92363648 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:38.443302 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7747d-489f-4a27-a672-1e4ba1745f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:38.444007 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7747d-489f-4a27-a672-1e4ba1745f83 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:38.444340 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7747d-489f-4a27-a672-1e4ba1745f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:38.444685 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7747d-489f-4a27-a672-1e4ba1745f83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:38.445624 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7747d-489f-4a27-a672-1e4ba1745f83 None admin] RBAC: Adding query filter params (group.id=f8d5e262d5f44cabacb5a22407a74168, role.id=f889b15cab8c46f58be00f84143aac60, scope.project.id=4adbce25e8e4487caa00d740c3b88473) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:38.445982 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7747d-489f-4a27-a672-1e4ba1745f83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:38.447592 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7747d-489f-4a27-a672-1e4ba1745f83 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:38.454959 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 228/455] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Sep 1 16:19:38 2022] GET /identity/v3/role_assignments?group.id=f8d5e262d5f44cabacb5a22407a74168&scope.project.id=4adbce25e8e4487caa00d740c3b88473&role.id=f889b15cab8c46f58be00f84143aac60 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:41.680480 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590629e9-a391-4b45-a6db-522ff9e660f5 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:41.681394 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590629e9-a391-4b45-a6db-522ff9e660f5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:41.681863 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590629e9-a391-4b45-a6db-522ff9e660f5 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:41.683444 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 228/456] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:19:41.690479 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f54f91-e562-4bf4-8db1-68c8b52264e9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:41.691351 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f54f91-e562-4bf4-8db1-68c8b52264e9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:41.691807 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f54f91-e562-4bf4-8db1-68c8b52264e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:41.713335 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-20f54f91-e562-4bf4-8db1-68c8b52264e9 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:41.714861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-20f54f91-e562-4bf4-8db1-68c8b52264e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:41.818678 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 229/457] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:19:41.940722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d8a9c-181e-4cea-8418-b925e648491b None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:41.941280 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d8a9c-181e-4cea-8418-b925e648491b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:41.941825 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d8a9c-181e-4cea-8418-b925e648491b None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:41.943608 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 229/458] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:41.961239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6837bf-d3f6-4bdd-86a9-7b3a3499c2a9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:41.961525 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6837bf-d3f6-4bdd-86a9-7b3a3499c2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:41.961806 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6837bf-d3f6-4bdd-86a9-7b3a3499c2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:41.990631 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8a6837bf-d3f6-4bdd-86a9-7b3a3499c2a9 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:41.991865 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8a6837bf-d3f6-4bdd-86a9-7b3a3499c2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:42.030251 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:42.103517 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 230/459] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:42.200769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57aa073-2b0b-47a5-8d72-ef546ada0057 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:42.200769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57aa073-2b0b-47a5-8d72-ef546ada0057 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:42.200769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57aa073-2b0b-47a5-8d72-ef546ada0057 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:42.201362 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 230/460] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:42.206779 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895c298-38e4-47db-869a-f5a4b094eecb None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:42.207067 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895c298-38e4-47db-869a-f5a4b094eecb None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:42.207347 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895c298-38e4-47db-869a-f5a4b094eecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:42.235099 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-7895c298-38e4-47db-869a-f5a4b094eecb None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:42.236337 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7895c298-38e4-47db-869a-f5a4b094eecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:42.345177 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 231/461] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:42.403319 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57aa073-2b0b-47a5-8d72-ef546ada0057 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:42.559535 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895c298-38e4-47db-869a-f5a4b094eecb None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:42.569961 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57aa073-2b0b-47a5-8d72-ef546ada0057 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:42.585673 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:42.653582 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961b976-dfd1-4189-9476-9a87e449ab41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:42.654278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961b976-dfd1-4189-9476-9a87e449ab41 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:42.654559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961b976-dfd1-4189-9476-9a87e449ab41 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:42.654836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961b976-dfd1-4189-9476-9a87e449ab41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:42.668026 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961b976-dfd1-4189-9476-9a87e449ab41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:42.670103 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961b976-dfd1-4189-9476-9a87e449ab41 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:42.701612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-d961b976-dfd1-4189-9476-9a87e449ab41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:42.701612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:42.701612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:42.701612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:42.701612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:42.701612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:42.701612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:42.701612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:42.701612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:42.701612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:42.701612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:42.701612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:42.701612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:42.701612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:42.701612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:42.701612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:42.703185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:42.703185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:42.703185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:42.703185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:42.703185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:42.703185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:42.703185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:42.703185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:42.703185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:42.703185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:42.703185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:42.703185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:42.703185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:42.703185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:42.703185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:42.703185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:42.703185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:42.704235 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:42.704235 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:42.704235 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:42.706682 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 231/462] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:42.713341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961b976-dfd1-4189-9476-9a87e449ab41 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:42.795046 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:42.816704 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895c298-38e4-47db-869a-f5a4b094eecb None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:42.888515 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806df00-d96d-4d1c-967b-e1b645bba2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:42.889834 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806df00-d96d-4d1c-967b-e1b645bba2c1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:42.890989 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806df00-d96d-4d1c-967b-e1b645bba2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:42.892061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806df00-d96d-4d1c-967b-e1b645bba2c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:42.907764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806df00-d96d-4d1c-967b-e1b645bba2c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:42.910683 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806df00-d96d-4d1c-967b-e1b645bba2c1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:42.916304 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961b976-dfd1-4189-9476-9a87e449ab41 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:42.931406 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-f806df00-d96d-4d1c-967b-e1b645bba2c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:42.931406 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:42.931406 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:42.931406 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:42.931406 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:42.931406 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:42.931406 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:42.931406 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:42.931406 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:42.931406 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:42.931406 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:42.931406 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:42.931406 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:42.931406 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:42.931406 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:42.931406 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:42.932404 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:42.932404 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:42.932404 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:42.932404 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:42.932404 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:42.932404 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:42.932404 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:42.932404 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:42.932404 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:42.932404 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:42.932404 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:42.932404 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:42.932404 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:42.932404 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:42.932404 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:42.932404 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:42.932404 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:42.933303 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:42.933303 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:42.933303 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:42.933303 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 232/463] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:19:42.934768 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1bda3-2829-4534-9894-feda19005349 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:42.935283 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1bda3-2829-4534-9894-feda19005349 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:42.935751 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1bda3-2829-4534-9894-feda19005349 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:42.938362 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 233/464] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:42.939461 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1bda3-2829-4534-9894-feda19005349 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:42.966375 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02782cb6-0864-4580-a088-150c111b02ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:42.966994 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02782cb6-0864-4580-a088-150c111b02ca None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:42.967267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02782cb6-0864-4580-a088-150c111b02ca None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:42.967537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02782cb6-0864-4580-a088-150c111b02ca None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:42.968225 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02782cb6-0864-4580-a088-150c111b02ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:42.968529 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02782cb6-0864-4580-a088-150c111b02ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:42.969990 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02782cb6-0864-4580-a088-150c111b02ca None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:42.987646 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 232/465] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:42.987646 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02782cb6-0864-4580-a088-150c111b02ca None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:43.016368 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:43.077207 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1bda3-2829-4534-9894-feda19005349 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:43.122894 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801ffae-4829-4891-a5d5-80bd59358f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:43.123846 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801ffae-4829-4891-a5d5-80bd59358f7b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:43.124189 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02782cb6-0864-4580-a088-150c111b02ca None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:43.124502 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801ffae-4829-4891-a5d5-80bd59358f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:43.124965 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801ffae-4829-4891-a5d5-80bd59358f7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:43.138791 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801ffae-4829-4891-a5d5-80bd59358f7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:43.140949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801ffae-4829-4891-a5d5-80bd59358f7b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:43.144932 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:43.161689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-2801ffae-4829-4891-a5d5-80bd59358f7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:43.161689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:43.161689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:43.161689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:43.161689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:43.161689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:43.161689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:43.161689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:43.161689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:43.161689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:43.161689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:43.161689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:43.161689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:43.161689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:43.161689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:43.161689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:43.162701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:43.162701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:43.162701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:43.162701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:43.162701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:43.162701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:43.162701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:43.162701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:43.162701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:43.162701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:43.162701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:43.162701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:43.162701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:43.162701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:43.162701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:43.162701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:43.162701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:43.163530 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:43.163530 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:43.163530 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:43.163530 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 234/466] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:43.164700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492becc-42ba-44f4-89d8-e6e20519a69a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:43.164989 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492becc-42ba-44f4-89d8-e6e20519a69a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:43.165308 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492becc-42ba-44f4-89d8-e6e20519a69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:43.190040 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b19771-5f08-4b7e-a101-2c468f42dc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:43.191061 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b19771-5f08-4b7e-a101-2c468f42dc9d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:43.191386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b19771-5f08-4b7e-a101-2c468f42dc9d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:43.191813 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b19771-5f08-4b7e-a101-2c468f42dc9d None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:43.193001 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b19771-5f08-4b7e-a101-2c468f42dc9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:43.193503 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b19771-5f08-4b7e-a101-2c468f42dc9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:43.195990 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b19771-5f08-4b7e-a101-2c468f42dc9d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:43.196757 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9492becc-42ba-44f4-89d8-e6e20519a69a None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:43.198859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9492becc-42ba-44f4-89d8-e6e20519a69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:43.223173 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 233/467] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:43.223173 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b19771-5f08-4b7e-a101-2c468f42dc9d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:43.334740 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 235/468] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:43.336297 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492becc-42ba-44f4-89d8-e6e20519a69a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:43.392557 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:43.431658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b19771-5f08-4b7e-a101-2c468f42dc9d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:43.503050 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c677bf-bf4f-4112-9cc0-43e906fdd52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:43.504322 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c677bf-bf4f-4112-9cc0-43e906fdd52c None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:43.504965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c677bf-bf4f-4112-9cc0-43e906fdd52c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:43.505573 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c677bf-bf4f-4112-9cc0-43e906fdd52c None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:43.506924 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c677bf-bf4f-4112-9cc0-43e906fdd52c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:43.509949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c677bf-bf4f-4112-9cc0-43e906fdd52c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:43.555140 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 234/469] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 1 16:19:43 2022] POST /identity/v3/users => generated 248 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:19:43.557769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c677bf-bf4f-4112-9cc0-43e906fdd52c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:43.567084 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492becc-42ba-44f4-89d8-e6e20519a69a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:43.669290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:43.703487 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a5346-330a-4daa-b29a-ff2859364895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:43.704304 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a5346-330a-4daa-b29a-ff2859364895 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:43.704802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a5346-330a-4daa-b29a-ff2859364895 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:43.705369 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a5346-330a-4daa-b29a-ff2859364895 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:43.706264 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a5346-330a-4daa-b29a-ff2859364895 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:43.706776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a5346-330a-4daa-b29a-ff2859364895 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:43.709471 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a5346-330a-4daa-b29a-ff2859364895 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:43.738465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 236/470] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:43.740039 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a5346-330a-4daa-b29a-ff2859364895 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:43.854928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c677bf-bf4f-4112-9cc0-43e906fdd52c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:43.908003 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9dfb06-0bce-4fa6-8eea-868c987e6768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:43.908738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9dfb06-0bce-4fa6-8eea-868c987e6768 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:43.908952 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9dfb06-0bce-4fa6-8eea-868c987e6768 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:43.909242 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9dfb06-0bce-4fa6-8eea-868c987e6768 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:43.909909 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9dfb06-0bce-4fa6-8eea-868c987e6768 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:43.911510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9dfb06-0bce-4fa6-8eea-868c987e6768 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:43.921729 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:43.929356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a5346-330a-4daa-b29a-ff2859364895 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:43.943802 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 235/471] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 1 16:19:43 2022] POST /identity/v3/users => generated 246 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:19:43.944754 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9dfb06-0bce-4fa6-8eea-868c987e6768 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:44.001487 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643d6af-ad65-471c-838b-3ab32c568bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:44.002231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643d6af-ad65-471c-838b-3ab32c568bae None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:44.002522 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643d6af-ad65-471c-838b-3ab32c568bae None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:44.002803 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643d6af-ad65-471c-838b-3ab32c568bae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:44.019591 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643d6af-ad65-471c-838b-3ab32c568bae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:44.021429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643d6af-ad65-471c-838b-3ab32c568bae None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:44.042718 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-8643d6af-ad65-471c-838b-3ab32c568bae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:44.042718 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:44.042718 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:44.042718 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:44.042718 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:44.042718 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:44.042718 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:44.042718 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:44.042718 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:44.042718 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:44.042718 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:44.042718 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:44.042718 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:44.042718 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:44.042718 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:44.042718 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:44.044482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:44.044482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:44.044482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:44.044482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:44.044482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:44.044482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:44.044482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:44.044482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:44.044482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:44.044482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:44.044482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:44.044482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:44.044482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:44.044482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:44.044482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:44.044482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:44.044482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:44.046006 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:44.046006 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:44.046006 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:44.046006 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 237/472] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:44.046006 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941093d-305a-4953-b478-d4df54b69afa None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:44.046006 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941093d-305a-4953-b478-d4df54b69afa None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:44.047192 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941093d-305a-4953-b478-d4df54b69afa None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:44.048511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 238/473] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:44.056469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941093d-305a-4953-b478-d4df54b69afa None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:44.120594 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:44.180559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9dfb06-0bce-4fa6-8eea-868c987e6768 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:44.220605 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941093d-305a-4953-b478-d4df54b69afa None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:44.238689 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9231d-79f4-4f31-af3e-2e5c90fc4dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:44.239419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9231d-79f4-4f31-af3e-2e5c90fc4dcf None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:44.239776 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9231d-79f4-4f31-af3e-2e5c90fc4dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:44.240065 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9231d-79f4-4f31-af3e-2e5c90fc4dcf None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:44.240783 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9231d-79f4-4f31-af3e-2e5c90fc4dcf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:44.242358 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9231d-79f4-4f31-af3e-2e5c90fc4dcf None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:44.272107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 236/474] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 1 16:19:43 2022] POST /identity/v3/users => generated 248 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:19:44.273732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ea826-8bbe-407c-8601-91e5c1ec5a05 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:44.274261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ea826-8bbe-407c-8601-91e5c1ec5a05 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:44.274590 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ea826-8bbe-407c-8601-91e5c1ec5a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:44.275488 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558af9d-d2b6-46a4-99a7-c9fb5c1ef1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:44.276405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558af9d-d2b6-46a4-99a7-c9fb5c1ef1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:44.276955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558af9d-d2b6-46a4-99a7-c9fb5c1ef1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:44.277565 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558af9d-d2b6-46a4-99a7-c9fb5c1ef1f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:44.278481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0558af9d-d2b6-46a4-99a7-c9fb5c1ef1f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:44.279016 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0558af9d-d2b6-46a4-99a7-c9fb5c1ef1f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:44.281427 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0558af9d-d2b6-46a4-99a7-c9fb5c1ef1f0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:44.297778 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c98ea826-8bbe-407c-8601-91e5c1ec5a05 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:44.299416 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c98ea826-8bbe-407c-8601-91e5c1ec5a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:44.301416 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 239/475] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:44.310318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558af9d-d2b6-46a4-99a7-c9fb5c1ef1f0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:44.390560 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:44.446233 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 237/476] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:44.471223 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:44.477035 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558af9d-d2b6-46a4-99a7-c9fb5c1ef1f0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:44.529574 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7b4c0-abf6-44ea-a976-cf19c9241ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:44.530219 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7b4c0-abf6-44ea-a976-cf19c9241ed3 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:44.530501 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7b4c0-abf6-44ea-a976-cf19c9241ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:44.530831 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7b4c0-abf6-44ea-a976-cf19c9241ed3 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:44.531591 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7b4c0-abf6-44ea-a976-cf19c9241ed3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:44.533151 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7b4c0-abf6-44ea-a976-cf19c9241ed3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:44.562454 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 240/477] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 1 16:19:44 2022] POST /identity/v3/users => generated 249 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:19:44.888992 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ea826-8bbe-407c-8601-91e5c1ec5a05 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:45.024126 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ea826-8bbe-407c-8601-91e5c1ec5a05 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:45.072281 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604a0e2-5088-4997-8757-b2e872ec4996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:45.072954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604a0e2-5088-4997-8757-b2e872ec4996 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:45.073240 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604a0e2-5088-4997-8757-b2e872ec4996 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:45.073546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604a0e2-5088-4997-8757-b2e872ec4996 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:45.074251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604a0e2-5088-4997-8757-b2e872ec4996 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:45.075960 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604a0e2-5088-4997-8757-b2e872ec4996 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:45.088250 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.sql.core [None req-e604a0e2-5088-4997-8757-b2e872ec4996 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 16:19:45.088250 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 16:19:45.088250 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [parameters: {'id': '1c40231130f346769cb5374edb8771a9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 16:19:45.088250 dv-cinder-852209-10-smb devstack@keystone.service[81459]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81459) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 16:19:45.111008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-e604a0e2-5088-4997-8757-b2e872ec4996 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 16:19:45.111008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:45.111008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 16:19:45.111008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 16:19:45.111008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 16:19:45.111008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 16:19:45.111008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 16:19:45.111008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 16:19:45.111008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 16:19:45.111008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application conn.query(q) Sep 01 16:19:45.111008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 16:19:45.111008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 16:19:45.111008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 16:19:45.111008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application result.read() Sep 01 16:19:45.111008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 16:19:45.112781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 16:19:45.112781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 16:19:45.112781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 16:19:45.112781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 16:19:45.112781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 16:19:45.112781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 16:19:45.112781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 16:19:45.112781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 16:19:45.112781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:45.112781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 16:19:45.112781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:45.112781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:45.112781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 16:19:45.112781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 16:19:45.112781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 01 16:19:45.112781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return ref.to_dict() Sep 01 16:19:45.112781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 16:19:45.112781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application next(self.gen) Sep 01 16:19:45.114575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 16:19:45.114575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application yield resource Sep 01 16:19:45.114575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 16:19:45.114575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application next(self.gen) Sep 01 16:19:45.114575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 16:19:45.114575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 16:19:45.114575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 16:19:45.114575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 16:19:45.114575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 16:19:45.114575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise self.value Sep 01 16:19:45.114575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 16:19:45.114575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 16:19:45.114575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 16:19:45.114575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application session.commit() Sep 01 16:19:45.114575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 16:19:45.114575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 16:19:45.114575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 16:19:45.116251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 16:19:45.116251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 16:19:45.116251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self.session.flush() Sep 01 16:19:45.116251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 16:19:45.116251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 16:19:45.116251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 16:19:45.116251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 16:19:45.116251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 16:19:45.116251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application compat.raise_( Sep 01 16:19:45.116251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 16:19:45.116251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception Sep 01 16:19:45.116251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 16:19:45.116251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 16:19:45.116251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 16:19:45.116251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 16:19:45.116251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 16:19:45.116251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 16:19:45.120523 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 16:19:45.120523 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 16:19:45.120523 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 16:19:45.120523 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 16:19:45.120523 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 16:19:45.120523 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 16:19:45.120523 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 16:19:45.120523 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 16:19:45.120523 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 16:19:45.120523 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 16:19:45.120523 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 16:19:45.120523 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 16:19:45.120523 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 16:19:45.120523 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 16:19:45.120523 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 16:19:45.120523 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception Sep 01 16:19:45.123751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 16:19:45.123751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 16:19:45.123751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 16:19:45.123751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 16:19:45.123751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 16:19:45.123751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 16:19:45.123751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 16:19:45.123751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application conn.query(q) Sep 01 16:19:45.123751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 16:19:45.123751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 16:19:45.123751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 16:19:45.123751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application result.read() Sep 01 16:19:45.123751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 16:19:45.123751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 16:19:45.123751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 16:19:45.123751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 16:19:45.133698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 16:19:45.133698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 16:19:45.133698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 16:19:45.133698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 16:19:45.133698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 16:19:45.133698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 16:19:45.133698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [parameters: {'id': '1c40231130f346769cb5374edb8771a9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 16:19:45.133698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 16:19:45.133698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:45.133698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:19:45.133698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:45.133698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:45.133698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:45.133698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:45.133698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:45.133698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:45.136966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:45.136966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:45.136966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:45.136966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:45.136966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:45.136966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:45.136966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 01 16:19:45.136966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 01 16:19:45.136966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:45.136966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:45.136966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 01 16:19:45.136966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 01 16:19:45.136966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 16:19:45.136966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 16:19:45.136966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 16:19:45.136966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:45.140562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 238/478] 10.222.0.52 () {60 vars in 1131 bytes} [Thu Sep 1 16:19:44 2022] POST /identity/v3/roles => generated 144 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:45.140867 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7b4c0-abf6-44ea-a976-cf19c9241ed3 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:45.256756 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7b4c0-abf6-44ea-a976-cf19c9241ed3 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:45.297251 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910acc51-b212-4287-bb89-6d362d7e74aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:45.297921 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910acc51-b212-4287-bb89-6d362d7e74aa None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:45.298204 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910acc51-b212-4287-bb89-6d362d7e74aa None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:45.298461 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910acc51-b212-4287-bb89-6d362d7e74aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:45.311176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910acc51-b212-4287-bb89-6d362d7e74aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:45.316862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-910acc51-b212-4287-bb89-6d362d7e74aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:45.316862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:45.316862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:45.316862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:45.316862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:45.316862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:45.316862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:45.316862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:45.316862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:45.316862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:45.316862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:45.316862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:45.316862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:45.316862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:45.316862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:45.316862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:45.319519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:45.319519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:45.319519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:45.319519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:45.319519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:45.319519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:45.319519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:45.319519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:45.319519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:45.319519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:45.319519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:45.319519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:45.319519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:45.319519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:45.319519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:45.319519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:45.321292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:45.321292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:45.321292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:45.321292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:45.321292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:45.321292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:45.321292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:45.321292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:45.321292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:45.321292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:45.321292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:19:45.321292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:45.321292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 241/479] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 1 16:19:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:45.326112 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604a0e2-5088-4997-8757-b2e872ec4996 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:45.393753 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:45.510294 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604a0e2-5088-4997-8757-b2e872ec4996 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:45.592400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048ef96-2bdc-4db1-a878-a22295da2c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:45.594590 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048ef96-2bdc-4db1-a878-a22295da2c4a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:45.595386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048ef96-2bdc-4db1-a878-a22295da2c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:45.597224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048ef96-2bdc-4db1-a878-a22295da2c4a None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:45.599868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048ef96-2bdc-4db1-a878-a22295da2c4a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:45.600955 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048ef96-2bdc-4db1-a878-a22295da2c4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:45.605937 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048ef96-2bdc-4db1-a878-a22295da2c4a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:45.623772 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 239/480] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:46.953366 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460b41d-3433-449e-8f71-358f090448c5 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:46.954202 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460b41d-3433-449e-8f71-358f090448c5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:46.954338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460b41d-3433-449e-8f71-358f090448c5 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:46.957221 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 242/481] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:46.963720 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85b61e-b05d-4947-bcc7-26ecafc51934 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:46.964474 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85b61e-b05d-4947-bcc7-26ecafc51934 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:46.964691 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85b61e-b05d-4947-bcc7-26ecafc51934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:47.008714 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4a85b61e-b05d-4947-bcc7-26ecafc51934 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:47.010772 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4a85b61e-b05d-4947-bcc7-26ecafc51934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:47.154157 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 240/482] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:47.302231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e4319-f1a6-48d0-a47a-a2ba454bb5b5 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:47.302698 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e4319-f1a6-48d0-a47a-a2ba454bb5b5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:47.303038 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e4319-f1a6-48d0-a47a-a2ba454bb5b5 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:47.306034 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 243/483] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:47.311730 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba412c-bb74-4da4-b617-27510e1d5c28 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:47.312139 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba412c-bb74-4da4-b617-27510e1d5c28 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:47.312330 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba412c-bb74-4da4-b617-27510e1d5c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:47.341955 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f2ba412c-bb74-4da4-b617-27510e1d5c28 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:47.343821 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f2ba412c-bb74-4da4-b617-27510e1d5c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:47.383985 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:47.446886 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 241/484] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:19:47.742598 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e4319-f1a6-48d0-a47a-a2ba454bb5b5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:47.772474 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:47.932657 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba412c-bb74-4da4-b617-27510e1d5c28 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:47.945694 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e4319-f1a6-48d0-a47a-a2ba454bb5b5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:48.005492 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba08af-3817-416b-aed7-09798c09297d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:48.006119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba08af-3817-416b-aed7-09798c09297d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:48.006334 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba08af-3817-416b-aed7-09798c09297d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:48.006590 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba08af-3817-416b-aed7-09798c09297d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:48.019932 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba08af-3817-416b-aed7-09798c09297d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:48.025824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-c2ba08af-3817-416b-aed7-09798c09297d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:48.025824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:48.025824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:48.025824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:48.025824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:48.025824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:48.025824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:48.025824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:48.025824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:48.025824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:48.025824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:48.025824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:48.025824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:48.025824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:48.025824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:48.025824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:48.026800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:48.026800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:48.026800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:48.026800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:48.026800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:48.026800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:48.026800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:48.026800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:48.026800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:48.026800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:48.026800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:48.026800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:48.026800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:48.026800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:48.026800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:48.026800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:48.027589 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:48.027589 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:48.027589 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:48.027589 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:48.027589 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:48.027589 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:48.027589 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:48.027589 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:48.027589 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:48.027589 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:48.027589 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:48.027589 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:48.027589 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 244/485] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 1 16:19:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:48.029761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8300cff-d93e-4cc3-8e13-376d667748a3 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:48.029761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8300cff-d93e-4cc3-8e13-376d667748a3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:48.029761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8300cff-d93e-4cc3-8e13-376d667748a3 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:48.031232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 245/486] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:48.041707 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc81009-4731-4a80-b87b-f531172af2ae None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:48.042267 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc81009-4731-4a80-b87b-f531172af2ae None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:48.042693 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc81009-4731-4a80-b87b-f531172af2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:48.073782 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-0dc81009-4731-4a80-b87b-f531172af2ae None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:48.075033 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0dc81009-4731-4a80-b87b-f531172af2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:48.133086 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba412c-bb74-4da4-b617-27510e1d5c28 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:48.173031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 246/487] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:48.173972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc81009-4731-4a80-b87b-f531172af2ae None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:48.178265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:48.204902 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b876ad-0885-4a2b-b075-e60957f18bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:48.206380 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b876ad-0885-4a2b-b075-e60957f18bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:48.207065 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b876ad-0885-4a2b-b075-e60957f18bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:48.208755 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b876ad-0885-4a2b-b075-e60957f18bc0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:48.238468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b876ad-0885-4a2b-b075-e60957f18bc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:48.253192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-82b876ad-0885-4a2b-b075-e60957f18bc0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:48.253192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:48.253192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:48.253192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:48.253192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:48.253192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:48.253192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:48.253192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:48.253192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:48.253192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:48.253192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:48.253192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:48.253192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:48.253192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:48.253192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:48.253192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:48.255315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:48.255315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:48.255315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:48.255315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:48.255315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:48.255315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:48.255315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:48.255315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:48.255315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:48.255315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:48.255315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:48.255315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:48.255315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:48.255315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:48.255315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:48.255315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:48.257104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:48.257104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:48.257104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:48.257104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:48.257104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:48.257104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:48.257104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:48.257104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:48.257104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:48.257104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:48.257104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:48.257104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:48.262587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 242/488] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 1 16:19:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:48.265647 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a5f32-3e10-4e58-bed7-46ee6e5f5e46 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:48.266328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a5f32-3e10-4e58-bed7-46ee6e5f5e46 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:48.266985 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a5f32-3e10-4e58-bed7-46ee6e5f5e46 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:48.275838 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 243/489] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:48.275838 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a5f32-3e10-4e58-bed7-46ee6e5f5e46 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:48.335189 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc81009-4731-4a80-b87b-f531172af2ae None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:48.341264 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:48.384698 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebcf22-d417-4df4-a015-fdf0d021100c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:48.385744 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebcf22-d417-4df4-a015-fdf0d021100c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:48.386233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebcf22-d417-4df4-a015-fdf0d021100c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:48.386926 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebcf22-d417-4df4-a015-fdf0d021100c None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:48.388020 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebcf22-d417-4df4-a015-fdf0d021100c None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:48.388545 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebcf22-d417-4df4-a015-fdf0d021100c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:48.391398 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebcf22-d417-4df4-a015-fdf0d021100c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:48.407414 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 247/490] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 1 16:19:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:48.409459 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b044d6-1ea3-465f-bf99-2c977f934e35 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:48.410014 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b044d6-1ea3-465f-bf99-2c977f934e35 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:48.410549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b044d6-1ea3-465f-bf99-2c977f934e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:48.432278 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a0b044d6-1ea3-465f-bf99-2c977f934e35 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:48.433949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a0b044d6-1ea3-465f-bf99-2c977f934e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:48.487646 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a5f32-3e10-4e58-bed7-46ee6e5f5e46 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:48.535664 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:48.546967 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 248/491] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:48.548283 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b044d6-1ea3-465f-bf99-2c977f934e35 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:48.581428 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805ceea-6177-402c-901f-31bcc6e56d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:48.582412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805ceea-6177-402c-901f-31bcc6e56d98 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:48.583794 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805ceea-6177-402c-901f-31bcc6e56d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:48.584286 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805ceea-6177-402c-901f-31bcc6e56d98 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:48.586080 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805ceea-6177-402c-901f-31bcc6e56d98 None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:48.586905 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805ceea-6177-402c-901f-31bcc6e56d98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:48.590301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805ceea-6177-402c-901f-31bcc6e56d98 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:48.608305 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 244/492] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 1 16:19:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:48.623443 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805ceea-6177-402c-901f-31bcc6e56d98 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:48.803566 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b044d6-1ea3-465f-bf99-2c977f934e35 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:48.819591 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:48.857133 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805ceea-6177-402c-901f-31bcc6e56d98 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:48.891522 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fb536-ed63-4c41-aa0a-061025d7aa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:48.894503 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fb536-ed63-4c41-aa0a-061025d7aa51 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:48.895384 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fb536-ed63-4c41-aa0a-061025d7aa51 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:48.896215 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fb536-ed63-4c41-aa0a-061025d7aa51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:48.918406 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fb536-ed63-4c41-aa0a-061025d7aa51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:48.922657 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fb536-ed63-4c41-aa0a-061025d7aa51 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:48.935400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611008e0-0aac-469f-9cd7-f3ead627e60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:48.936321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611008e0-0aac-469f-9cd7-f3ead627e60a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:48.937298 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611008e0-0aac-469f-9cd7-f3ead627e60a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:48.937700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611008e0-0aac-469f-9cd7-f3ead627e60a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:48.957120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-992fb536-ed63-4c41-aa0a-061025d7aa51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:48.957120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:48.957120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:48.957120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:48.957120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:48.957120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:48.957120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:48.957120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:48.957120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:48.957120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:48.957120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:48.957120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:48.957120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:48.957120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:48.957120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:48.957120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:48.959025 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:48.959025 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:48.959025 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:48.959025 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:48.959025 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:48.959025 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:48.959025 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:48.959025 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:48.959025 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:48.959025 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:48.959025 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:48.959025 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:48.959025 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:48.959025 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:48.959025 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:48.959025 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:48.959025 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:48.960662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:48.960662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:48.960662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:48.961002 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611008e0-0aac-469f-9cd7-f3ead627e60a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:48.962187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611008e0-0aac-469f-9cd7-f3ead627e60a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:48.964723 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 249/493] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:48.973739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fb536-ed63-4c41-aa0a-061025d7aa51 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:48.991509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-611008e0-0aac-469f-9cd7-f3ead627e60a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:48.991509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:48.991509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:48.991509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:48.991509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:48.991509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:48.991509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:48.991509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:48.991509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:48.991509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:48.991509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:48.991509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:48.991509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:48.991509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:48.991509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:48.991509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:48.993346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:48.993346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:48.993346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:48.993346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:48.993346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:48.993346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:48.993346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:48.993346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:48.993346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:48.993346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:48.993346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:48.993346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:48.993346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:48.993346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:48.993346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:48.993346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:48.993346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:48.994616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:48.994616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:48.994616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:48.994616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 245/494] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:19:48.995711 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611008e0-0aac-469f-9cd7-f3ead627e60a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:49.087349 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:49.166263 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611008e0-0aac-469f-9cd7-f3ead627e60a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:49.199851 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fb536-ed63-4c41-aa0a-061025d7aa51 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:49.231725 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8de21-06bb-4835-9950-13706bff4842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:49.232958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8de21-06bb-4835-9950-13706bff4842 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:49.233580 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8de21-06bb-4835-9950-13706bff4842 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:49.234071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8de21-06bb-4835-9950-13706bff4842 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:49.235254 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8de21-06bb-4835-9950-13706bff4842 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:49.236046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8de21-06bb-4835-9950-13706bff4842 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:49.238136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8de21-06bb-4835-9950-13706bff4842 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:49.241689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8756b0-1411-4ac1-a7a7-3dbb4bf96d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:49.242341 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8756b0-1411-4ac1-a7a7-3dbb4bf96d59 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:49.243308 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8756b0-1411-4ac1-a7a7-3dbb4bf96d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:49.243308 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8756b0-1411-4ac1-a7a7-3dbb4bf96d59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:49.257314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:49.257724 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8756b0-1411-4ac1-a7a7-3dbb4bf96d59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:49.263148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-cf8756b0-1411-4ac1-a7a7-3dbb4bf96d59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:49.263148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:49.263148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:49.263148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:49.263148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:49.263148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:49.263148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:49.263148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:49.263148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:49.263148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:49.263148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:49.263148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:49.263148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:49.263148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:49.263148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:49.263148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:49.273348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:49.273348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:49.273348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:49.273348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:49.273348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:49.273348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:49.273348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:49.273348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:49.273348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:49.273348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:49.273348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:49.273348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:49.273348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:49.273348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:49.273348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:49.273348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:49.274900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:49.274900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:49.274900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:49.274900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:49.274900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:49.274900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:49.274900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:49.274900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:49.274900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:49.274900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:49.274900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:49.274900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:49.276026 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 246/495] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:49.276168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 250/496] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 1 16:19:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:49.276168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8756b0-1411-4ac1-a7a7-3dbb4bf96d59 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:49.276402 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8de21-06bb-4835-9950-13706bff4842 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:49.404575 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8756b0-1411-4ac1-a7a7-3dbb4bf96d59 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:49.415833 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:49.422247 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8de21-06bb-4835-9950-13706bff4842 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:49.445727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc696b3-61a9-46fc-af41-6950097e5523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:49.446376 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc696b3-61a9-46fc-af41-6950097e5523 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:49.446655 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc696b3-61a9-46fc-af41-6950097e5523 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:49.446924 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc696b3-61a9-46fc-af41-6950097e5523 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:49.459443 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc696b3-61a9-46fc-af41-6950097e5523 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:49.465102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-cdc696b3-61a9-46fc-af41-6950097e5523 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:49.465102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:49.465102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:49.465102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:49.465102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:49.465102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:49.465102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:49.465102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:49.465102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:49.465102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:49.465102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:49.465102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:49.465102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:49.465102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:49.465102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:49.465102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:49.466962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:49.466962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:49.466962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:49.466962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:49.466962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:49.466962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:49.466962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:49.466962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:49.466962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:49.466962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:49.466962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:49.466962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:49.466962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:49.466962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:49.466962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:49.466962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:49.469091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:49.469091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:49.469091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:49.469091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:49.469091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:49.469091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:49.469091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:49.469091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:49.469091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:49.469091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:49.469091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:49.469091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:49.469091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 251/497] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 1 16:19:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:49.469091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc696b3-61a9-46fc-af41-6950097e5523 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:49.481493 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f0576-48d5-4713-bb9f-491b234e9f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:49.482109 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f0576-48d5-4713-bb9f-491b234e9f08 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:49.482387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f0576-48d5-4713-bb9f-491b234e9f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:49.482658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f0576-48d5-4713-bb9f-491b234e9f08 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:49.483344 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f0576-48d5-4713-bb9f-491b234e9f08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:49.484179 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f0576-48d5-4713-bb9f-491b234e9f08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:49.485668 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f0576-48d5-4713-bb9f-491b234e9f08 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:49.501553 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 247/498] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:49.502650 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f0576-48d5-4713-bb9f-491b234e9f08 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:49.589738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:49.626480 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc696b3-61a9-46fc-af41-6950097e5523 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:49.649793 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f0576-48d5-4713-bb9f-491b234e9f08 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:49.672491 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb58ee1-1688-40bc-9091-6e7e4f8e8cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:49.673082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb58ee1-1688-40bc-9091-6e7e4f8e8cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:49.673362 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb58ee1-1688-40bc-9091-6e7e4f8e8cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:49.673632 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb58ee1-1688-40bc-9091-6e7e4f8e8cc1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:49.682231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb58ee1-1688-40bc-9091-6e7e4f8e8cc1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:49.683748 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb58ee1-1688-40bc-9091-6e7e4f8e8cc1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:49.691762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288c763-a556-4eaa-a150-9aedba521b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:49.692476 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288c763-a556-4eaa-a150-9aedba521b6b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:49.692912 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288c763-a556-4eaa-a150-9aedba521b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:49.693263 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288c763-a556-4eaa-a150-9aedba521b6b None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:49.694014 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288c763-a556-4eaa-a150-9aedba521b6b None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:49.694423 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288c763-a556-4eaa-a150-9aedba521b6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:49.696126 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288c763-a556-4eaa-a150-9aedba521b6b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:49.698373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-0bb58ee1-1688-40bc-9091-6e7e4f8e8cc1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 16:19:49.698373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:49.698373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:49.698373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:49.698373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:49.698373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:49.698373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:49.698373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:49.698373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:49.698373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:49.698373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:49.698373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:49.698373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:19:49.698373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:19:49.698373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:19:49.698373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:19:49.700405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:49.700405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:49.700405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:19:49.700405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:49.700405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:19:49.700405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:49.700405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:49.700405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:49.700405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:49.700405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:49.700405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:49.700405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:49.700405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:49.700405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:49.700405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:49.700405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:49.700405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:49.700405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:49.708700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:49.708700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:49.708700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:19:49.708700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:19:49.708700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:19:49.708700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:19:49.708700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:19:49.708700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:19:49.708700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 16:19:49.708700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:49.708700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 252/499] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:49.708700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0d7a7-abf9-441d-8b11-6b2bc90107ef None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:49.708700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0d7a7-abf9-441d-8b11-6b2bc90107ef None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:49.709638 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0d7a7-abf9-441d-8b11-6b2bc90107ef None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:49.709638 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 253/500] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:49.709638 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0d7a7-abf9-441d-8b11-6b2bc90107ef None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:49.711940 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 248/501] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 1 16:19:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:49.713078 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288c763-a556-4eaa-a150-9aedba521b6b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:49.757702 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:49.851206 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0d7a7-abf9-441d-8b11-6b2bc90107ef None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:49.869890 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288c763-a556-4eaa-a150-9aedba521b6b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:49.892884 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:49.906230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e945fa0-0afb-4b89-babc-8d1f1930035d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:49.906853 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e945fa0-0afb-4b89-babc-8d1f1930035d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:49.907156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e945fa0-0afb-4b89-babc-8d1f1930035d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:49.907421 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e945fa0-0afb-4b89-babc-8d1f1930035d None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:49.908106 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e945fa0-0afb-4b89-babc-8d1f1930035d None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:49.908408 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e945fa0-0afb-4b89-babc-8d1f1930035d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:49.909092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315f96d-ddf0-4278-b330-57b70826d1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:49.909770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315f96d-ddf0-4278-b330-57b70826d1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:49.909938 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e945fa0-0afb-4b89-babc-8d1f1930035d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:49.910093 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315f96d-ddf0-4278-b330-57b70826d1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:49.910307 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315f96d-ddf0-4278-b330-57b70826d1f4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:49.918952 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315f96d-ddf0-4278-b330-57b70826d1f4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:49.919836 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 254/502] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 1 16:19:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:49.920459 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315f96d-ddf0-4278-b330-57b70826d1f4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:49.920730 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e945fa0-0afb-4b89-babc-8d1f1930035d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:49.934980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-3315f96d-ddf0-4278-b330-57b70826d1f4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:19:49.934980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:49.934980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:49.934980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:49.934980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:49.934980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:49.934980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:49.934980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:49.934980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:49.934980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:49.934980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:49.934980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:49.934980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:19:49.934980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:19:49.934980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:19:49.934980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:19:49.937341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:49.937341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:49.937341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:19:49.937341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:49.937341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:19:49.937341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:49.937341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:49.937341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:49.937341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:49.937341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:49.937341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:49.937341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:49.937341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:49.937341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:49.937341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:49.937341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:49.937341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:49.937341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:49.938328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:49.938328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:49.938328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:19:49.938328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:19:49.938328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:19:49.938328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:19:49.938328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:19:49.938328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:19:49.938328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:19:49.938328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:49.938328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 249/503] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Sep 1 16:19:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:49.938328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91665320-909b-4818-8452-b5ea83b0f618 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:49.938328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91665320-909b-4818-8452-b5ea83b0f618 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:49.938971 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91665320-909b-4818-8452-b5ea83b0f618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:49.960647 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-91665320-909b-4818-8452-b5ea83b0f618 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:49.961930 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-91665320-909b-4818-8452-b5ea83b0f618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:50.040649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 250/504] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:50.041583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91665320-909b-4818-8452-b5ea83b0f618 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:50.079019 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:50.102896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e945fa0-0afb-4b89-babc-8d1f1930035d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:50.158942 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f6ff5-e8c3-4499-b526-7d460b22127a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:50.159573 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f6ff5-e8c3-4499-b526-7d460b22127a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:50.159883 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f6ff5-e8c3-4499-b526-7d460b22127a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:50.160146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f6ff5-e8c3-4499-b526-7d460b22127a None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:50.160948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f6ff5-e8c3-4499-b526-7d460b22127a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:50.161302 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f6ff5-e8c3-4499-b526-7d460b22127a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:50.162742 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f6ff5-e8c3-4499-b526-7d460b22127a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:50.207541 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 255/505] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Sep 1 16:19:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:50.212772 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f6ff5-e8c3-4499-b526-7d460b22127a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:50.225396 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91665320-909b-4818-8452-b5ea83b0f618 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:50.251198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:50.287211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11d26d-3d3b-42aa-ae86-1bac97eafa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:50.287853 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11d26d-3d3b-42aa-ae86-1bac97eafa1b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:50.288135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11d26d-3d3b-42aa-ae86-1bac97eafa1b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:50.288413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11d26d-3d3b-42aa-ae86-1bac97eafa1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:50.303433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11d26d-3d3b-42aa-ae86-1bac97eafa1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:50.306273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11d26d-3d3b-42aa-ae86-1bac97eafa1b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:50.335670 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-3b11d26d-3d3b-42aa-ae86-1bac97eafa1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:50.335670 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:50.335670 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:50.335670 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:50.335670 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:50.335670 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:50.335670 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:50.335670 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:50.335670 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:50.335670 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:50.335670 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:50.335670 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:50.335670 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:50.335670 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:50.335670 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:50.335670 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:50.336796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:50.336796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:50.336796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:50.336796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:50.336796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:50.336796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:50.336796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:50.336796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:50.336796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:50.336796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:50.336796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:50.336796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:50.336796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:50.336796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:50.336796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:50.336796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:50.336796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:50.337646 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:50.337646 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:50.337646 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:50.337806 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 251/506] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:50.339194 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11d26d-3d3b-42aa-ae86-1bac97eafa1b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:50.379483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f6ff5-e8c3-4499-b526-7d460b22127a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:50.422194 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe534b-dc11-4f4c-8394-a7fbd9ca85ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:50.422946 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe534b-dc11-4f4c-8394-a7fbd9ca85ee None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:50.423356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe534b-dc11-4f4c-8394-a7fbd9ca85ee None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:50.423799 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe534b-dc11-4f4c-8394-a7fbd9ca85ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:50.437446 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe534b-dc11-4f4c-8394-a7fbd9ca85ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:50.439417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe534b-dc11-4f4c-8394-a7fbd9ca85ee None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:50.452502 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:50.461648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-85fe534b-dc11-4f4c-8394-a7fbd9ca85ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:50.461648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:50.461648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:50.461648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:50.461648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:50.461648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:50.461648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:50.461648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:50.461648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:50.461648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:50.461648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:50.461648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:50.461648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:50.461648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:50.461648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:50.461648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:50.462754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:50.462754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:50.462754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:50.462754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:50.462754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:50.462754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:50.462754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:50.462754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:50.462754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:50.462754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:50.462754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:50.462754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:50.462754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:50.462754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:50.462754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:50.462754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:50.462754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:50.463712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:50.463712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:50.463712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:50.465069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 256/507] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:50.466595 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe534b-dc11-4f4c-8394-a7fbd9ca85ee None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:50.503184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11d26d-3d3b-42aa-ae86-1bac97eafa1b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:50.544101 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c874895-fe8b-46a2-8e2e-6e66b2eae927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:50.544765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c874895-fe8b-46a2-8e2e-6e66b2eae927 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:50.545052 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c874895-fe8b-46a2-8e2e-6e66b2eae927 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:50.545350 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c874895-fe8b-46a2-8e2e-6e66b2eae927 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:50.546668 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c874895-fe8b-46a2-8e2e-6e66b2eae927 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:50.546981 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c874895-fe8b-46a2-8e2e-6e66b2eae927 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:50.548485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c874895-fe8b-46a2-8e2e-6e66b2eae927 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:50.589143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 252/508] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Sep 1 16:19:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:50.589810 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c874895-fe8b-46a2-8e2e-6e66b2eae927 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:50.596202 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe534b-dc11-4f4c-8394-a7fbd9ca85ee None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:50.620849 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:50.647830 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73ffe4-289b-4ee9-8702-7f7dfde60c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:50.648455 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73ffe4-289b-4ee9-8702-7f7dfde60c31 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:50.648777 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73ffe4-289b-4ee9-8702-7f7dfde60c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:50.649050 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73ffe4-289b-4ee9-8702-7f7dfde60c31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:50.728109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:50.732075 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73ffe4-289b-4ee9-8702-7f7dfde60c31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:50.735026 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73ffe4-289b-4ee9-8702-7f7dfde60c31 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:50.743955 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c874895-fe8b-46a2-8e2e-6e66b2eae927 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:50.792777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e4f6d-5325-4fa4-9295-45a61c544bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:50.793884 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e4f6d-5325-4fa4-9295-45a61c544bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:50.794373 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e4f6d-5325-4fa4-9295-45a61c544bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:50.794870 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e4f6d-5325-4fa4-9295-45a61c544bc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:50.815261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e4f6d-5325-4fa4-9295-45a61c544bc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:50.818173 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e4f6d-5325-4fa4-9295-45a61c544bc3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:50.848232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-1b4e4f6d-5325-4fa4-9295-45a61c544bc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:50.848232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:50.848232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:50.848232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:50.848232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:50.848232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:50.848232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:50.848232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:50.848232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:50.848232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:50.848232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:50.848232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:50.848232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:50.848232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:50.848232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:50.848232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:50.849412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:50.849412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:50.849412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:50.849412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:50.849412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:50.849412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:50.849412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:50.849412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:50.849412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:50.849412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:50.849412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:50.849412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:50.849412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:50.849412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:50.849412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:50.849412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:50.849412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:50.853477 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:50.853477 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:50.853477 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:50.853477 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 253/509] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:50.853477 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e4f6d-5325-4fa4-9295-45a61c544bc3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:50.869854 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 257/510] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:50.870831 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73ffe4-289b-4ee9-8702-7f7dfde60c31 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:50.966987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:51.005619 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e4f6d-5325-4fa4-9295-45a61c544bc3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:51.012364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:51.016428 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73ffe4-289b-4ee9-8702-7f7dfde60c31 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:51.062225 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d49ca0-b8b1-488e-8f49-8d1e625f0f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:51.063182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d49ca0-b8b1-488e-8f49-8d1e625f0f54 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:51.063638 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d49ca0-b8b1-488e-8f49-8d1e625f0f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:51.064081 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d49ca0-b8b1-488e-8f49-8d1e625f0f54 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:51.065243 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d49ca0-b8b1-488e-8f49-8d1e625f0f54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:51.065698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d49ca0-b8b1-488e-8f49-8d1e625f0f54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:51.068030 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d49ca0-b8b1-488e-8f49-8d1e625f0f54 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:51.079651 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882854e3-29cb-492d-8141-7c70c9c37c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:51.080687 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882854e3-29cb-492d-8141-7c70c9c37c85 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:51.081167 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882854e3-29cb-492d-8141-7c70c9c37c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:51.081642 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882854e3-29cb-492d-8141-7c70c9c37c85 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:51.082819 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882854e3-29cb-492d-8141-7c70c9c37c85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:51.083301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882854e3-29cb-492d-8141-7c70c9c37c85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:51.085301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882854e3-29cb-492d-8141-7c70c9c37c85 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:51.098089 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 254/511] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:51.098089 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d49ca0-b8b1-488e-8f49-8d1e625f0f54 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:51.108730 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 258/512] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:51.108730 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882854e3-29cb-492d-8141-7c70c9c37c85 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:51.243699 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d49ca0-b8b1-488e-8f49-8d1e625f0f54 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:51.275724 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882854e3-29cb-492d-8141-7c70c9c37c85 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:51.295081 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:51.302804 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbfa0a-96f8-4ffa-bdbe-5004336a4cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:51.303751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbfa0a-96f8-4ffa-bdbe-5004336a4cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:51.304211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbfa0a-96f8-4ffa-bdbe-5004336a4cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:51.304608 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbfa0a-96f8-4ffa-bdbe-5004336a4cd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:51.323941 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a71fd-2fb4-431b-aeeb-bfef2a52d28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:51.324562 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a71fd-2fb4-431b-aeeb-bfef2a52d28f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:51.324872 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a71fd-2fb4-431b-aeeb-bfef2a52d28f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:51.325146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a71fd-2fb4-431b-aeeb-bfef2a52d28f None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:51.325817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a71fd-2fb4-431b-aeeb-bfef2a52d28f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:51.326117 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a71fd-2fb4-431b-aeeb-bfef2a52d28f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:51.328128 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a71fd-2fb4-431b-aeeb-bfef2a52d28f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:51.341621 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 259/513] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:51.342486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a71fd-2fb4-431b-aeeb-bfef2a52d28f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:51.383882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:51.399126 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbfa0a-96f8-4ffa-bdbe-5004336a4cd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:51.400608 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbfa0a-96f8-4ffa-bdbe-5004336a4cd1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:51.518157 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a71fd-2fb4-431b-aeeb-bfef2a52d28f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:51.525015 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 255/514] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:51.525988 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbfa0a-96f8-4ffa-bdbe-5004336a4cd1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:51.561293 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:51.566660 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331fff9-b9a0-493c-a410-0d58e31cefeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:51.567330 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331fff9-b9a0-493c-a410-0d58e31cefeb None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:51.567610 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331fff9-b9a0-493c-a410-0d58e31cefeb None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:51.567878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331fff9-b9a0-493c-a410-0d58e31cefeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:51.580222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331fff9-b9a0-493c-a410-0d58e31cefeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:51.581733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331fff9-b9a0-493c-a410-0d58e31cefeb None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:51.598966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-a331fff9-b9a0-493c-a410-0d58e31cefeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:51.598966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:51.598966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:51.598966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:51.598966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:51.598966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:51.598966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:51.598966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:51.598966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:51.598966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:51.598966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:51.598966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:51.598966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:51.598966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:51.598966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:51.598966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:51.600727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:51.600727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:51.600727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:51.600727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:51.600727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:51.600727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:51.600727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:51.600727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:51.600727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:51.600727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:51.600727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:51.600727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:51.600727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:51.600727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:51.600727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:51.600727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:51.600727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:51.602349 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:51.602349 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:51.602349 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:51.602349 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 260/515] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:51.602349 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331fff9-b9a0-493c-a410-0d58e31cefeb None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:51.664335 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbfa0a-96f8-4ffa-bdbe-5004336a4cd1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:51.710728 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:51.715105 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19909e8a-7286-4138-ae2b-01237677ad75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:51.715751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19909e8a-7286-4138-ae2b-01237677ad75 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:51.716023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19909e8a-7286-4138-ae2b-01237677ad75 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:51.716290 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19909e8a-7286-4138-ae2b-01237677ad75 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:51.725134 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19909e8a-7286-4138-ae2b-01237677ad75 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:51.726762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19909e8a-7286-4138-ae2b-01237677ad75 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:51.740011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-19909e8a-7286-4138-ae2b-01237677ad75 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:19:51.740011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:51.740011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:51.740011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:51.740011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:51.740011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:51.740011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:51.740011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:51.740011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:51.740011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:51.740011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:51.740011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:51.740011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:19:51.740011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:19:51.740011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:19:51.740011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:19:51.741849 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:51.741849 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:51.741849 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:19:51.741849 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:51.741849 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:19:51.741849 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:51.741849 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:51.741849 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:51.741849 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:51.741849 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:51.741849 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:51.741849 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:51.741849 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:51.741849 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:51.741849 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:51.741849 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:51.741849 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:51.741849 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:51.745043 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:51.745043 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:51.745043 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:19:51.745043 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:19:51.745043 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:19:51.745043 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:19:51.745043 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:19:51.745043 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:19:51.745043 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:19:51.745043 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:51.745043 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 256/516] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:51.745043 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19909e8a-7286-4138-ae2b-01237677ad75 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:51.769411 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331fff9-b9a0-493c-a410-0d58e31cefeb None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:51.816020 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb36364-be35-4d21-9b4a-ebdf47ec772b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:51.816565 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb36364-be35-4d21-9b4a-ebdf47ec772b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:51.816867 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb36364-be35-4d21-9b4a-ebdf47ec772b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:51.817133 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb36364-be35-4d21-9b4a-ebdf47ec772b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:51.825308 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb36364-be35-4d21-9b4a-ebdf47ec772b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:51.826828 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb36364-be35-4d21-9b4a-ebdf47ec772b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:51.840031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-5bb36364-be35-4d21-9b4a-ebdf47ec772b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 16:19:51.840031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:51.840031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:51.840031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:51.840031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:51.840031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:51.840031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:51.840031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:51.840031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:51.840031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:51.840031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:51.840031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:51.840031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:19:51.840031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:19:51.840031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:19:51.840031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:19:51.841148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:51.841148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:51.841148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:19:51.841148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:51.841148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:19:51.841148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:51.841148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:51.841148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:51.841148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:51.841148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:51.841148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:51.841148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:51.841148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:51.841148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:51.841148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:51.841148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:51.841148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:51.841148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:51.842093 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:51.842093 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:51.842093 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:19:51.842093 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:19:51.842093 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:19:51.842093 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:19:51.842093 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:19:51.842093 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:19:51.842093 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 16:19:51.842093 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:51.842093 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 261/517] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 1 16:19:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:51.842677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb36364-be35-4d21-9b4a-ebdf47ec772b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:51.886743 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:51.897032 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19909e8a-7286-4138-ae2b-01237677ad75 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:51.944002 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7670e8-8acb-4adf-8a77-6b96e2159e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:51.944831 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7670e8-8acb-4adf-8a77-6b96e2159e7a None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:51.945270 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7670e8-8acb-4adf-8a77-6b96e2159e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:51.945738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7670e8-8acb-4adf-8a77-6b96e2159e7a None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:51.946616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7670e8-8acb-4adf-8a77-6b96e2159e7a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:51.948257 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7670e8-8acb-4adf-8a77-6b96e2159e7a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:51.975317 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 257/518] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 1 16:19:51 2022] POST /identity/v3/users => generated 247 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:19:51.976502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7670e8-8acb-4adf-8a77-6b96e2159e7a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:52.005580 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb36364-be35-4d21-9b4a-ebdf47ec772b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:52.069255 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:52.084080 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d6ace-42b2-491e-982f-981d2a43de26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:52.087365 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d6ace-42b2-491e-982f-981d2a43de26 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:52.087731 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d6ace-42b2-491e-982f-981d2a43de26 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:52.088086 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d6ace-42b2-491e-982f-981d2a43de26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:52.104891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d6ace-42b2-491e-982f-981d2a43de26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:52.106802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d6ace-42b2-491e-982f-981d2a43de26 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:52.127356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-a95d6ace-42b2-491e-982f-981d2a43de26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:52.127356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:52.127356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:52.127356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:52.127356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:52.127356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:52.127356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:52.127356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:52.127356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:52.127356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:52.127356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:52.127356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:52.127356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:52.127356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:52.127356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:52.127356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:52.136929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:52.136929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:52.136929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:52.136929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:52.136929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:52.136929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:52.136929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:52.136929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:52.136929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:52.136929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:52.136929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:52.136929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:52.136929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:52.136929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:52.136929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:52.136929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:52.136929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:52.138569 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:52.138569 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:52.138569 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:52.138569 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 262/519] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:52.138569 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d6ace-42b2-491e-982f-981d2a43de26 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:52.188139 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7670e8-8acb-4adf-8a77-6b96e2159e7a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:52.247390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825832e7-527d-4c1a-bf34-c43b7ea1f84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:52.248352 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825832e7-527d-4c1a-bf34-c43b7ea1f84a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:52.248352 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825832e7-527d-4c1a-bf34-c43b7ea1f84a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:52.248667 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825832e7-527d-4c1a-bf34-c43b7ea1f84a None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:52.249705 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825832e7-527d-4c1a-bf34-c43b7ea1f84a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:52.250003 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825832e7-527d-4c1a-bf34-c43b7ea1f84a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:52.251702 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825832e7-527d-4c1a-bf34-c43b7ea1f84a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:52.266778 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 258/520] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:52.267658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825832e7-527d-4c1a-bf34-c43b7ea1f84a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:52.292237 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:52.310299 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d6ace-42b2-491e-982f-981d2a43de26 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:52.356504 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec1fe1-625d-4754-bca9-425dcf011ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:52.357060 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec1fe1-625d-4754-bca9-425dcf011ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:52.357403 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec1fe1-625d-4754-bca9-425dcf011ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:52.357600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec1fe1-625d-4754-bca9-425dcf011ef7 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:52.358917 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec1fe1-625d-4754-bca9-425dcf011ef7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:52.359226 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec1fe1-625d-4754-bca9-425dcf011ef7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:52.360758 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec1fe1-625d-4754-bca9-425dcf011ef7 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:52.391083 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 263/521] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Sep 1 16:19:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:52.393286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec1fe1-625d-4754-bca9-425dcf011ef7 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:52.434425 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825832e7-527d-4c1a-bf34-c43b7ea1f84a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:52.449380 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:52.481840 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894fd17-2ec4-4a0c-b238-8e808417c4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:52.482476 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894fd17-2ec4-4a0c-b238-8e808417c4b5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:52.482757 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894fd17-2ec4-4a0c-b238-8e808417c4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:52.483031 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894fd17-2ec4-4a0c-b238-8e808417c4b5 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:52.484697 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894fd17-2ec4-4a0c-b238-8e808417c4b5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:52.485225 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894fd17-2ec4-4a0c-b238-8e808417c4b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:52.486750 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894fd17-2ec4-4a0c-b238-8e808417c4b5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:52.515021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 259/522] 10.222.0.52 () {56 vars in 1139 bytes} [Thu Sep 1 16:19:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:52.515866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894fd17-2ec4-4a0c-b238-8e808417c4b5 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:52.563503 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec1fe1-625d-4754-bca9-425dcf011ef7 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:52.609327 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:52.620574 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94917f54-4a13-4aa6-8df6-791f8c9ecaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:52.621662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94917f54-4a13-4aa6-8df6-791f8c9ecaac None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:52.622157 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94917f54-4a13-4aa6-8df6-791f8c9ecaac None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:52.622646 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94917f54-4a13-4aa6-8df6-791f8c9ecaac None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:52.623619 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94917f54-4a13-4aa6-8df6-791f8c9ecaac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:52.624651 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94917f54-4a13-4aa6-8df6-791f8c9ecaac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:52.628597 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94917f54-4a13-4aa6-8df6-791f8c9ecaac None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:52.650321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894fd17-2ec4-4a0c-b238-8e808417c4b5 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:52.656896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 264/523] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:52.656896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94917f54-4a13-4aa6-8df6-791f8c9ecaac None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:52.714291 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2aacb8-f8b4-4530-9610-917b4d44a3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:52.715199 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2aacb8-f8b4-4530-9610-917b4d44a3ac None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:52.715602 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2aacb8-f8b4-4530-9610-917b4d44a3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:52.716000 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2aacb8-f8b4-4530-9610-917b4d44a3ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:52.728111 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2aacb8-f8b4-4530-9610-917b4d44a3ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:52.730612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2aacb8-f8b4-4530-9610-917b4d44a3ac None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:52.752464 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-db2aacb8-f8b4-4530-9610-917b4d44a3ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:52.752464 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:52.752464 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:52.752464 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:52.752464 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:52.752464 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:52.752464 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:52.752464 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:52.752464 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:52.752464 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:52.752464 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:52.752464 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:52.752464 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:19:52.752464 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:19:52.752464 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:19:52.753510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:19:52.753510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:52.753510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:52.753510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:52.753510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:52.753510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:52.753510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:52.753510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:52.753510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:52.753510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:52.753510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:52.753510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:52.753510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:52.753510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:52.753510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:52.753510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:52.753510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:52.754353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:19:52.754353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:19:52.754353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:19:52.754353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:19:52.754353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:19:52.754353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:19:52.754353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:52.754353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:52.754353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 260/524] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:52.755497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2aacb8-f8b4-4530-9610-917b4d44a3ac None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:52.814790 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94917f54-4a13-4aa6-8df6-791f8c9ecaac None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:52.816491 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:52.857205 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2676d-33c9-4b86-8e8d-d4c6829d645c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:52.857833 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2676d-33c9-4b86-8e8d-d4c6829d645c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:52.858109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2676d-33c9-4b86-8e8d-d4c6829d645c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:52.858960 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2676d-33c9-4b86-8e8d-d4c6829d645c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:52.894900 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2aacb8-f8b4-4530-9610-917b4d44a3ac None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:52.927200 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:52.938598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682177b6-aba1-4cd5-abd3-4e319b2bc89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:52.939211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682177b6-aba1-4cd5-abd3-4e319b2bc89e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:52.939487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682177b6-aba1-4cd5-abd3-4e319b2bc89e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:52.939755 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682177b6-aba1-4cd5-abd3-4e319b2bc89e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:52.965045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2676d-33c9-4b86-8e8d-d4c6829d645c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:52.966553 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2676d-33c9-4b86-8e8d-d4c6829d645c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:53.058492 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682177b6-aba1-4cd5-abd3-4e319b2bc89e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:53.060386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682177b6-aba1-4cd5-abd3-4e319b2bc89e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:53.111334 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 265/525] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:53.112563 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2676d-33c9-4b86-8e8d-d4c6829d645c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:53.115331 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:53.193118 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 261/526] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:53.194242 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682177b6-aba1-4cd5-abd3-4e319b2bc89e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:53.232551 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:53.250942 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2676d-33c9-4b86-8e8d-d4c6829d645c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:53.293737 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132f2f7-721e-4c76-81bc-49faff14ae5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:53.294389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132f2f7-721e-4c76-81bc-49faff14ae5b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:53.294678 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132f2f7-721e-4c76-81bc-49faff14ae5b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:53.294936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132f2f7-721e-4c76-81bc-49faff14ae5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:53.303434 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132f2f7-721e-4c76-81bc-49faff14ae5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:53.305235 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132f2f7-721e-4c76-81bc-49faff14ae5b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:53.320085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-5132f2f7-721e-4c76-81bc-49faff14ae5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:53.320085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:53.320085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:53.320085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:53.320085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:53.320085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:53.320085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:53.320085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:53.320085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:53.320085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:53.320085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:53.320085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:53.320085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:19:53.320085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:19:53.320085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:19:53.321764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:19:53.321764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:53.321764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:53.321764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:53.321764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:53.321764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:53.321764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:53.321764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:53.321764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:53.321764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:53.321764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:53.321764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:53.321764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:53.321764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:53.321764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:53.321764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:53.321764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:53.324181 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:19:53.324181 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:19:53.324181 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:19:53.324181 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:19:53.324181 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:19:53.324181 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:19:53.324181 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:53.324181 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:53.324181 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 266/527] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:53.324181 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132f2f7-721e-4c76-81bc-49faff14ae5b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:53.340058 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682177b6-aba1-4cd5-abd3-4e319b2bc89e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:53.395570 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d374a23-ebc9-41f9-92af-fb090ea3353b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:53.396678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d374a23-ebc9-41f9-92af-fb090ea3353b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:53.397200 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d374a23-ebc9-41f9-92af-fb090ea3353b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:53.397692 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d374a23-ebc9-41f9-92af-fb090ea3353b None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:53.399019 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d374a23-ebc9-41f9-92af-fb090ea3353b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:53.399589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d374a23-ebc9-41f9-92af-fb090ea3353b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:53.402386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d374a23-ebc9-41f9-92af-fb090ea3353b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:53.403257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:53.440651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 262/528] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:19:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:53.440651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d374a23-ebc9-41f9-92af-fb090ea3353b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:53.458188 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132f2f7-721e-4c76-81bc-49faff14ae5b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:53.533130 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e9d71-063a-4527-a621-fd135023caec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:53.534217 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e9d71-063a-4527-a621-fd135023caec None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:53.534712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e9d71-063a-4527-a621-fd135023caec None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:53.535203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e9d71-063a-4527-a621-fd135023caec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:53.543003 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:53.555350 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e9d71-063a-4527-a621-fd135023caec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:53.558226 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e9d71-063a-4527-a621-fd135023caec None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:53.562821 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d374a23-ebc9-41f9-92af-fb090ea3353b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:53.588089 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-509e9d71-063a-4527-a621-fd135023caec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:53.588089 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:53.588089 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:53.588089 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:53.588089 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:53.588089 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:53.588089 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:53.588089 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:53.588089 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:53.588089 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:53.588089 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:53.588089 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:53.588089 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:53.588089 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:53.588089 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:53.588089 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:53.589166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:53.589166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:53.589166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:53.589166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:53.589166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:53.589166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:53.589166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:53.589166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:53.589166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:53.589166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:53.589166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:53.589166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:53.589166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:53.589166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:53.589166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:53.589166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:53.589166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:53.590004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:53.590004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:53.590004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:53.590472 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 267/529] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:53.592168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e9d71-063a-4527-a621-fd135023caec None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:53.606095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f33c22-2532-470c-9c8c-aa531aee2686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:53.606740 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f33c22-2532-470c-9c8c-aa531aee2686 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:53.607155 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f33c22-2532-470c-9c8c-aa531aee2686 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:53.607430 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f33c22-2532-470c-9c8c-aa531aee2686 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:53.621901 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f33c22-2532-470c-9c8c-aa531aee2686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:53.623507 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f33c22-2532-470c-9c8c-aa531aee2686 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:53.641167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-63f33c22-2532-470c-9c8c-aa531aee2686 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:53.641167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:53.641167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:53.641167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:53.641167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:53.641167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:53.641167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:53.641167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:53.641167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:53.641167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:53.641167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:53.641167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:53.641167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:53.641167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:53.641167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:53.641167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:53.642153 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:53.642153 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:53.642153 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:53.642153 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:53.642153 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:53.642153 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:53.642153 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:53.642153 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:53.642153 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:53.642153 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:53.642153 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:53.642153 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:53.642153 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:53.642153 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:53.642153 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:53.642153 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:53.642153 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:53.643007 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:53.643007 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:53.643007 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:53.643007 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 263/530] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:53.643943 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f33c22-2532-470c-9c8c-aa531aee2686 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:53.758199 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e9d71-063a-4527-a621-fd135023caec None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:53.777610 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:53.802866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cb84d-8527-4dff-bfa6-cf3a8f5c3981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:53.803867 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cb84d-8527-4dff-bfa6-cf3a8f5c3981 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:53.804147 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cb84d-8527-4dff-bfa6-cf3a8f5c3981 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:53.804417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cb84d-8527-4dff-bfa6-cf3a8f5c3981 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:53.805666 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5cb84d-8527-4dff-bfa6-cf3a8f5c3981 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:53.805974 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5cb84d-8527-4dff-bfa6-cf3a8f5c3981 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:53.807457 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5cb84d-8527-4dff-bfa6-cf3a8f5c3981 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:53.822905 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f33c22-2532-470c-9c8c-aa531aee2686 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:53.836663 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 268/531] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:19:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:53.836663 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cb84d-8527-4dff-bfa6-cf3a8f5c3981 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:53.886359 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8afaa-985e-430c-986d-cce809b25443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:53.887226 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8afaa-985e-430c-986d-cce809b25443 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:53.887679 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8afaa-985e-430c-986d-cce809b25443 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:53.888119 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8afaa-985e-430c-986d-cce809b25443 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:53.889376 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8afaa-985e-430c-986d-cce809b25443 None admin] RBAC: Adding query filter params (role.id=93abdb875d35417d91e420a60ccafbd2, scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f, user.id=c2feb3132ad9497aaae8720ed170ef3e) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:53.890410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8afaa-985e-430c-986d-cce809b25443 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:53.893148 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8afaa-985e-430c-986d-cce809b25443 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:53.902535 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 264/532] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:53 2022] GET /identity/v3/role_assignments?user.id=c2feb3132ad9497aaae8720ed170ef3e&scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f&role.id=93abdb875d35417d91e420a60ccafbd2 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:53.903893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8afaa-985e-430c-986d-cce809b25443 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:53.907727 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:54.037551 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cb84d-8527-4dff-bfa6-cf3a8f5c3981 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:54.101485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8afaa-985e-430c-986d-cce809b25443 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:54.111726 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d65c9-6926-48f6-bde3-2ab535f55902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:54.112788 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d65c9-6926-48f6-bde3-2ab535f55902 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:54.113268 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d65c9-6926-48f6-bde3-2ab535f55902 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:54.114032 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d65c9-6926-48f6-bde3-2ab535f55902 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:54.115200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d65c9-6926-48f6-bde3-2ab535f55902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:54.115712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d65c9-6926-48f6-bde3-2ab535f55902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:54.118335 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d65c9-6926-48f6-bde3-2ab535f55902 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:54.144042 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 269/533] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:54.145563 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d65c9-6926-48f6-bde3-2ab535f55902 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:54.179138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e66698-fecb-4307-8897-a6187d031500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:54.180968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e66698-fecb-4307-8897-a6187d031500 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:54.181719 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e66698-fecb-4307-8897-a6187d031500 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:54.182466 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e66698-fecb-4307-8897-a6187d031500 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:54.184162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e66698-fecb-4307-8897-a6187d031500 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:54.185093 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e66698-fecb-4307-8897-a6187d031500 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:54.186729 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e66698-fecb-4307-8897-a6187d031500 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:54.203596 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 265/534] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:54.204912 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e66698-fecb-4307-8897-a6187d031500 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:54.220308 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:54.319136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d65c9-6926-48f6-bde3-2ab535f55902 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:54.350214 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:54.401629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d89fb-b6b4-4122-8f70-fee2a794370e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:54.403505 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d89fb-b6b4-4122-8f70-fee2a794370e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:54.404578 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d89fb-b6b4-4122-8f70-fee2a794370e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:54.406120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d89fb-b6b4-4122-8f70-fee2a794370e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:54.408215 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d89fb-b6b4-4122-8f70-fee2a794370e None admin] RBAC: Adding query filter params (role.id=93abdb875d35417d91e420a60ccafbd2, scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f, user.id=55f389ab3ea046008b44f129113de995) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:54.408996 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e66698-fecb-4307-8897-a6187d031500 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:54.409260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d89fb-b6b4-4122-8f70-fee2a794370e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:54.413460 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d89fb-b6b4-4122-8f70-fee2a794370e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:54.436957 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 270/535] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:54 2022] GET /identity/v3/role_assignments?user.id=55f389ab3ea046008b44f129113de995&scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f&role.id=93abdb875d35417d91e420a60ccafbd2 => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:54.436957 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d89fb-b6b4-4122-8f70-fee2a794370e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:54.493967 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f177583-bddf-4e50-b974-19a9d25835d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:54.494630 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f177583-bddf-4e50-b974-19a9d25835d3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:54.494910 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f177583-bddf-4e50-b974-19a9d25835d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:54.495184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f177583-bddf-4e50-b974-19a9d25835d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:54.510181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f177583-bddf-4e50-b974-19a9d25835d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:54.514446 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f177583-bddf-4e50-b974-19a9d25835d3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:54.544589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-9f177583-bddf-4e50-b974-19a9d25835d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:54.544589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:54.544589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:54.544589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:54.544589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:54.544589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:54.544589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:54.544589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:54.544589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:54.544589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:54.544589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:54.544589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:54.544589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:19:54.544589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:19:54.544589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:19:54.546982 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:19:54.546982 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:54.546982 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:54.546982 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:54.546982 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:54.546982 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:54.546982 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:54.546982 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:54.546982 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:54.546982 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:54.546982 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:54.546982 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:54.546982 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:54.546982 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:54.546982 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:54.546982 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:54.546982 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:54.549543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:19:54.549543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:19:54.549543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:19:54.549543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:19:54.549543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:19:54.549543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:19:54.549543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:54.549543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:54.549543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 266/536] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:54.561736 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f177583-bddf-4e50-b974-19a9d25835d3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:54.671757 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:54.681051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d89fb-b6b4-4122-8f70-fee2a794370e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:54.742556 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2908a9-541f-4f74-9d08-930620d5ca3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:54.743207 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2908a9-541f-4f74-9d08-930620d5ca3e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:54.743485 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2908a9-541f-4f74-9d08-930620d5ca3e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:54.743755 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2908a9-541f-4f74-9d08-930620d5ca3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:54.751789 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2908a9-541f-4f74-9d08-930620d5ca3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:54.753332 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2908a9-541f-4f74-9d08-930620d5ca3e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:54.766476 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-fc2908a9-541f-4f74-9d08-930620d5ca3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:54.766476 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:54.766476 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:54.766476 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:54.766476 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:54.766476 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:54.766476 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:54.766476 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:54.766476 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:54.766476 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:54.766476 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:54.766476 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:54.766476 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:19:54.766476 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:19:54.766476 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:19:54.767387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:19:54.767387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:54.767387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:54.767387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:54.767387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:54.767387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:54.767387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:54.767387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:54.767387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:54.767387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:54.767387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:54.767387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:54.767387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:54.767387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:54.767387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:54.767387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:54.767387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:54.768432 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:19:54.768432 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:19:54.768432 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:19:54.768432 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:19:54.768432 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:19:54.768432 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:19:54.768432 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:54.768432 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:54.768432 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 271/537] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:54.781879 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2908a9-541f-4f74-9d08-930620d5ca3e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:54.830198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f177583-bddf-4e50-b974-19a9d25835d3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:54.922458 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:54.925014 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2908a9-541f-4f74-9d08-930620d5ca3e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:54.963377 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f4ceb-db70-4d65-aa52-d98dc278bbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:54.964405 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f4ceb-db70-4d65-aa52-d98dc278bbdd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:54.964891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac283efd-dd2f-4a85-a6f4-044ff1f60fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:54.965038 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f4ceb-db70-4d65-aa52-d98dc278bbdd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:54.965370 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f4ceb-db70-4d65-aa52-d98dc278bbdd None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:54.965545 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac283efd-dd2f-4a85-a6f4-044ff1f60fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:54.965786 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac283efd-dd2f-4a85-a6f4-044ff1f60fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:54.966062 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac283efd-dd2f-4a85-a6f4-044ff1f60fb6 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:54.966627 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f4ceb-db70-4d65-aa52-d98dc278bbdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:54.966791 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac283efd-dd2f-4a85-a6f4-044ff1f60fb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:54.967053 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac283efd-dd2f-4a85-a6f4-044ff1f60fb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:54.967148 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f4ceb-db70-4d65-aa52-d98dc278bbdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:54.970017 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac283efd-dd2f-4a85-a6f4-044ff1f60fb6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:54.970392 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f4ceb-db70-4d65-aa52-d98dc278bbdd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:54.985008 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 272/538] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:19:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:54.986337 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd772ed0-9d8e-48c8-ad3f-d06ad994ed94 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:54.986627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd772ed0-9d8e-48c8-ad3f-d06ad994ed94 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:54.986904 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd772ed0-9d8e-48c8-ad3f-d06ad994ed94 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:54.988262 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 273/539] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:54.993528 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd772ed0-9d8e-48c8-ad3f-d06ad994ed94 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:55.009642 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 267/540] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:19:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:55.012155 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5474e88-92a2-465c-b986-fba8cb26f65c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:55.012657 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5474e88-92a2-465c-b986-fba8cb26f65c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:55.013149 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5474e88-92a2-465c-b986-fba8cb26f65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:55.015753 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:55.043551 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b5474e88-92a2-465c-b986-fba8cb26f65c None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:55.045178 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b5474e88-92a2-465c-b986-fba8cb26f65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:55.156667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd772ed0-9d8e-48c8-ad3f-d06ad994ed94 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:55.193357 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 268/541] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:55.195279 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5474e88-92a2-465c-b986-fba8cb26f65c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:55.212042 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fc3a3-04f7-4f04-b5bb-8b8b9fecefc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:55.213040 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fc3a3-04f7-4f04-b5bb-8b8b9fecefc8 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:55.213544 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fc3a3-04f7-4f04-b5bb-8b8b9fecefc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:55.213999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fc3a3-04f7-4f04-b5bb-8b8b9fecefc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:55.214950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905fc3a3-04f7-4f04-b5bb-8b8b9fecefc8 None admin] RBAC: Adding query filter params (role.id=93abdb875d35417d91e420a60ccafbd2, scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f, user.id=0668b918bf2c49c2901838cd22770030) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:55.215462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905fc3a3-04f7-4f04-b5bb-8b8b9fecefc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:55.217181 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905fc3a3-04f7-4f04-b5bb-8b8b9fecefc8 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:55.234246 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 274/542] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:54 2022] GET /identity/v3/role_assignments?user.id=0668b918bf2c49c2901838cd22770030&scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f&role.id=93abdb875d35417d91e420a60ccafbd2 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:55.364726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5474e88-92a2-465c-b986-fba8cb26f65c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:55.405821 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:55.434261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670207dc-f5a7-4aa3-aa2c-82762a5f251d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:55.435236 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670207dc-f5a7-4aa3-aa2c-82762a5f251d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:55.435779 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670207dc-f5a7-4aa3-aa2c-82762a5f251d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:55.436269 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670207dc-f5a7-4aa3-aa2c-82762a5f251d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:55.438029 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670207dc-f5a7-4aa3-aa2c-82762a5f251d None admin] RBAC: Adding query filter params (role.id=93abdb875d35417d91e420a60ccafbd2, scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f, user.id=80a92eaeb5c54414864deef3052bd8f2) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:55.438582 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670207dc-f5a7-4aa3-aa2c-82762a5f251d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:55.440297 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670207dc-f5a7-4aa3-aa2c-82762a5f251d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:55.448301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 269/543] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:55 2022] GET /identity/v3/role_assignments?user.id=80a92eaeb5c54414864deef3052bd8f2&scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f&role.id=93abdb875d35417d91e420a60ccafbd2 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:55.635145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fc3a3-04f7-4f04-b5bb-8b8b9fecefc8 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:55.773359 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:55.800229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fc3a3-04f7-4f04-b5bb-8b8b9fecefc8 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:55.850902 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73197f52-2131-4297-8f49-2d19b67d1c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:55.851558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73197f52-2131-4297-8f49-2d19b67d1c6d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:55.851833 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73197f52-2131-4297-8f49-2d19b67d1c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:55.852100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73197f52-2131-4297-8f49-2d19b67d1c6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:55.865367 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73197f52-2131-4297-8f49-2d19b67d1c6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:55.871119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-73197f52-2131-4297-8f49-2d19b67d1c6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:55.871119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:55.871119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:55.871119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:55.871119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:55.871119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:55.871119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:55.871119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:55.871119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:55.871119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:55.871119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:55.871119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:55.871119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:55.871119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:55.871119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:55.871119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:55.872214 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:55.872214 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:55.872214 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:55.872214 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:55.872214 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:55.872214 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:55.872214 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:55.872214 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:55.872214 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:55.872214 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:55.872214 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:55.872214 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:55.872214 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:55.872214 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:55.872214 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:55.872214 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:55.873209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:55.873209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:55.873209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:55.873209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:55.873209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:55.873209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:55.873209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:55.873209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:55.873209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:55.873209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:55.873209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:55.873209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:55.876801 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 275/544] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 1 16:19:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:55.879872 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670207dc-f5a7-4aa3-aa2c-82762a5f251d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:56.005605 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670207dc-f5a7-4aa3-aa2c-82762a5f251d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:56.069461 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e39a7-085d-4d4c-99d6-dea235ba0ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:56.070402 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e39a7-085d-4d4c-99d6-dea235ba0ace None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:56.070831 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e39a7-085d-4d4c-99d6-dea235ba0ace None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:56.071244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e39a7-085d-4d4c-99d6-dea235ba0ace None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:56.072088 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e39a7-085d-4d4c-99d6-dea235ba0ace None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:56.072534 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e39a7-085d-4d4c-99d6-dea235ba0ace None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:56.074184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e39a7-085d-4d4c-99d6-dea235ba0ace None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:56.091072 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 270/545] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 1 16:19:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:56.097586 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73197f52-2131-4297-8f49-2d19b67d1c6d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:56.290868 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73197f52-2131-4297-8f49-2d19b67d1c6d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:56.344217 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8553f6-672b-4fed-bba3-e5d6f14ed8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:56.344820 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8553f6-672b-4fed-bba3-e5d6f14ed8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:56.345104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8553f6-672b-4fed-bba3-e5d6f14ed8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:56.345381 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8553f6-672b-4fed-bba3-e5d6f14ed8d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:56.357751 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8553f6-672b-4fed-bba3-e5d6f14ed8d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:56.359805 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8553f6-672b-4fed-bba3-e5d6f14ed8d0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:56.366568 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:56.385729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-8a8553f6-672b-4fed-bba3-e5d6f14ed8d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:56.385729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:56.385729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:56.385729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:56.385729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:56.385729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:56.385729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:56.385729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:56.385729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:56.385729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:56.385729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:56.385729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:56.385729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:56.385729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:56.385729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:56.385729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:56.386695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:56.386695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:56.386695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:56.386695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:56.386695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:56.386695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:56.386695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:56.386695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:56.386695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:56.386695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:56.386695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:56.386695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:56.386695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:56.386695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:56.386695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:56.386695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:56.386695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:56.387601 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:56.387601 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:56.387601 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:56.387601 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 276/546] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:56.394278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e39a7-085d-4d4c-99d6-dea235ba0ace None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:56.462683 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:56.506618 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155c9d6-6502-4b8c-8b47-8459164a3f46 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:56.506955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155c9d6-6502-4b8c-8b47-8459164a3f46 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:56.507163 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155c9d6-6502-4b8c-8b47-8459164a3f46 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:56.510395 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 277/547] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:19:56.515379 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc002a27-0903-48fd-9e53-634f2dc8cf21 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:56.515659 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc002a27-0903-48fd-9e53-634f2dc8cf21 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:56.515915 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc002a27-0903-48fd-9e53-634f2dc8cf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:56.540142 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-cc002a27-0903-48fd-9e53-634f2dc8cf21 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:56.541919 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cc002a27-0903-48fd-9e53-634f2dc8cf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:56.590262 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e39a7-085d-4d4c-99d6-dea235ba0ace None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:56.676828 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71db228-96a9-4e5b-ab86-d46b01a09d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:56.678297 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71db228-96a9-4e5b-ab86-d46b01a09d28 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:56.679085 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71db228-96a9-4e5b-ab86-d46b01a09d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:56.679869 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71db228-96a9-4e5b-ab86-d46b01a09d28 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:56.681394 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71db228-96a9-4e5b-ab86-d46b01a09d28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:56.682282 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71db228-96a9-4e5b-ab86-d46b01a09d28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:56.685306 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71db228-96a9-4e5b-ab86-d46b01a09d28 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:56.733179 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 271/548] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:56.737498 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71db228-96a9-4e5b-ab86-d46b01a09d28 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:56.811317 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 278/549] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:19:56.982761 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:56.994290 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71db228-96a9-4e5b-ab86-d46b01a09d28 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:57.071070 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7035b58-0453-45f5-aee7-56218c1797c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:57.072874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7035b58-0453-45f5-aee7-56218c1797c8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:57.073642 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7035b58-0453-45f5-aee7-56218c1797c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:57.074472 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7035b58-0453-45f5-aee7-56218c1797c8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:57.102723 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7035b58-0453-45f5-aee7-56218c1797c8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:57.106125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7035b58-0453-45f5-aee7-56218c1797c8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:57.137413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-e7035b58-0453-45f5-aee7-56218c1797c8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:19:57.137413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:57.137413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:57.137413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:57.137413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:57.137413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:57.137413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:57.137413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:57.137413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:57.137413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:57.137413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:57.137413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:57.137413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:19:57.137413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:19:57.137413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:19:57.137413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:19:57.139777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:57.139777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:57.139777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:19:57.139777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:57.139777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:19:57.139777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:57.139777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:57.139777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:57.139777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:57.139777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:57.139777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:57.139777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:57.139777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:57.139777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:57.139777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:57.139777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:57.139777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:57.139777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:57.141682 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:57.141682 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:57.141682 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:19:57.141682 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:19:57.141682 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:19:57.141682 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:19:57.141682 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:19:57.141682 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:19:57.141682 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:19:57.141682 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:57.146419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 272/550] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:19:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:57.154464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc002a27-0903-48fd-9e53-634f2dc8cf21 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:57.376334 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc002a27-0903-48fd-9e53-634f2dc8cf21 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:57.385863 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7035b58-0453-45f5-aee7-56218c1797c8 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:57.459338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:57.484300 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb0c14-a8e7-4a57-bd05-87f6b50d2db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:57.485094 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb0c14-a8e7-4a57-bd05-87f6b50d2db2 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:57.485379 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb0c14-a8e7-4a57-bd05-87f6b50d2db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:57.485516 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb0c14-a8e7-4a57-bd05-87f6b50d2db2 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:57.486278 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb0c14-a8e7-4a57-bd05-87f6b50d2db2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:57.486580 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb0c14-a8e7-4a57-bd05-87f6b50d2db2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:57.488072 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb0c14-a8e7-4a57-bd05-87f6b50d2db2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:57.510347 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 279/551] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Sep 1 16:19:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:57.511396 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb017d4-718d-4aba-9b5c-c9fd9fc3dd73 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:57.511689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb017d4-718d-4aba-9b5c-c9fd9fc3dd73 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:57.511969 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb017d4-718d-4aba-9b5c-c9fd9fc3dd73 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:57.513662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 280/552] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:57.519434 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb017d4-718d-4aba-9b5c-c9fd9fc3dd73 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:57.642321 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb017d4-718d-4aba-9b5c-c9fd9fc3dd73 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:57.646231 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7035b58-0453-45f5-aee7-56218c1797c8 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:57.684903 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1dfa9-0b97-4761-a4b8-249924a8e8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:57.685526 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1dfa9-0b97-4761-a4b8-249924a8e8e2 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:57.685805 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1dfa9-0b97-4761-a4b8-249924a8e8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:57.686128 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1dfa9-0b97-4761-a4b8-249924a8e8e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:57.728039 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd7d23-6e97-45fb-8356-67a050ad4b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:57.729801 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd7d23-6e97-45fb-8356-67a050ad4b43 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:57.730601 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd7d23-6e97-45fb-8356-67a050ad4b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:57.731401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd7d23-6e97-45fb-8356-67a050ad4b43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:57.745374 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:57.757045 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd7d23-6e97-45fb-8356-67a050ad4b43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:57.764096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-67dd7d23-6e97-45fb-8356-67a050ad4b43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:57.764096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:57.764096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:57.764096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:57.764096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:57.764096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:57.764096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:57.764096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:57.764096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:57.764096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:57.764096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:57.764096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:57.764096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:57.764096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:57.764096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:57.764096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:57.765675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:57.765675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:57.765675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:57.765675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:57.765675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:57.765675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:57.765675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:57.765675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:57.765675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:57.765675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:57.765675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:57.765675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:57.765675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:57.765675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:57.765675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:57.765675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:57.766559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:57.766559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:57.766559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:57.766559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:57.766559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:57.766559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:57.766559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:57.766559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:57.766559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:57.766559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:57.766559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:57.766559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:57.768824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1dfa9-0b97-4761-a4b8-249924a8e8e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:57.774242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1dfa9-0b97-4761-a4b8-249924a8e8e2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:57.775269 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 273/553] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 1 16:19:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:57.778197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760e46b-4c1e-4323-b3c9-b7cef14939e9 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:57.779057 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760e46b-4c1e-4323-b3c9-b7cef14939e9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:57.779988 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760e46b-4c1e-4323-b3c9-b7cef14939e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:57.818814 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e760e46b-4c1e-4323-b3c9-b7cef14939e9 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:57.821444 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e760e46b-4c1e-4323-b3c9-b7cef14939e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:57.866654 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:57.895356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 281/554] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:19:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:19:57.896415 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1dfa9-0b97-4761-a4b8-249924a8e8e2 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:57.986555 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 274/555] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:57.988817 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760e46b-4c1e-4323-b3c9-b7cef14939e9 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:58.010556 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:58.045190 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1dfa9-0b97-4761-a4b8-249924a8e8e2 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:58.197666 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760e46b-4c1e-4323-b3c9-b7cef14939e9 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:58.228521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc48a3e-9265-4286-85ea-91f8a9249b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:58.228882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc48a3e-9265-4286-85ea-91f8a9249b81 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:58.229017 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc48a3e-9265-4286-85ea-91f8a9249b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:58.229377 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc48a3e-9265-4286-85ea-91f8a9249b81 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:58.229957 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc48a3e-9265-4286-85ea-91f8a9249b81 None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:58.230260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc48a3e-9265-4286-85ea-91f8a9249b81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:58.231679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc48a3e-9265-4286-85ea-91f8a9249b81 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:58.258983 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 282/556] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 1 16:19:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:58.280533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ff0e0-1909-49d1-b4fc-bd11853f9380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:58.281761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc48a3e-9265-4286-85ea-91f8a9249b81 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:58.282681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ff0e0-1909-49d1-b4fc-bd11853f9380 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:58.283441 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ff0e0-1909-49d1-b4fc-bd11853f9380 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:58.284152 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ff0e0-1909-49d1-b4fc-bd11853f9380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:58.306410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ff0e0-1909-49d1-b4fc-bd11853f9380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:58.309990 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ff0e0-1909-49d1-b4fc-bd11853f9380 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:58.329205 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:58.345181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-8c0ff0e0-1909-49d1-b4fc-bd11853f9380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:58.345181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:58.345181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:58.345181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:58.345181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:58.345181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:58.345181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:58.345181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:58.345181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:58.345181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:58.345181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:58.345181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:58.345181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:58.345181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:58.345181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:58.345181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:58.347136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:58.347136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:58.347136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:58.347136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:58.347136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:58.347136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:58.347136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:58.347136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:58.347136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:58.347136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:58.347136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:58.347136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:58.347136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:58.347136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:58.347136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:58.347136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:58.347136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:58.348821 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:58.348821 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:58.348821 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:58.348821 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 275/557] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:58.357675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ff0e0-1909-49d1-b4fc-bd11853f9380 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:58.489235 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc48a3e-9265-4286-85ea-91f8a9249b81 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:58.538080 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cba10f-4b10-433a-9d5c-be6b88dba13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:58.538765 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cba10f-4b10-433a-9d5c-be6b88dba13e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:58.539060 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cba10f-4b10-433a-9d5c-be6b88dba13e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:58.539351 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cba10f-4b10-433a-9d5c-be6b88dba13e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:58.553210 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cba10f-4b10-433a-9d5c-be6b88dba13e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:58.554783 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cba10f-4b10-433a-9d5c-be6b88dba13e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:58.558327 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:58.576169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-53cba10f-4b10-433a-9d5c-be6b88dba13e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:58.576169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:58.576169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:58.576169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:58.576169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:58.576169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:58.576169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:58.576169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:58.576169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:58.576169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:58.576169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:58.576169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:58.576169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:58.576169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:58.576169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:58.576169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:58.579260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:58.579260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:58.579260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:58.579260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:58.579260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:58.579260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:58.579260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:58.579260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:58.579260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:58.579260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:58.579260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:58.579260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:58.579260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:58.579260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:58.579260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:58.579260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:58.579260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:58.583405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:58.583405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:58.583405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:58.583405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 283/558] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:58.583405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cba10f-4b10-433a-9d5c-be6b88dba13e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:58.595744 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ff0e0-1909-49d1-b4fc-bd11853f9380 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:58.666761 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1607c7-13ca-4e66-97f1-0cd53c9a219c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:58.667760 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1607c7-13ca-4e66-97f1-0cd53c9a219c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:58.668113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1607c7-13ca-4e66-97f1-0cd53c9a219c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:58.668491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1607c7-13ca-4e66-97f1-0cd53c9a219c None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:58.669332 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1607c7-13ca-4e66-97f1-0cd53c9a219c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:58.669697 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1607c7-13ca-4e66-97f1-0cd53c9a219c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:58.671949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1607c7-13ca-4e66-97f1-0cd53c9a219c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:58.691871 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 276/559] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:19:58.694575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43fa5b-e742-4686-9646-305e8de713a4 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:58.695342 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43fa5b-e742-4686-9646-305e8de713a4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:58.696116 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43fa5b-e742-4686-9646-305e8de713a4 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:58.698735 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 277/560] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:58.700294 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43fa5b-e742-4686-9646-305e8de713a4 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:58.754771 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cba10f-4b10-433a-9d5c-be6b88dba13e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:58.773235 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:58.812009 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6aade-ac05-4814-9cb7-c4b1d6d9fcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:58.812702 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6aade-ac05-4814-9cb7-c4b1d6d9fcc7 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:58.812987 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6aade-ac05-4814-9cb7-c4b1d6d9fcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:58.813267 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6aade-ac05-4814-9cb7-c4b1d6d9fcc7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:58.825189 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6aade-ac05-4814-9cb7-c4b1d6d9fcc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:58.831309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-5af6aade-ac05-4814-9cb7-c4b1d6d9fcc7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:58.831309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:58.831309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:58.831309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:58.831309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:58.831309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:58.831309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:58.831309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:58.831309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:58.831309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:58.831309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:58.831309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:58.831309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:58.831309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:58.831309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:58.831309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:58.833407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:58.833407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:58.833407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:58.833407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:58.833407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:58.833407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:58.833407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:58.833407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:58.833407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:58.833407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:58.833407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:58.833407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:58.833407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:58.833407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:58.833407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:58.833407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:58.835719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:58.835719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:58.835719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:58.835719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:58.835719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:58.835719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:58.835719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:58.835719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:58.835719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:58.835719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:58.835719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:58.835719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:58.835719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 284/561] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 1 16:19:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:58.835719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17bd9a-2eab-4d0f-ad50-fb58e3a47da9 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:58.838678 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17bd9a-2eab-4d0f-ad50-fb58e3a47da9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:58.838678 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17bd9a-2eab-4d0f-ad50-fb58e3a47da9 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:58.838678 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 285/562] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:19:58.838678 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17bd9a-2eab-4d0f-ad50-fb58e3a47da9 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:58.843982 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43fa5b-e742-4686-9646-305e8de713a4 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:58.911146 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00c8a9-65df-4a99-b8da-19c3944211ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:58.912070 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00c8a9-65df-4a99-b8da-19c3944211ed None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:58.912526 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00c8a9-65df-4a99-b8da-19c3944211ed None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:58.912980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00c8a9-65df-4a99-b8da-19c3944211ed None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:58.914080 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00c8a9-65df-4a99-b8da-19c3944211ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:58.914595 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00c8a9-65df-4a99-b8da-19c3944211ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:58.917060 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00c8a9-65df-4a99-b8da-19c3944211ed None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:58.934940 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:58.945510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 278/563] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:58.945510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa493ba9-c4a5-4faa-ae54-301df7faada4 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:58.945510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa493ba9-c4a5-4faa-ae54-301df7faada4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:58.945510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa493ba9-c4a5-4faa-ae54-301df7faada4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:58.966039 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-fa493ba9-c4a5-4faa-ae54-301df7faada4 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:58.967610 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fa493ba9-c4a5-4faa-ae54-301df7faada4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:59.001741 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17bd9a-2eab-4d0f-ad50-fb58e3a47da9 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:59.051049 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940db2d2-a1df-4196-b259-59e51d09e852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:59.051970 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940db2d2-a1df-4196-b259-59e51d09e852 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:59.052409 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940db2d2-a1df-4196-b259-59e51d09e852 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:59.052889 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940db2d2-a1df-4196-b259-59e51d09e852 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:59.061367 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940db2d2-a1df-4196-b259-59e51d09e852 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:59.063159 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940db2d2-a1df-4196-b259-59e51d09e852 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:59.063998 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 279/564] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:59.065731 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa493ba9-c4a5-4faa-ae54-301df7faada4 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:59.077944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-940db2d2-a1df-4196-b259-59e51d09e852 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:59.077944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:59.077944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:59.077944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:59.077944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:59.077944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:59.077944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:59.077944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:59.077944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:59.077944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:59.077944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:59.077944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:59.077944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:19:59.077944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:19:59.077944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:19:59.079719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:19:59.079719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:59.079719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:59.079719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:59.079719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:59.079719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:59.079719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:59.079719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:59.079719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:59.079719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:59.079719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:59.079719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:59.079719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:59.079719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:59.079719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:59.079719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:59.079719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:59.083084 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:19:59.083084 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:19:59.083084 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:19:59.083084 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:19:59.083084 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:19:59.083084 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:19:59.083084 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:19:59.083084 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:59.085276 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 286/565] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:19:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:59.088255 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c1c5c-27c8-4269-9301-977291f006ae None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:59.088839 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c1c5c-27c8-4269-9301-977291f006ae None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:59.089286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c1c5c-27c8-4269-9301-977291f006ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:59.111466 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b79c1c5c-27c8-4269-9301-977291f006ae None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:19:59.113096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b79c1c5c-27c8-4269-9301-977291f006ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:19:59.169347 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:59.249521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa493ba9-c4a5-4faa-ae54-301df7faada4 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:59.253911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 287/566] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:19:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:19:59.255445 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c1c5c-27c8-4269-9301-977291f006ae None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:59.325843 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6eb975-1350-4ef9-b79e-c9c9a074e331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:59.327424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6eb975-1350-4ef9-b79e-c9c9a074e331 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:59.327988 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6eb975-1350-4ef9-b79e-c9c9a074e331 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:59.328575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6eb975-1350-4ef9-b79e-c9c9a074e331 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:59.329926 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6eb975-1350-4ef9-b79e-c9c9a074e331 None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:59.330545 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6eb975-1350-4ef9-b79e-c9c9a074e331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:59.333439 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6eb975-1350-4ef9-b79e-c9c9a074e331 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:59.351291 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 280/567] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 1 16:19:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:59.353186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6eb975-1350-4ef9-b79e-c9c9a074e331 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:59.360469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:59.509201 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6eb975-1350-4ef9-b79e-c9c9a074e331 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:59.514079 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c1c5c-27c8-4269-9301-977291f006ae None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:59.533356 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:59.565950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7d63a-b232-4820-a288-41c2beeacd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:59.566598 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7d63a-b232-4820-a288-41c2beeacd33 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:59.566881 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7d63a-b232-4820-a288-41c2beeacd33 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:59.567155 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7d63a-b232-4820-a288-41c2beeacd33 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:59.572300 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b021fe-fe68-4164-87b2-5f6db5cb0fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:59.573712 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b021fe-fe68-4164-87b2-5f6db5cb0fdd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:59.574445 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b021fe-fe68-4164-87b2-5f6db5cb0fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:59.575196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b021fe-fe68-4164-87b2-5f6db5cb0fdd None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:59.575780 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7d63a-b232-4820-a288-41c2beeacd33 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:59.577651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b021fe-fe68-4164-87b2-5f6db5cb0fdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:19:59.578000 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7d63a-b232-4820-a288-41c2beeacd33 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:59.578719 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b021fe-fe68-4164-87b2-5f6db5cb0fdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:59.581584 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b021fe-fe68-4164-87b2-5f6db5cb0fdd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:59.591572 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-70c7d63a-b232-4820-a288-41c2beeacd33 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 16:19:59.591572 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:59.591572 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:59.591572 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:59.591572 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:59.591572 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:59.591572 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:59.591572 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:59.591572 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:59.591572 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:59.591572 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:59.591572 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:59.591572 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:19:59.591572 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:19:59.591572 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:19:59.591572 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:19:59.594012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:59.594012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:59.594012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:19:59.594012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:59.594012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:19:59.594012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:19:59.594012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:59.594012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:59.594012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:59.594012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:59.594012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:59.594012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:59.594012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:59.594012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:59.594012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:59.594012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:59.594012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:59.594012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:59.596315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:59.596315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:59.596315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:19:59.596315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:19:59.596315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:19:59.596315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:19:59.596315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:19:59.596315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:19:59.596315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 16:19:59.596315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:59.596315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 288/568] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:19:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:59.596315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7d63a-b232-4820-a288-41c2beeacd33 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:59.611447 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 281/569] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:19:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:59.613494 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b021fe-fe68-4164-87b2-5f6db5cb0fdd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:59.771789 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7d63a-b232-4820-a288-41c2beeacd33 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:59.781540 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:59.803101 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b021fe-fe68-4164-87b2-5f6db5cb0fdd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:19:59.815392 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087aedd-e347-415f-8c6a-f6e3de9ff6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:59.816134 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087aedd-e347-415f-8c6a-f6e3de9ff6a8 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:59.816488 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087aedd-e347-415f-8c6a-f6e3de9ff6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:59.816844 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087aedd-e347-415f-8c6a-f6e3de9ff6a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:59.831286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087aedd-e347-415f-8c6a-f6e3de9ff6a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:19:59.832766 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087aedd-e347-415f-8c6a-f6e3de9ff6a8 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:19:59.857761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-f087aedd-e347-415f-8c6a-f6e3de9ff6a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:59.857761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:59.857761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:59.857761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:59.857761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:59.857761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:59.857761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:59.857761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:59.857761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:59.857761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:59.857761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:59.857761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:59.857761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:19:59.857761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:19:59.857761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:19:59.857761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:19:59.858816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:59.858816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:59.858816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:59.858816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:59.858816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:59.858816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:59.858816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:59.858816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:59.858816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:59.858816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:59.858816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:59.858816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:59.858816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:59.858816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:59.858816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:59.858816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:59.858816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:19:59.859687 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:19:59.859687 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:19:59.859687 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:19:59.859865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de50d8-a88a-4e07-89eb-258ef698f60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:19:59.859865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de50d8-a88a-4e07-89eb-258ef698f60b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:19:59.859865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de50d8-a88a-4e07-89eb-258ef698f60b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:19:59.860074 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 289/570] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:59.860143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de50d8-a88a-4e07-89eb-258ef698f60b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:19:59.861400 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087aedd-e347-415f-8c6a-f6e3de9ff6a8 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:59.878070 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de50d8-a88a-4e07-89eb-258ef698f60b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:19:59.883655 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-84de50d8-a88a-4e07-89eb-258ef698f60b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:59.883655 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:19:59.883655 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:19:59.883655 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:19:59.883655 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:19:59.883655 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:19:59.883655 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:19:59.883655 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:19:59.883655 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:19:59.883655 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:19:59.883655 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:19:59.883655 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:19:59.883655 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:19:59.883655 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:19:59.883655 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:19:59.883655 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:19:59.885517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:19:59.885517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:19:59.885517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:19:59.885517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:19:59.885517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:19:59.885517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:19:59.885517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:19:59.885517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:19:59.885517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:19:59.885517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:19:59.885517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:19:59.885517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:19:59.885517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:19:59.885517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:19:59.885517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:19:59.885517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:19:59.887811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:19:59.887811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:19:59.887811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:19:59.887811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:19:59.887811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:19:59.887811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:19:59.887811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:19:59.887811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:19:59.887811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:19:59.887811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:19:59.887811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:19:59.887811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:19:59.887811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 282/571] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 1 16:19:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:19:59.887811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de50d8-a88a-4e07-89eb-258ef698f60b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:19:59.937056 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:59.989874 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087aedd-e347-415f-8c6a-f6e3de9ff6a8 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:00.031391 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2f126-8baf-4e2a-965b-4aa79a05c07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:00.032021 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2f126-8baf-4e2a-965b-4aa79a05c07f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:00.032289 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2f126-8baf-4e2a-965b-4aa79a05c07f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:00.032552 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2f126-8baf-4e2a-965b-4aa79a05c07f None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:00.033333 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2f126-8baf-4e2a-965b-4aa79a05c07f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:00.033633 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2f126-8baf-4e2a-965b-4aa79a05c07f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:00.035109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2f126-8baf-4e2a-965b-4aa79a05c07f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:00.047442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de50d8-a88a-4e07-89eb-258ef698f60b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:00.057236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 290/572] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Sep 1 16:19:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:00.058592 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2f126-8baf-4e2a-965b-4aa79a05c07f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:00.094343 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:00.099291 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7cb82-f4c6-4ce7-a9ea-d17bee0fccc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:00.100228 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7cb82-f4c6-4ce7-a9ea-d17bee0fccc8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:00.100596 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7cb82-f4c6-4ce7-a9ea-d17bee0fccc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:00.100994 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7cb82-f4c6-4ce7-a9ea-d17bee0fccc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:00.102100 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7cb82-f4c6-4ce7-a9ea-d17bee0fccc8 None admin] RBAC: Adding query filter params (role.id=93abdb875d35417d91e420a60ccafbd2, scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f, user.id=748e35d9a1534920860b2234d45f6724) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:00.102380 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7cb82-f4c6-4ce7-a9ea-d17bee0fccc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:00.104282 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7cb82-f4c6-4ce7-a9ea-d17bee0fccc8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:00.112242 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 283/573] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:19:59 2022] GET /identity/v3/role_assignments?user.id=748e35d9a1534920860b2234d45f6724&scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f&role.id=93abdb875d35417d91e420a60ccafbd2 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:00.113901 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7cb82-f4c6-4ce7-a9ea-d17bee0fccc8 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:00.248147 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2f126-8baf-4e2a-965b-4aa79a05c07f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:00.307851 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d27c49-553c-498f-b62c-19366fa5f405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:00.308645 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:00.308908 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d27c49-553c-498f-b62c-19366fa5f405 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:00.309353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d27c49-553c-498f-b62c-19366fa5f405 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:00.309792 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d27c49-553c-498f-b62c-19366fa5f405 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:00.322187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7cb82-f4c6-4ce7-a9ea-d17bee0fccc8 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:00.329085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d27c49-553c-498f-b62c-19366fa5f405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:00.338871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-e6d27c49-553c-498f-b62c-19366fa5f405 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:00.338871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:00.338871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:00.338871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:00.338871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:00.338871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:00.338871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:00.338871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:00.338871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:00.338871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:00.338871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:00.338871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:00.338871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:00.338871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:00.338871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:00.338871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:00.339859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:00.339859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:00.339859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:00.339859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:00.339859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:00.339859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:00.339859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:00.339859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:00.339859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:00.339859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:00.339859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:00.339859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:00.339859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:00.339859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:00.339859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:00.339859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:00.340729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:00.340729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:00.340729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:00.340729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:00.340729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:00.340729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:00.340729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:00.340729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:00.340729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:00.340729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:00.340729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:00.340729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:00.342005 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 291/574] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 1 16:20:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:00.343600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d27c49-553c-498f-b62c-19366fa5f405 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:00.383715 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa8c11-ce5b-4dfe-ae4b-38ced7461c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:00.384667 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa8c11-ce5b-4dfe-ae4b-38ced7461c23 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:00.385151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa8c11-ce5b-4dfe-ae4b-38ced7461c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:00.385629 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa8c11-ce5b-4dfe-ae4b-38ced7461c23 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:00.386801 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa8c11-ce5b-4dfe-ae4b-38ced7461c23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:00.387336 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa8c11-ce5b-4dfe-ae4b-38ced7461c23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:00.390048 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa8c11-ce5b-4dfe-ae4b-38ced7461c23 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:00.419527 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 284/575] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:00.419527 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa8c11-ce5b-4dfe-ae4b-38ced7461c23 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:00.492852 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:00.538633 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d27c49-553c-498f-b62c-19366fa5f405 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:00.597242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfdbcc-953b-4542-a2de-5c158f41281c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:00.598206 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfdbcc-953b-4542-a2de-5c158f41281c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:00.598649 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfdbcc-953b-4542-a2de-5c158f41281c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:00.599091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfdbcc-953b-4542-a2de-5c158f41281c None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:00.600222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfdbcc-953b-4542-a2de-5c158f41281c None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:00.600738 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfdbcc-953b-4542-a2de-5c158f41281c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:00.602732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfdbcc-953b-4542-a2de-5c158f41281c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:00.626586 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 292/576] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 1 16:20:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:00.626586 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfdbcc-953b-4542-a2de-5c158f41281c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:00.626932 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa8c11-ce5b-4dfe-ae4b-38ced7461c23 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:00.683148 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcef674-5cdf-4f62-ac3e-498c8750e8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:00.684375 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcef674-5cdf-4f62-ac3e-498c8750e8e0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:00.684998 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcef674-5cdf-4f62-ac3e-498c8750e8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:00.685591 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcef674-5cdf-4f62-ac3e-498c8750e8e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:00.706157 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcef674-5cdf-4f62-ac3e-498c8750e8e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:00.708973 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcef674-5cdf-4f62-ac3e-498c8750e8e0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:00.731183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-fbcef674-5cdf-4f62-ac3e-498c8750e8e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:00.731183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:00.731183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:00.731183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:00.731183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:00.731183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:00.731183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:00.731183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:00.731183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:00.731183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:00.731183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:00.731183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:00.731183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:00.731183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:00.731183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:00.731183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:00.733669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:00.733669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:00.733669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:00.733669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:00.733669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:00.733669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:00.733669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:00.733669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:00.733669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:00.733669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:00.733669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:00.733669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:00.733669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:00.733669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:00.733669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:00.733669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:00.733669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:00.735431 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:00.735431 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:00.735431 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:00.735431 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 285/577] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:00.735431 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcef674-5cdf-4f62-ac3e-498c8750e8e0 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:00.750845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:00.793020 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfdbcc-953b-4542-a2de-5c158f41281c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:00.842432 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e2d0e-65a9-44b1-bf7d-6be6b7c950ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:00.843909 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e2d0e-65a9-44b1-bf7d-6be6b7c950ca None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:00.844341 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e2d0e-65a9-44b1-bf7d-6be6b7c950ca None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:00.844836 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e2d0e-65a9-44b1-bf7d-6be6b7c950ca None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:00.845755 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e2d0e-65a9-44b1-bf7d-6be6b7c950ca None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:00.846196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e2d0e-65a9-44b1-bf7d-6be6b7c950ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:00.847817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e2d0e-65a9-44b1-bf7d-6be6b7c950ca None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:00.856190 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:00.868255 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 293/578] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 1 16:20:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:00.868255 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e2d0e-65a9-44b1-bf7d-6be6b7c950ca None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:00.885963 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcef674-5cdf-4f62-ac3e-498c8750e8e0 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:00.932108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09278733-84b7-464d-a3e9-6a353e457646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:00.932804 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09278733-84b7-464d-a3e9-6a353e457646 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:00.933147 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09278733-84b7-464d-a3e9-6a353e457646 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:00.933424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09278733-84b7-464d-a3e9-6a353e457646 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:00.944820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09278733-84b7-464d-a3e9-6a353e457646 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:00.946350 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09278733-84b7-464d-a3e9-6a353e457646 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:00.961412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-09278733-84b7-464d-a3e9-6a353e457646 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:20:00.961412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:00.961412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:00.961412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:00.961412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:00.961412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:00.961412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:00.961412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:00.961412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:00.961412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:00.961412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:00.961412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:00.961412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:00.961412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:00.961412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:00.961412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:00.962537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:00.962537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:00.962537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:00.962537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:00.962537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:00.962537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:00.962537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:00.962537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:00.962537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:00.962537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:00.962537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:00.962537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:00.962537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:00.962537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:00.962537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:00.962537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:00.962537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:00.962537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:00.964334 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:00.964334 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:00.964334 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:00.964334 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:00.964334 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:00.964334 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:00.964334 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:00.964334 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:00.964334 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:20:00.964334 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:00.964334 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 286/579] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Sep 1 16:20:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:00.964334 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09278733-84b7-464d-a3e9-6a353e457646 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:01.028868 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e2d0e-65a9-44b1-bf7d-6be6b7c950ca None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:01.050586 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:01.087875 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc5a2c-5801-4955-a450-f32071fbec6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:01.088530 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc5a2c-5801-4955-a450-f32071fbec6e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:01.089036 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc5a2c-5801-4955-a450-f32071fbec6e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:01.089448 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc5a2c-5801-4955-a450-f32071fbec6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:01.103742 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc5a2c-5801-4955-a450-f32071fbec6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:01.105572 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc5a2c-5801-4955-a450-f32071fbec6e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:01.111973 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09278733-84b7-464d-a3e9-6a353e457646 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:01.129156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-04cc5a2c-5801-4955-a450-f32071fbec6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:01.129156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:01.129156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:01.129156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:01.129156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:01.129156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:01.129156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:01.129156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:01.129156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:01.129156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:01.129156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:01.129156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:01.129156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:01.129156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:01.129156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:01.129156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:01.130196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:01.130196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:01.130196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:01.130196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:01.130196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:01.130196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:01.130196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:01.130196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:01.130196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:01.130196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:01.130196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:01.130196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:01.130196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:01.130196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:01.130196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:01.130196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:01.130196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:01.131053 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:01.131053 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:01.131053 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:01.131318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 294/580] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:01.132735 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc5a2c-5801-4955-a450-f32071fbec6e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:01.168240 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba446b78-3520-4534-b75f-732bc0944705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:01.169616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba446b78-3520-4534-b75f-732bc0944705 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:01.169769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba446b78-3520-4534-b75f-732bc0944705 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:01.170281 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba446b78-3520-4534-b75f-732bc0944705 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:01.172044 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba446b78-3520-4534-b75f-732bc0944705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:01.172571 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba446b78-3520-4534-b75f-732bc0944705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:01.175197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba446b78-3520-4534-b75f-732bc0944705 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:01.202787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 287/581] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:01.202787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba446b78-3520-4534-b75f-732bc0944705 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:01.214367 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:01.275731 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc5a2c-5801-4955-a450-f32071fbec6e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:01.319986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddbfd6-35d8-4fdb-adb0-0b4b75035fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:01.320629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddbfd6-35d8-4fdb-adb0-0b4b75035fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:01.320934 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddbfd6-35d8-4fdb-adb0-0b4b75035fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:01.321193 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddbfd6-35d8-4fdb-adb0-0b4b75035fd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:01.335071 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ddbfd6-35d8-4fdb-adb0-0b4b75035fd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:01.336575 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ddbfd6-35d8-4fdb-adb0-0b4b75035fd9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:01.344102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba446b78-3520-4534-b75f-732bc0944705 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:01.357722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-57ddbfd6-35d8-4fdb-adb0-0b4b75035fd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:01.357722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:01.357722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:01.357722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:01.357722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:01.357722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:01.357722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:01.357722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:01.357722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:01.357722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:01.357722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:01.357722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:01.357722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:01.357722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:01.357722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:01.357722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:01.358829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:01.358829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:01.358829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:01.358829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:01.358829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:01.358829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:01.358829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:01.358829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:01.358829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:01.358829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:01.358829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:01.358829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:01.358829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:01.358829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:01.358829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:01.358829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:01.358829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:01.362436 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:01.362436 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:01.362436 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:01.362436 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 295/582] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:01.362436 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddbfd6-35d8-4fdb-adb0-0b4b75035fd9 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:01.388974 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:01.401168 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c2b46-37d7-4d85-8748-94e7cb4e4022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:01.401933 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c2b46-37d7-4d85-8748-94e7cb4e4022 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:01.402318 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c2b46-37d7-4d85-8748-94e7cb4e4022 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:01.402619 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c2b46-37d7-4d85-8748-94e7cb4e4022 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:01.403497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c2b46-37d7-4d85-8748-94e7cb4e4022 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:01.403889 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c2b46-37d7-4d85-8748-94e7cb4e4022 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:01.406229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c2b46-37d7-4d85-8748-94e7cb4e4022 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:01.433467 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 288/583] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Sep 1 16:20:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:01.433467 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c2b46-37d7-4d85-8748-94e7cb4e4022 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:01.512966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddbfd6-35d8-4fdb-adb0-0b4b75035fd9 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:01.516217 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:01.559631 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91caefd4-d01e-4446-ba34-13785b57f2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:01.561044 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91caefd4-d01e-4446-ba34-13785b57f2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:01.561767 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91caefd4-d01e-4446-ba34-13785b57f2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:01.562269 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91caefd4-d01e-4446-ba34-13785b57f2e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:01.563405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91caefd4-d01e-4446-ba34-13785b57f2e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:01.563917 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91caefd4-d01e-4446-ba34-13785b57f2e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:01.566526 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91caefd4-d01e-4446-ba34-13785b57f2e4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:01.594438 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 296/584] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:01.595874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c2b46-37d7-4d85-8748-94e7cb4e4022 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:01.596834 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91caefd4-d01e-4446-ba34-13785b57f2e4 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:01.640303 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050e339-03ea-4b6b-b896-9c4235546979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:01.641007 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050e339-03ea-4b6b-b896-9c4235546979 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:01.641288 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050e339-03ea-4b6b-b896-9c4235546979 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:01.641562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050e339-03ea-4b6b-b896-9c4235546979 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:01.649750 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050e339-03ea-4b6b-b896-9c4235546979 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:01.651346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050e339-03ea-4b6b-b896-9c4235546979 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:01.670419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-d050e339-03ea-4b6b-b896-9c4235546979 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:01.670419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:01.670419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:01.670419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:01.670419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:01.670419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:01.670419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:01.670419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:01.670419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:01.670419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:01.670419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:01.670419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:01.670419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:01.670419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:01.670419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:01.672162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:01.672162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:01.672162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:01.672162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:01.672162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:01.672162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:01.672162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:01.672162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:01.672162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:01.672162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:01.672162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:01.672162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:01.672162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:01.672162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:01.672162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:01.672162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:01.672162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:01.674715 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:01.674715 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:01.674715 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:01.674715 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:01.674715 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:01.674715 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:01.674715 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:01.674715 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:01.679952 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 289/585] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:01.680365 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050e339-03ea-4b6b-b896-9c4235546979 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:01.749706 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:01.812134 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91caefd4-d01e-4446-ba34-13785b57f2e4 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:01.842091 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050e339-03ea-4b6b-b896-9c4235546979 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:01.883578 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ab59b-adb3-4d7e-863b-2058adc364d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:01.884867 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ab59b-adb3-4d7e-863b-2058adc364d5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:01.885444 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ab59b-adb3-4d7e-863b-2058adc364d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:01.886043 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ab59b-adb3-4d7e-863b-2058adc364d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:01.887354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ab59b-adb3-4d7e-863b-2058adc364d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:01.888024 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ab59b-adb3-4d7e-863b-2058adc364d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:01.888732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27153b35-821b-45ce-8e28-15af4f0e9ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:01.890267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27153b35-821b-45ce-8e28-15af4f0e9ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:01.890666 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27153b35-821b-45ce-8e28-15af4f0e9ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:01.891028 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27153b35-821b-45ce-8e28-15af4f0e9ae2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:01.891999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ab59b-adb3-4d7e-863b-2058adc364d5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:01.905181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27153b35-821b-45ce-8e28-15af4f0e9ae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:01.907261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27153b35-821b-45ce-8e28-15af4f0e9ae2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:01.921985 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 297/586] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:01.921985 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ab59b-adb3-4d7e-863b-2058adc364d5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:01.931071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-27153b35-821b-45ce-8e28-15af4f0e9ae2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:01.931071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:01.931071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:01.931071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:01.931071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:01.931071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:01.931071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:01.931071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:01.931071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:01.931071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:01.931071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:01.931071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:01.931071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:01.931071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:01.931071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:01.931071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:01.933224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:01.933224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:01.933224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:01.933224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:01.933224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:01.933224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:01.933224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:01.933224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:01.933224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:01.933224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:01.933224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:01.933224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:01.933224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:01.933224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:01.933224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:01.933224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:01.933224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:01.935248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:01.935248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:01.935248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:01.941972 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 290/587] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:01.943365 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27153b35-821b-45ce-8e28-15af4f0e9ae2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:01.977423 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:02.096910 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:02.103824 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27153b35-821b-45ce-8e28-15af4f0e9ae2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:02.121108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ab59b-adb3-4d7e-863b-2058adc364d5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:02.172170 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36fbeb-6722-4223-81e2-07f43b3116fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:02.173462 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36fbeb-6722-4223-81e2-07f43b3116fb None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:02.173876 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36fbeb-6722-4223-81e2-07f43b3116fb None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:02.174373 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36fbeb-6722-4223-81e2-07f43b3116fb None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:02.175723 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d36fbeb-6722-4223-81e2-07f43b3116fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:02.176334 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d36fbeb-6722-4223-81e2-07f43b3116fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:02.179512 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d36fbeb-6722-4223-81e2-07f43b3116fb None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:02.186009 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bff42-4457-43f6-b7ec-5a39d6b36757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:02.187452 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bff42-4457-43f6-b7ec-5a39d6b36757 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:02.187920 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bff42-4457-43f6-b7ec-5a39d6b36757 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:02.188378 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bff42-4457-43f6-b7ec-5a39d6b36757 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:02.202882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418bff42-4457-43f6-b7ec-5a39d6b36757 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:02.209387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 291/588] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:02.209592 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418bff42-4457-43f6-b7ec-5a39d6b36757 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:02.209686 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36fbeb-6722-4223-81e2-07f43b3116fb None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:02.232452 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-418bff42-4457-43f6-b7ec-5a39d6b36757 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 16:20:02.232452 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:02.232452 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:02.232452 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:02.232452 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:02.232452 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:02.232452 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:02.232452 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:02.232452 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:02.232452 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:02.232452 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:02.232452 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:02.232452 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:02.232452 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:02.232452 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:02.232452 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:02.233759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:02.233759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:02.233759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:02.233759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:02.233759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:02.233759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:02.233759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:02.233759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:02.233759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:02.233759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:02.233759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:02.233759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:02.233759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:02.233759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:02.233759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:02.233759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:02.233759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:02.233759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:02.234995 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:02.234995 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:02.234995 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:02.234995 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:02.234995 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:02.234995 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:02.234995 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:02.234995 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:02.234995 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 16:20:02.234995 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:02.237250 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 298/589] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 1 16:20:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:02.238875 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bff42-4457-43f6-b7ec-5a39d6b36757 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:02.393455 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:02.400268 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36fbeb-6722-4223-81e2-07f43b3116fb None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:02.415461 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bff42-4457-43f6-b7ec-5a39d6b36757 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:02.459846 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a9dbd-b447-41cb-815d-ab94f072bc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:02.460549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a9dbd-b447-41cb-815d-ab94f072bc48 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:02.460924 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a9dbd-b447-41cb-815d-ab94f072bc48 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:02.461255 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a9dbd-b447-41cb-815d-ab94f072bc48 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:02.461980 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a9dbd-b447-41cb-815d-ab94f072bc48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:02.462336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a9dbd-b447-41cb-815d-ab94f072bc48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:02.464031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a9dbd-b447-41cb-815d-ab94f072bc48 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:02.474050 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e28452-5372-4fad-a115-83cc082760d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:02.475167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e28452-5372-4fad-a115-83cc082760d7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:02.475670 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e28452-5372-4fad-a115-83cc082760d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:02.476176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e28452-5372-4fad-a115-83cc082760d7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:02.487041 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 299/590] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:02.487041 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a9dbd-b447-41cb-815d-ab94f072bc48 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:02.498491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e28452-5372-4fad-a115-83cc082760d7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:02.501781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e28452-5372-4fad-a115-83cc082760d7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:02.525543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-03e28452-5372-4fad-a115-83cc082760d7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:20:02.525543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:02.525543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:02.525543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:02.525543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:02.525543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:02.525543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:02.525543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:02.525543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:02.525543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:02.525543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:02.525543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:02.525543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:02.525543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:02.525543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:02.525543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:02.527487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:02.527487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:02.527487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:02.527487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:02.527487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:02.527487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:02.527487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:02.527487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:02.527487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:02.527487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:02.527487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:02.527487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:02.527487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:02.527487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:02.527487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:02.527487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:02.527487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:02.527487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:02.529314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:02.529314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:02.529314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:02.529314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:02.529314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:02.529314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:02.529314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:02.529314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:02.529314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:20:02.529314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:02.529314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 292/591] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:20:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:02.529314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e28452-5372-4fad-a115-83cc082760d7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:02.571851 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:02.632429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a9dbd-b447-41cb-815d-ab94f072bc48 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:02.696173 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425ca26-d9b0-454b-99fe-baa9488d5003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:02.697110 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425ca26-d9b0-454b-99fe-baa9488d5003 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:02.697554 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425ca26-d9b0-454b-99fe-baa9488d5003 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:02.697992 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425ca26-d9b0-454b-99fe-baa9488d5003 None admin] PATH_INFO: `/v3/projects/43f5c22e38824a8b8dff2f9b4bc1df3f/users/c2feb3132ad9497aaae8720ed170ef3e/roles/93abdb875d35417d91e420a60ccafbd2` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:02.723500 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425ca26-d9b0-454b-99fe-baa9488d5003 None admin] RBAC: Authorizing `identity:create_grant(project_id=43f5c22e38824a8b8dff2f9b4bc1df3f, user_id=c2feb3132ad9497aaae8720ed170ef3e, role_id=93abdb875d35417d91e420a60ccafbd2)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:02.726046 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425ca26-d9b0-454b-99fe-baa9488d5003 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:02.727844 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e28452-5372-4fad-a115-83cc082760d7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:02.732070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:02.747498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 300/592] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 1 16:20:02 2022] PUT /identity/v3/projects/43f5c22e38824a8b8dff2f9b4bc1df3f/users/c2feb3132ad9497aaae8720ed170ef3e/roles/93abdb875d35417d91e420a60ccafbd2 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:20:02.749279 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425ca26-d9b0-454b-99fe-baa9488d5003 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:02.793373 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d89a0-ec80-44b1-b3ca-b889ded191da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:02.794332 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d89a0-ec80-44b1-b3ca-b889ded191da None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:02.794766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d89a0-ec80-44b1-b3ca-b889ded191da None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:02.795271 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d89a0-ec80-44b1-b3ca-b889ded191da None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:02.797054 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d89a0-ec80-44b1-b3ca-b889ded191da None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:02.797375 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d89a0-ec80-44b1-b3ca-b889ded191da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:02.799505 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d89a0-ec80-44b1-b3ca-b889ded191da None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:02.842906 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 293/593] 10.222.0.52 () {56 vars in 1139 bytes} [Thu Sep 1 16:20:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:02.842906 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d89a0-ec80-44b1-b3ca-b889ded191da None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:02.972959 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425ca26-d9b0-454b-99fe-baa9488d5003 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:02.992266 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:03.036888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d89a0-ec80-44b1-b3ca-b889ded191da None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:03.038439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26600cb0-6d90-4612-9dad-b8248efbb5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:03.039531 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26600cb0-6d90-4612-9dad-b8248efbb5d8 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:03.039964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26600cb0-6d90-4612-9dad-b8248efbb5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:03.040444 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26600cb0-6d90-4612-9dad-b8248efbb5d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:03.054452 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26600cb0-6d90-4612-9dad-b8248efbb5d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:03.057301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26600cb0-6d90-4612-9dad-b8248efbb5d8 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:03.075271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-26600cb0-6d90-4612-9dad-b8248efbb5d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:03.075271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:03.075271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:03.075271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:03.075271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:03.075271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:03.075271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:03.075271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:03.075271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:03.075271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:03.075271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:03.075271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:03.075271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:03.075271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:03.075271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:03.077513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:03.077513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:03.077513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:03.077513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:03.077513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:03.077513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:03.077513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:03.077513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:03.077513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:03.077513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:03.077513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:03.077513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:03.077513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:03.077513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:03.077513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:03.077513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:03.077513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:03.079891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:03.079891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:03.079891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:03.079891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:03.079891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:03.079891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:03.079891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:03.079891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:03.079891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 301/594] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:03.079891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c94c6-03c2-4f4c-ab38-9517b01687fb None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:03.079891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c94c6-03c2-4f4c-ab38-9517b01687fb None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:03.081819 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c94c6-03c2-4f4c-ab38-9517b01687fb None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:03.081819 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 302/595] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:03.082216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c94c6-03c2-4f4c-ab38-9517b01687fb None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:03.114459 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e4845-861b-4699-a6ad-65cf3f8769cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:03.115516 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e4845-861b-4699-a6ad-65cf3f8769cc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:03.115962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e4845-861b-4699-a6ad-65cf3f8769cc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:03.116388 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e4845-861b-4699-a6ad-65cf3f8769cc None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:03.117714 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e4845-861b-4699-a6ad-65cf3f8769cc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:03.118243 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e4845-861b-4699-a6ad-65cf3f8769cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:03.120763 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e4845-861b-4699-a6ad-65cf3f8769cc None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:03.152314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 294/596] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Sep 1 16:20:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:03.153920 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e4845-861b-4699-a6ad-65cf3f8769cc None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:03.192522 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:03.283716 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c94c6-03c2-4f4c-ab38-9517b01687fb None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:03.303777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e4845-861b-4699-a6ad-65cf3f8769cc None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:03.332309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ac880-7b4a-49fb-9bfe-951e8d92929c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:03.332983 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ac880-7b4a-49fb-9bfe-951e8d92929c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:03.333310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ac880-7b4a-49fb-9bfe-951e8d92929c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:03.333525 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ac880-7b4a-49fb-9bfe-951e8d92929c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:03.346285 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ac880-7b4a-49fb-9bfe-951e8d92929c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:03.347987 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ac880-7b4a-49fb-9bfe-951e8d92929c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:03.364398 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-f91ac880-7b4a-49fb-9bfe-951e8d92929c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:03.364398 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:03.364398 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:03.364398 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:03.364398 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:03.364398 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:03.364398 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:03.364398 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:03.364398 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:03.364398 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:03.364398 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:03.364398 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:03.364398 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:03.364398 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:03.364398 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:03.364398 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:03.365606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:03.365606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:03.365606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:03.365606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:03.365606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:03.365606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:03.365606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:03.365606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:03.365606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:03.365606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:03.365606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:03.365606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:03.365606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:03.365606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:03.365606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:03.365606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:03.365606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:03.366455 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:03.366455 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:03.366455 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:03.366455 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 303/597] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:03.367205 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56b846-6039-401e-88fb-905654b89d84 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:03.367478 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56b846-6039-401e-88fb-905654b89d84 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:03.367747 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56b846-6039-401e-88fb-905654b89d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:03.374547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f84504-2a56-4cc8-92e7-6e2bc10d5264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:03.375864 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f84504-2a56-4cc8-92e7-6e2bc10d5264 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:03.376350 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f84504-2a56-4cc8-92e7-6e2bc10d5264 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:03.376858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f84504-2a56-4cc8-92e7-6e2bc10d5264 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:03.378059 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f84504-2a56-4cc8-92e7-6e2bc10d5264 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:03.379537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f84504-2a56-4cc8-92e7-6e2bc10d5264 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:03.381406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f84504-2a56-4cc8-92e7-6e2bc10d5264 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:03.383618 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:03.391262 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-fe56b846-6039-401e-88fb-905654b89d84 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:03.392774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fe56b846-6039-401e-88fb-905654b89d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:03.409780 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 295/598] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:03.409780 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f84504-2a56-4cc8-92e7-6e2bc10d5264 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:03.485254 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 304/599] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:20:03.485254 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56b846-6039-401e-88fb-905654b89d84 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:03.534833 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:03.608457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f84504-2a56-4cc8-92e7-6e2bc10d5264 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:03.640747 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56b846-6039-401e-88fb-905654b89d84 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:03.659051 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e935a6-ba61-412a-b98c-290bcec00075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:03.660053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e935a6-ba61-412a-b98c-290bcec00075 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:03.660516 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e935a6-ba61-412a-b98c-290bcec00075 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:03.660995 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e935a6-ba61-412a-b98c-290bcec00075 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:03.677414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e935a6-ba61-412a-b98c-290bcec00075 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:03.680201 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e935a6-ba61-412a-b98c-290bcec00075 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:03.702502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-75e935a6-ba61-412a-b98c-290bcec00075 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:03.702502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:03.702502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:03.702502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:03.702502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:03.702502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:03.702502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:03.702502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:03.702502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:03.702502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:03.702502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:03.702502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:03.702502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:03.702502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:03.702502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:03.702502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:03.703541 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:03.703541 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:03.703541 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:03.703541 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:03.703541 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:03.703541 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:03.703541 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:03.703541 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:03.703541 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:03.703541 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:03.703541 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:03.703541 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:03.703541 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:03.703541 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:03.703541 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:03.703541 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:03.703541 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:03.704408 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:03.704408 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:03.704408 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:03.705732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523f722-f3e5-439f-9d8a-1ab8df572403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:03.706651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 296/600] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:03.706906 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523f722-f3e5-439f-9d8a-1ab8df572403 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:03.707494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523f722-f3e5-439f-9d8a-1ab8df572403 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:03.708004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523f722-f3e5-439f-9d8a-1ab8df572403 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:03.708461 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e935a6-ba61-412a-b98c-290bcec00075 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:03.710972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523f722-f3e5-439f-9d8a-1ab8df572403 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:03.711669 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523f722-f3e5-439f-9d8a-1ab8df572403 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:03.714221 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523f722-f3e5-439f-9d8a-1ab8df572403 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:03.743901 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 305/601] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:03.745299 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523f722-f3e5-439f-9d8a-1ab8df572403 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:03.774147 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:03.852777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e935a6-ba61-412a-b98c-290bcec00075 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:03.910157 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:03.918706 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523f722-f3e5-439f-9d8a-1ab8df572403 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:03.920698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed0608-8a28-4a8a-ab37-e2282a3cac6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:03.922013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed0608-8a28-4a8a-ab37-e2282a3cac6f None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:03.922436 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed0608-8a28-4a8a-ab37-e2282a3cac6f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:03.922850 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed0608-8a28-4a8a-ab37-e2282a3cac6f None admin] PATH_INFO: `/v3/projects/43f5c22e38824a8b8dff2f9b4bc1df3f/users/55f389ab3ea046008b44f129113de995/roles/93abdb875d35417d91e420a60ccafbd2` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:03.952898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed0608-8a28-4a8a-ab37-e2282a3cac6f None admin] RBAC: Authorizing `identity:create_grant(project_id=43f5c22e38824a8b8dff2f9b4bc1df3f, user_id=55f389ab3ea046008b44f129113de995, role_id=93abdb875d35417d91e420a60ccafbd2)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:03.955614 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed0608-8a28-4a8a-ab37-e2282a3cac6f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:03.974365 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d6397-4615-4073-b0e6-3d77cff6469f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:03.975634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d6397-4615-4073-b0e6-3d77cff6469f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:03.976102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d6397-4615-4073-b0e6-3d77cff6469f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:03.976879 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d6397-4615-4073-b0e6-3d77cff6469f None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:03.978261 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d6397-4615-4073-b0e6-3d77cff6469f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:03.978796 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d6397-4615-4073-b0e6-3d77cff6469f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:03.979827 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 297/602] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 1 16:20:03 2022] PUT /identity/v3/projects/43f5c22e38824a8b8dff2f9b4bc1df3f/users/55f389ab3ea046008b44f129113de995/roles/93abdb875d35417d91e420a60ccafbd2 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:20:03.981941 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d6397-4615-4073-b0e6-3d77cff6469f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:03.989810 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed0608-8a28-4a8a-ab37-e2282a3cac6f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:04.009249 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 306/603] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:04.010848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d6397-4615-4073-b0e6-3d77cff6469f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:04.152258 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:04.164996 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed0608-8a28-4a8a-ab37-e2282a3cac6f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:04.172982 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d6397-4615-4073-b0e6-3d77cff6469f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:04.216521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ec589-bab0-41f9-a8bf-cb9f8cea3e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:04.217826 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ec589-bab0-41f9-a8bf-cb9f8cea3e10 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:04.218046 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ec589-bab0-41f9-a8bf-cb9f8cea3e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:04.218322 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ec589-bab0-41f9-a8bf-cb9f8cea3e10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:04.225465 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22d6cb-9766-4ceb-b189-b0d4492bc00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:04.226130 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22d6cb-9766-4ceb-b189-b0d4492bc00a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:04.226405 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22d6cb-9766-4ceb-b189-b0d4492bc00a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:04.226675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22d6cb-9766-4ceb-b189-b0d4492bc00a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:04.241078 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22d6cb-9766-4ceb-b189-b0d4492bc00a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:04.242975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22d6cb-9766-4ceb-b189-b0d4492bc00a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:04.244033 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ec589-bab0-41f9-a8bf-cb9f8cea3e10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:04.249229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-b51ec589-bab0-41f9-a8bf-cb9f8cea3e10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:04.249229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:04.249229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:04.249229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:04.249229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:04.249229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:04.249229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:04.249229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:04.249229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:04.249229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:04.249229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:04.249229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:04.249229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:04.249229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:04.249229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:04.249229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:04.250483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:04.250483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:04.250483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:04.250483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:04.250483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:04.250483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:04.250483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:04.250483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:04.250483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:04.250483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:04.250483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:04.250483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:04.250483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:04.250483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:04.250483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:04.250483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:04.251310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:04.251310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:04.251310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:04.251310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:04.251310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:04.251310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:04.251310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:04.251310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:04.251310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:04.251310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:04.251310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:04.251310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:04.251310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 307/604] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 1 16:20:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:04.252001 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ec589-bab0-41f9-a8bf-cb9f8cea3e10 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:04.269577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-5b22d6cb-9766-4ceb-b189-b0d4492bc00a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:04.269577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:04.269577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:04.269577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:04.269577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:04.269577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:04.269577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:04.269577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:04.269577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:04.269577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:04.269577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:04.269577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:04.269577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:04.269577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:04.269577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:04.270606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:04.270606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:04.270606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:04.270606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:04.270606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:04.270606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:04.270606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:04.270606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:04.270606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:04.270606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:04.270606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:04.270606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:04.270606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:04.270606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:04.270606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:04.270606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:04.270606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:04.271479 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:04.271479 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:04.271479 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:04.271479 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:04.271479 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:04.271479 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:04.271479 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:04.271479 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:04.272992 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 298/605] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:04.274693 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22d6cb-9766-4ceb-b189-b0d4492bc00a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:04.290251 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:04.427284 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ec589-bab0-41f9-a8bf-cb9f8cea3e10 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:04.439781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22d6cb-9766-4ceb-b189-b0d4492bc00a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:04.469952 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7ca05-3a03-49a6-8da8-147d711d9a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:04.470606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7ca05-3a03-49a6-8da8-147d711d9a59 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:04.470885 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7ca05-3a03-49a6-8da8-147d711d9a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:04.471154 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7ca05-3a03-49a6-8da8-147d711d9a59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:04.479299 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7ca05-3a03-49a6-8da8-147d711d9a59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:04.480843 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7ca05-3a03-49a6-8da8-147d711d9a59 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:04.493565 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1821d38-6443-4be8-91aa-cebd84a1f216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:04.494096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-76e7ca05-3a03-49a6-8da8-147d711d9a59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:04.494096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:04.494096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:04.494096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:04.494096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:04.494096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:04.494096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:04.494096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:04.494096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:04.494096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:04.494096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:04.494096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:04.494096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:04.494096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:04.494096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:04.494949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:04.494949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:04.494949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:04.494949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:04.494949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:04.494949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:04.494949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:04.494949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:04.494949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:04.494949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:04.494949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:04.494949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:04.494949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:04.494949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:04.494949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:04.494949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:04.494949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:04.495954 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:04.495954 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:04.495954 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:04.495954 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:04.495954 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:04.495954 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:04.495954 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:04.495954 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:04.495954 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 308/606] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:04.496426 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7ca05-3a03-49a6-8da8-147d711d9a59 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:04.497834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1821d38-6443-4be8-91aa-cebd84a1f216 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:04.499061 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1821d38-6443-4be8-91aa-cebd84a1f216 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:04.499605 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1821d38-6443-4be8-91aa-cebd84a1f216 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:04.501187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1821d38-6443-4be8-91aa-cebd84a1f216 None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:04.502811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1821d38-6443-4be8-91aa-cebd84a1f216 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:04.504503 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1821d38-6443-4be8-91aa-cebd84a1f216 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:04.516216 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 299/607] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 1 16:20:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:04.521336 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1821d38-6443-4be8-91aa-cebd84a1f216 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:04.543732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:04.619826 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:04.644970 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1821d38-6443-4be8-91aa-cebd84a1f216 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:04.659604 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7ca05-3a03-49a6-8da8-147d711d9a59 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:04.688832 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79168fd0-0596-45a6-8ef6-5ba1675713fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:04.690669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79168fd0-0596-45a6-8ef6-5ba1675713fd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:04.691419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79168fd0-0596-45a6-8ef6-5ba1675713fd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:04.692008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79168fd0-0596-45a6-8ef6-5ba1675713fd None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:04.693338 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79168fd0-0596-45a6-8ef6-5ba1675713fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:04.694497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79168fd0-0596-45a6-8ef6-5ba1675713fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:04.697323 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79168fd0-0596-45a6-8ef6-5ba1675713fd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:04.706747 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb0433-9863-4ab1-b3a7-c3fddf3f050d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:04.707379 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb0433-9863-4ab1-b3a7-c3fddf3f050d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:04.707659 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb0433-9863-4ab1-b3a7-c3fddf3f050d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:04.707932 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb0433-9863-4ab1-b3a7-c3fddf3f050d None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:04.708695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb0433-9863-4ab1-b3a7-c3fddf3f050d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:04.709004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb0433-9863-4ab1-b3a7-c3fddf3f050d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:04.710938 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb0433-9863-4ab1-b3a7-c3fddf3f050d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:04.718833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 300/608] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:04.720237 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79168fd0-0596-45a6-8ef6-5ba1675713fd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:04.732664 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 309/609] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:04.734218 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb0433-9863-4ab1-b3a7-c3fddf3f050d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:04.853622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:04.859517 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb0433-9863-4ab1-b3a7-c3fddf3f050d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:04.890521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79168fd0-0596-45a6-8ef6-5ba1675713fd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:04.909379 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b79b2-3fd1-4382-9387-a91c825dc6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:04.910283 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b79b2-3fd1-4382-9387-a91c825dc6a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:04.910396 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b79b2-3fd1-4382-9387-a91c825dc6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:04.910595 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b79b2-3fd1-4382-9387-a91c825dc6a7 None admin] PATH_INFO: `/v3/projects/43f5c22e38824a8b8dff2f9b4bc1df3f/users/80a92eaeb5c54414864deef3052bd8f2/roles/93abdb875d35417d91e420a60ccafbd2` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:04.915785 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:04.931640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b79b2-3fd1-4382-9387-a91c825dc6a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=43f5c22e38824a8b8dff2f9b4bc1df3f, user_id=80a92eaeb5c54414864deef3052bd8f2, role_id=93abdb875d35417d91e420a60ccafbd2)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:04.933206 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b79b2-3fd1-4382-9387-a91c825dc6a7 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:04.952294 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 310/610] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 1 16:20:04 2022] PUT /identity/v3/projects/43f5c22e38824a8b8dff2f9b4bc1df3f/users/80a92eaeb5c54414864deef3052bd8f2/roles/93abdb875d35417d91e420a60ccafbd2 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:20:04.953294 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b79b2-3fd1-4382-9387-a91c825dc6a7 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:04.954140 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f25d3-1ac6-495c-aa0a-0254e4e738f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:04.955099 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f25d3-1ac6-495c-aa0a-0254e4e738f6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:04.955613 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f25d3-1ac6-495c-aa0a-0254e4e738f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:04.956567 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f25d3-1ac6-495c-aa0a-0254e4e738f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:04.975792 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f25d3-1ac6-495c-aa0a-0254e4e738f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:04.978290 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f25d3-1ac6-495c-aa0a-0254e4e738f6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:05.004660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-534f25d3-1ac6-495c-aa0a-0254e4e738f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:05.004660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:05.004660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:05.004660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:05.004660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:05.004660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:05.004660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:05.004660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:05.004660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:05.004660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:05.004660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:05.004660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:05.004660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:05.004660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:05.004660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:05.004660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:05.005695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:05.005695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:05.005695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:05.005695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:05.005695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:05.005695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:05.005695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:05.005695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:05.005695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:05.005695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:05.005695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:05.005695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:05.005695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:05.005695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:05.005695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:05.005695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:05.005695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:05.006696 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:05.006696 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:05.006696 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:05.010329 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 301/611] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:05.019321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f25d3-1ac6-495c-aa0a-0254e4e738f6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:05.173587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f25d3-1ac6-495c-aa0a-0254e4e738f6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:05.198988 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b79b2-3fd1-4382-9387-a91c825dc6a7 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:05.217089 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:05.225901 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d4260-2f84-419f-87a1-02adc7b771ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:05.228162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d4260-2f84-419f-87a1-02adc7b771ae None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:05.229909 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d4260-2f84-419f-87a1-02adc7b771ae None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:05.230756 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d4260-2f84-419f-87a1-02adc7b771ae None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:05.231673 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d4260-2f84-419f-87a1-02adc7b771ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:05.233732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d4260-2f84-419f-87a1-02adc7b771ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:05.235429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d4260-2f84-419f-87a1-02adc7b771ae None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:05.254814 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 302/612] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:05.261439 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d4260-2f84-419f-87a1-02adc7b771ae None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:05.267062 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937e68a-fa0f-4790-821f-b474b95be6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:05.268490 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937e68a-fa0f-4790-821f-b474b95be6e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:05.268996 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937e68a-fa0f-4790-821f-b474b95be6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:05.269513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937e68a-fa0f-4790-821f-b474b95be6e0 None admin] PATH_INFO: `/v3/projects/43f5c22e38824a8b8dff2f9b4bc1df3f/users/0668b918bf2c49c2901838cd22770030/roles/93abdb875d35417d91e420a60ccafbd2` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:05.291849 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937e68a-fa0f-4790-821f-b474b95be6e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=43f5c22e38824a8b8dff2f9b4bc1df3f, user_id=0668b918bf2c49c2901838cd22770030, role_id=93abdb875d35417d91e420a60ccafbd2)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:05.294635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937e68a-fa0f-4790-821f-b474b95be6e0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:05.318176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 311/613] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 1 16:20:04 2022] PUT /identity/v3/projects/43f5c22e38824a8b8dff2f9b4bc1df3f/users/0668b918bf2c49c2901838cd22770030/roles/93abdb875d35417d91e420a60ccafbd2 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:20:05.407926 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d4260-2f84-419f-87a1-02adc7b771ae None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:05.456575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0577e9e-dbc2-464e-85af-f0882e27c879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:05.457618 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0577e9e-dbc2-464e-85af-f0882e27c879 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:05.458099 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0577e9e-dbc2-464e-85af-f0882e27c879 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:05.458595 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0577e9e-dbc2-464e-85af-f0882e27c879 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:05.468335 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0577e9e-dbc2-464e-85af-f0882e27c879 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:05.470214 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0577e9e-dbc2-464e-85af-f0882e27c879 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:05.484587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-e0577e9e-dbc2-464e-85af-f0882e27c879 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:20:05.484587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:05.484587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:05.484587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:05.484587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:05.484587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:05.484587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:05.484587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:05.484587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:05.484587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:05.484587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:05.484587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:05.484587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:05.484587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:05.484587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:05.484587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:05.485633 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:05.485633 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:05.485633 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:05.485633 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:05.485633 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:05.485633 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:05.485633 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:05.485633 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:05.485633 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:05.485633 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:05.485633 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:05.485633 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:05.485633 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:05.485633 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:05.485633 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:05.485633 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:05.485633 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:05.485633 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:05.486545 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:05.486545 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:05.486545 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:05.486545 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:05.486545 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:05.486545 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:05.486545 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:05.486545 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:05.486545 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:20:05.486545 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:05.489419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 303/614] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:20:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:05.495089 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937e68a-fa0f-4790-821f-b474b95be6e0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:05.549374 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:05.646038 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937e68a-fa0f-4790-821f-b474b95be6e0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:05.690898 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9761cc45-badb-4fca-a6df-8277309e91dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:05.691920 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761cc45-badb-4fca-a6df-8277309e91dd None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:05.692430 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761cc45-badb-4fca-a6df-8277309e91dd None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:05.693072 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761cc45-badb-4fca-a6df-8277309e91dd None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:05.694051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9761cc45-badb-4fca-a6df-8277309e91dd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:05.694566 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9761cc45-badb-4fca-a6df-8277309e91dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:05.696674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9761cc45-badb-4fca-a6df-8277309e91dd None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:05.719464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 312/615] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Sep 1 16:20:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:05.724929 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0577e9e-dbc2-464e-85af-f0882e27c879 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:05.810997 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:05.815172 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a537d37-2722-47b0-81dd-bcb3a7fb3fad None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:05.815673 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a537d37-2722-47b0-81dd-bcb3a7fb3fad None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:05.816281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a537d37-2722-47b0-81dd-bcb3a7fb3fad None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:05.824807 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 313/616] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:05.829040 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d4605-a246-4b44-a44d-ddfceaedd031 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:05.829542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d4605-a246-4b44-a44d-ddfceaedd031 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:05.830036 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d4605-a246-4b44-a44d-ddfceaedd031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:05.880855 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-7d2d4605-a246-4b44-a44d-ddfceaedd031 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:05.883447 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7d2d4605-a246-4b44-a44d-ddfceaedd031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:05.886697 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0577e9e-dbc2-464e-85af-f0882e27c879 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:05.931374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc546e2-90a1-40c3-9dc3-a2962314efe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:05.932526 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc546e2-90a1-40c3-9dc3-a2962314efe1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:05.933063 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc546e2-90a1-40c3-9dc3-a2962314efe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:05.933550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc546e2-90a1-40c3-9dc3-a2962314efe1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:05.947947 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc546e2-90a1-40c3-9dc3-a2962314efe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:05.950003 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc546e2-90a1-40c3-9dc3-a2962314efe1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:05.968510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-fdc546e2-90a1-40c3-9dc3-a2962314efe1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:05.968510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:05.968510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:05.968510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:05.968510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:05.968510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:05.968510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:05.968510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:05.968510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:05.968510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:05.968510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:05.968510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:05.968510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:05.968510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:05.968510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:05.968510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:05.969608 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:05.969608 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:05.969608 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:05.969608 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:05.969608 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:05.969608 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:05.969608 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:05.969608 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:05.969608 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:05.969608 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:05.969608 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:05.969608 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:05.969608 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:05.969608 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:05.969608 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:05.969608 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:05.969608 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:05.970647 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:05.970647 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:05.970647 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:05.973454 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 304/617] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:05.985720 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc546e2-90a1-40c3-9dc3-a2962314efe1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:06.110080 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 314/618] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:20:06.184663 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc546e2-90a1-40c3-9dc3-a2962314efe1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:06.192348 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:06.274669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087c47e-f36d-4365-ba2a-1c518df302a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:06.275528 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087c47e-f36d-4365-ba2a-1c518df302a1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:06.275972 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087c47e-f36d-4365-ba2a-1c518df302a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:06.276420 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087c47e-f36d-4365-ba2a-1c518df302a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:06.277688 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087c47e-f36d-4365-ba2a-1c518df302a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:06.278215 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087c47e-f36d-4365-ba2a-1c518df302a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:06.281074 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087c47e-f36d-4365-ba2a-1c518df302a1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:06.307829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 305/619] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:06.313797 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d4605-a246-4b44-a44d-ddfceaedd031 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:06.362650 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:06.495680 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d4605-a246-4b44-a44d-ddfceaedd031 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:06.551819 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661e7d5-c4d9-4d6b-9f0b-f1914704a45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:06.552369 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661e7d5-c4d9-4d6b-9f0b-f1914704a45b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:06.552657 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087c47e-f36d-4365-ba2a-1c518df302a1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:06.552836 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661e7d5-c4d9-4d6b-9f0b-f1914704a45b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:06.552971 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661e7d5-c4d9-4d6b-9f0b-f1914704a45b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:06.565896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661e7d5-c4d9-4d6b-9f0b-f1914704a45b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:06.567402 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661e7d5-c4d9-4d6b-9f0b-f1914704a45b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:06.586773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-8661e7d5-c4d9-4d6b-9f0b-f1914704a45b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:06.586773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:06.586773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:06.586773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:06.586773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:06.586773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:06.586773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:06.586773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:06.586773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:06.586773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:06.586773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:06.586773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:06.586773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:06.586773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:06.586773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:06.588576 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:06.588576 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:06.588576 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:06.588576 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:06.588576 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:06.588576 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:06.588576 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:06.588576 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:06.588576 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:06.588576 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:06.588576 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:06.588576 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:06.588576 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:06.588576 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:06.588576 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:06.588576 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:06.588576 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:06.590773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:06.590773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:06.590773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:06.590773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:06.590773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:06.590773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:06.590773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:06.590773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:06.590773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 315/620] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:06.594770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661e7d5-c4d9-4d6b-9f0b-f1914704a45b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:06.820475 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087c47e-f36d-4365-ba2a-1c518df302a1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:06.837149 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:06.870485 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661e7d5-c4d9-4d6b-9f0b-f1914704a45b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:06.901950 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6da7f-103d-4245-bf96-f94c5ddd1c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:06.902602 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6da7f-103d-4245-bf96-f94c5ddd1c75 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:06.902872 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6da7f-103d-4245-bf96-f94c5ddd1c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:06.903146 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6da7f-103d-4245-bf96-f94c5ddd1c75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:06.924749 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6da7f-103d-4245-bf96-f94c5ddd1c75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:06.929969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-7fa6da7f-103d-4245-bf96-f94c5ddd1c75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:06.929969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:06.929969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:06.929969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:06.929969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:06.929969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:06.929969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:06.929969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:06.929969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:06.929969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:06.929969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:06.929969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:06.929969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:06.929969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:06.929969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:06.929969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:06.931933 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:06.931933 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:06.931933 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:06.931933 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:06.931933 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:06.931933 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:06.931933 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:06.931933 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:06.931933 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:06.931933 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:06.931933 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:06.931933 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:06.931933 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:06.931933 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:06.931933 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:06.931933 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:06.933521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:06.933521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:06.933521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:06.933521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:06.933521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:06.933521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:06.933521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:06.933521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:06.933521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:06.933521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:06.933521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:06.933521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:06.933521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 306/621] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 1 16:20:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:06.950354 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6da7f-103d-4245-bf96-f94c5ddd1c75 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:06.980235 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27f738-ea57-4635-b400-8c00ed9b7d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:06.980912 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27f738-ea57-4635-b400-8c00ed9b7d79 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:06.981193 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27f738-ea57-4635-b400-8c00ed9b7d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:06.981473 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27f738-ea57-4635-b400-8c00ed9b7d79 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:06.982191 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27f738-ea57-4635-b400-8c00ed9b7d79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:06.982558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27f738-ea57-4635-b400-8c00ed9b7d79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:06.984196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27f738-ea57-4635-b400-8c00ed9b7d79 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:07.001677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 316/622] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:07.002988 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566a303-49f2-419a-8d9d-33891df532d5 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:07.003287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566a303-49f2-419a-8d9d-33891df532d5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:07.003560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566a303-49f2-419a-8d9d-33891df532d5 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:07.005247 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 317/623] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:07.008410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:07.011787 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0c9ca-9cb5-4888-a8f6-7cfdfa22c225 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:07.012349 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0c9ca-9cb5-4888-a8f6-7cfdfa22c225 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:07.012555 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0c9ca-9cb5-4888-a8f6-7cfdfa22c225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:07.038065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-0fc0c9ca-9cb5-4888-a8f6-7cfdfa22c225 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:07.039399 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0fc0c9ca-9cb5-4888-a8f6-7cfdfa22c225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:07.145591 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 318/624] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:20:07.146437 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0c9ca-9cb5-4888-a8f6-7cfdfa22c225 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:07.204294 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6da7f-103d-4245-bf96-f94c5ddd1c75 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:07.276839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ba3b5-872b-4eb4-a4ae-a07490e43369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:07.278385 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ba3b5-872b-4eb4-a4ae-a07490e43369 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:07.279879 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ba3b5-872b-4eb4-a4ae-a07490e43369 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:07.280747 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ba3b5-872b-4eb4-a4ae-a07490e43369 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:07.282471 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ba3b5-872b-4eb4-a4ae-a07490e43369 None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:07.283266 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ba3b5-872b-4eb4-a4ae-a07490e43369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:07.286532 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ba3b5-872b-4eb4-a4ae-a07490e43369 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:07.304124 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:07.316707 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 307/625] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 1 16:20:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:07.329785 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ba3b5-872b-4eb4-a4ae-a07490e43369 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:07.379928 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0c9ca-9cb5-4888-a8f6-7cfdfa22c225 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:07.518457 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7239e-da1b-4dab-a39d-611ad503b180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:07.519152 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7239e-da1b-4dab-a39d-611ad503b180 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:07.519438 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7239e-da1b-4dab-a39d-611ad503b180 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:07.519701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7239e-da1b-4dab-a39d-611ad503b180 None admin] PATH_INFO: `/v3/projects/43f5c22e38824a8b8dff2f9b4bc1df3f/users/748e35d9a1534920860b2234d45f6724/roles/93abdb875d35417d91e420a60ccafbd2` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:07.549599 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7239e-da1b-4dab-a39d-611ad503b180 None admin] RBAC: Authorizing `identity:create_grant(project_id=43f5c22e38824a8b8dff2f9b4bc1df3f, user_id=748e35d9a1534920860b2234d45f6724, role_id=93abdb875d35417d91e420a60ccafbd2)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:07.551370 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7239e-da1b-4dab-a39d-611ad503b180 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:07.567916 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 319/626] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 1 16:20:07 2022] PUT /identity/v3/projects/43f5c22e38824a8b8dff2f9b4bc1df3f/users/748e35d9a1534920860b2234d45f6724/roles/93abdb875d35417d91e420a60ccafbd2 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:20:07.568994 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7239e-da1b-4dab-a39d-611ad503b180 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:07.610688 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:07.694739 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ba3b5-872b-4eb4-a4ae-a07490e43369 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:07.712019 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7239e-da1b-4dab-a39d-611ad503b180 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:07.750942 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:07.765158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b758ba-10ea-45d4-950c-0ba27c09735d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:07.766206 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b758ba-10ea-45d4-950c-0ba27c09735d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:07.766871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b758ba-10ea-45d4-950c-0ba27c09735d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:07.767617 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b758ba-10ea-45d4-950c-0ba27c09735d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:07.782499 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b758ba-10ea-45d4-950c-0ba27c09735d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:07.788121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-c0b758ba-10ea-45d4-950c-0ba27c09735d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:07.788121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:07.788121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:07.788121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:07.788121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:07.788121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:07.788121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:07.788121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:07.788121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:07.788121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:07.788121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:07.788121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:07.788121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:07.788121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:07.788121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:07.788121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:07.789212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:07.789212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:07.789212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:07.789212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:07.789212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:07.789212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:07.789212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:07.789212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:07.789212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:07.789212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:07.789212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:07.789212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:07.789212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:07.789212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:07.789212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:07.789212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:07.790113 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:07.790113 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:07.790113 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:07.790113 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:07.790113 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:07.790113 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:07.790113 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:07.790113 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:07.790113 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:07.790113 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:07.790113 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:07.790113 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:07.796659 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 320/627] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 1 16:20:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:07.802595 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b758ba-10ea-45d4-950c-0ba27c09735d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:07.809533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d148ff7-3e02-48e8-839f-59910166d67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:07.810358 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d148ff7-3e02-48e8-839f-59910166d67e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:07.810793 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d148ff7-3e02-48e8-839f-59910166d67e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:07.811076 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d148ff7-3e02-48e8-839f-59910166d67e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:07.832891 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d148ff7-3e02-48e8-839f-59910166d67e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:07.835999 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d148ff7-3e02-48e8-839f-59910166d67e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:07.882501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-1d148ff7-3e02-48e8-839f-59910166d67e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:07.882501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:07.882501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:07.882501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:07.882501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:07.882501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:07.882501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:07.882501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:07.882501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:07.882501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:07.882501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:07.882501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:07.882501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:07.882501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:07.882501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:07.882501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:07.883547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:07.883547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:07.883547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:07.883547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:07.883547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:07.883547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:07.883547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:07.883547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:07.883547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:07.883547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:07.883547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:07.883547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:07.883547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:07.883547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:07.883547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:07.883547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:07.883547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:07.885176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:07.885176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:07.885176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:07.885176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 308/628] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 555 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:07.890285 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d148ff7-3e02-48e8-839f-59910166d67e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:07.976051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b758ba-10ea-45d4-950c-0ba27c09735d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:08.054056 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e925835-19de-43c0-a635-6c3c29f19b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:08.055146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e925835-19de-43c0-a635-6c3c29f19b84 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:08.055355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e925835-19de-43c0-a635-6c3c29f19b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:08.055626 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e925835-19de-43c0-a635-6c3c29f19b84 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:08.056363 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e925835-19de-43c0-a635-6c3c29f19b84 None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:08.056762 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e925835-19de-43c0-a635-6c3c29f19b84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:08.060685 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e925835-19de-43c0-a635-6c3c29f19b84 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:08.076814 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 321/629] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 1 16:20:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:08.078362 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b66942-aa95-4735-9f24-4c44675882ed None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:08.078657 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b66942-aa95-4735-9f24-4c44675882ed None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:08.078935 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b66942-aa95-4735-9f24-4c44675882ed None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:08.085093 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 322/630] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:08.086311 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b66942-aa95-4735-9f24-4c44675882ed None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:08.099760 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d148ff7-3e02-48e8-839f-59910166d67e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:08.153311 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7a724-10ed-47a2-a506-f7421cb7f49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:08.153932 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7a724-10ed-47a2-a506-f7421cb7f49c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:08.154215 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7a724-10ed-47a2-a506-f7421cb7f49c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:08.154514 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7a724-10ed-47a2-a506-f7421cb7f49c None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:08.155182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7a724-10ed-47a2-a506-f7421cb7f49c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:08.155490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7a724-10ed-47a2-a506-f7421cb7f49c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:08.157085 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7a724-10ed-47a2-a506-f7421cb7f49c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:08.160170 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:08.160927 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:08.180681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 309/631] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:08.180681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6551a8-8b71-4421-8a01-786fa9af0e7b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:08.180681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6551a8-8b71-4421-8a01-786fa9af0e7b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:08.180681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6551a8-8b71-4421-8a01-786fa9af0e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:08.197815 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9f6551a8-8b71-4421-8a01-786fa9af0e7b None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:08.199153 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9f6551a8-8b71-4421-8a01-786fa9af0e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:08.272939 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b66942-aa95-4735-9f24-4c44675882ed None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:08.314494 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 310/632] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:20:08.317850 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539abc9-8ade-4263-9116-bdd0ed5bc25a None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:08.318730 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539abc9-8ade-4263-9116-bdd0ed5bc25a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:08.319510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539abc9-8ade-4263-9116-bdd0ed5bc25a None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:08.322293 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 311/633] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:08.324043 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539abc9-8ade-4263-9116-bdd0ed5bc25a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:08.338549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8e892-c8b3-41ed-a8e5-333a15de8ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:08.339599 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8e892-c8b3-41ed-a8e5-333a15de8ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:08.340078 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8e892-c8b3-41ed-a8e5-333a15de8ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:08.340548 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8e892-c8b3-41ed-a8e5-333a15de8ab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:08.366635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8e892-c8b3-41ed-a8e5-333a15de8ab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:08.370250 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8e892-c8b3-41ed-a8e5-333a15de8ab7 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:08.398065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-3bb8e892-c8b3-41ed-a8e5-333a15de8ab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:08.398065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:08.398065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:08.398065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:08.398065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:08.398065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:08.398065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:08.398065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:08.398065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:08.398065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:08.398065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:08.398065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:08.398065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:08.398065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:08.398065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:08.398065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:08.399529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:08.399529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:08.399529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:08.399529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:08.399529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:08.399529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:08.399529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:08.399529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:08.399529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:08.399529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:08.399529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:08.399529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:08.399529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:08.399529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:08.399529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:08.399529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:08.399529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:08.400403 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:08.400403 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:08.400403 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:08.402658 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 323/634] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:08.404357 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d670d-79f7-428f-b01f-c3c3f2ead794 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:08.405435 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d670d-79f7-428f-b01f-c3c3f2ead794 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:08.405921 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d670d-79f7-428f-b01f-c3c3f2ead794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:08.425772 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ce9d670d-79f7-428f-b01f-c3c3f2ead794 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:08.427397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ce9d670d-79f7-428f-b01f-c3c3f2ead794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:08.509338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 324/635] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:20:08.510599 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d670d-79f7-428f-b01f-c3c3f2ead794 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:08.544510 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:08.575971 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539abc9-8ade-4263-9116-bdd0ed5bc25a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:08.634185 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d670d-79f7-428f-b01f-c3c3f2ead794 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:08.636459 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:08.650758 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb8624-06cc-449d-ae9f-17ae93c60636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:08.651536 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb8624-06cc-449d-ae9f-17ae93c60636 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:08.651934 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb8624-06cc-449d-ae9f-17ae93c60636 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:08.652211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb8624-06cc-449d-ae9f-17ae93c60636 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:08.663662 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb8624-06cc-449d-ae9f-17ae93c60636 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:08.666300 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb8624-06cc-449d-ae9f-17ae93c60636 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:08.681848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc1e29-8716-4791-aacd-02cbf7fc4c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:08.682624 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc1e29-8716-4791-aacd-02cbf7fc4c78 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:08.683019 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc1e29-8716-4791-aacd-02cbf7fc4c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:08.683367 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc1e29-8716-4791-aacd-02cbf7fc4c78 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:08.684107 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc1e29-8716-4791-aacd-02cbf7fc4c78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:08.684497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-c0bb8624-06cc-449d-ae9f-17ae93c60636 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 16:20:08.684497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:08.684497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:08.684497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:08.684497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:08.684497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:08.684497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:08.684497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:08.684497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:08.684497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:08.684497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:08.684497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:08.684497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:08.684497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:08.684497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:08.684497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:08.685502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:08.685502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:08.685502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:08.685502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:08.685502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:08.685502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:08.685502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:08.685502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:08.685502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:08.685502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:08.685502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:08.685502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:08.685502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:08.685502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:08.685502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:08.685502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:08.685502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:08.685502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:08.686467 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:08.686467 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:08.686467 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:08.686467 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:08.686467 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:08.686467 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:08.686467 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:08.686467 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:08.686467 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 16:20:08.686467 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:08.687017 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc1e29-8716-4791-aacd-02cbf7fc4c78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:08.687017 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc1e29-8716-4791-aacd-02cbf7fc4c78 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:08.690196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 312/636] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:20:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:08.691478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb8624-06cc-449d-ae9f-17ae93c60636 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:08.705804 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 325/637] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:08.706980 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc1e29-8716-4791-aacd-02cbf7fc4c78 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:08.856369 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:08.876206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb8624-06cc-449d-ae9f-17ae93c60636 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:08.889230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc1e29-8716-4791-aacd-02cbf7fc4c78 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:08.932979 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55361349-bd31-45e0-9aaa-13d9f8488c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:08.933630 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55361349-bd31-45e0-9aaa-13d9f8488c22 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:08.933913 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55361349-bd31-45e0-9aaa-13d9f8488c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:08.934189 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55361349-bd31-45e0-9aaa-13d9f8488c22 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:08.946942 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee343c66-baf4-4fa8-99d4-67dab9cdec91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:08.947573 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee343c66-baf4-4fa8-99d4-67dab9cdec91 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:08.947911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee343c66-baf4-4fa8-99d4-67dab9cdec91 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:08.948190 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee343c66-baf4-4fa8-99d4-67dab9cdec91 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:08.949007 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee343c66-baf4-4fa8-99d4-67dab9cdec91 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:08.949318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee343c66-baf4-4fa8-99d4-67dab9cdec91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:08.951041 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee343c66-baf4-4fa8-99d4-67dab9cdec91 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:08.952433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55361349-bd31-45e0-9aaa-13d9f8488c22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:08.963028 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-55361349-bd31-45e0-9aaa-13d9f8488c22 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:08.963028 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:08.963028 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:08.963028 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:08.963028 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:08.963028 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:08.963028 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:08.963028 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:08.963028 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:08.963028 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:08.963028 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:08.963028 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:08.963028 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:08.963028 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:08.963028 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:08.963028 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:08.964087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:08.964087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:08.964087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:08.964087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:08.964087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:08.964087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:08.964087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:08.964087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:08.964087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:08.964087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:08.964087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:08.964087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:08.964087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:08.964087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:08.964087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:08.964087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:08.964961 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:08.964961 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:08.964961 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:08.964961 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:08.964961 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:08.964961 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:08.964961 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:08.964961 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:08.964961 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:08.964961 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:08.964961 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:08.964961 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:08.965708 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 313/638] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 1 16:20:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:08.966505 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55361349-bd31-45e0-9aaa-13d9f8488c22 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:08.976163 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 326/639] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Sep 1 16:20:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:08.977529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee343c66-baf4-4fa8-99d4-67dab9cdec91 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:09.041638 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:09.138288 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55361349-bd31-45e0-9aaa-13d9f8488c22 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:09.160189 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee343c66-baf4-4fa8-99d4-67dab9cdec91 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:09.204906 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24a1f1-58cc-4034-b14f-cfd381c86ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:09.205577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24a1f1-58cc-4034-b14f-cfd381c86ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:09.206044 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24a1f1-58cc-4034-b14f-cfd381c86ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:09.206395 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24a1f1-58cc-4034-b14f-cfd381c86ff3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:09.207560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ece25-9354-47db-b7f6-6419197f6c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:09.208217 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ece25-9354-47db-b7f6-6419197f6c8a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:09.208501 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ece25-9354-47db-b7f6-6419197f6c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:09.208806 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ece25-9354-47db-b7f6-6419197f6c8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:09.217216 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24a1f1-58cc-4034-b14f-cfd381c86ff3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:09.219541 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24a1f1-58cc-4034-b14f-cfd381c86ff3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:09.221420 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ece25-9354-47db-b7f6-6419197f6c8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:09.226750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-e64ece25-9354-47db-b7f6-6419197f6c8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:09.226750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:09.226750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:09.226750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:09.226750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:09.226750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:09.226750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:09.226750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:09.226750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:09.226750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:09.226750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:09.226750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:09.226750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:09.226750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:09.226750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:09.226750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:09.228286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:09.228286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:09.228286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:09.228286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:09.228286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:09.228286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:09.228286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:09.228286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:09.228286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:09.228286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:09.228286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:09.228286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:09.228286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:09.228286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:09.228286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:09.228286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:09.229222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:09.229222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:09.229222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:09.229222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:09.229222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:09.229222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:09.229222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:09.229222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:09.229222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:09.229222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:09.229222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:09.229222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:09.232808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 327/640] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 1 16:20:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:09.234253 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ece25-9354-47db-b7f6-6419197f6c8a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:09.242390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-1c24a1f1-58cc-4034-b14f-cfd381c86ff3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:20:09.242390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:09.242390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:09.242390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:09.242390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:09.242390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:09.242390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:09.242390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:09.242390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:09.242390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:09.242390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:09.242390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:09.242390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:09.242390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:09.242390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:09.242390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:09.243726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:09.243726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:09.243726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:09.243726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:09.243726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:09.243726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:09.243726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:09.243726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:09.243726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:09.243726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:09.243726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:09.243726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:09.243726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:09.243726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:09.243726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:09.243726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:09.243726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:09.243726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:09.252462 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:09.252462 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:09.252462 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:09.252462 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:09.252462 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:09.252462 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:09.252462 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:09.252462 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:09.252462 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:20:09.252462 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:09.252462 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 314/641] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Sep 1 16:20:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:09.252462 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24a1f1-58cc-4034-b14f-cfd381c86ff3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:09.255051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:09.376596 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ece25-9354-47db-b7f6-6419197f6c8a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:09.440264 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe69c7c-fc3b-4556-83bb-6700fa4f34f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:09.441326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24a1f1-58cc-4034-b14f-cfd381c86ff3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:09.441960 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe69c7c-fc3b-4556-83bb-6700fa4f34f4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:09.441960 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe69c7c-fc3b-4556-83bb-6700fa4f34f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:09.442203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe69c7c-fc3b-4556-83bb-6700fa4f34f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:09.443104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe69c7c-fc3b-4556-83bb-6700fa4f34f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:09.443549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe69c7c-fc3b-4556-83bb-6700fa4f34f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:09.446410 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe69c7c-fc3b-4556-83bb-6700fa4f34f4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:09.455669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:09.465860 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 328/642] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 1 16:20:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:09.465860 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe69c7c-fc3b-4556-83bb-6700fa4f34f4 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:09.506288 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ec0b4-43d9-47d6-8c6f-c0344a37be45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:09.507324 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ec0b4-43d9-47d6-8c6f-c0344a37be45 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:09.507813 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ec0b4-43d9-47d6-8c6f-c0344a37be45 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:09.508310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ec0b4-43d9-47d6-8c6f-c0344a37be45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:09.575432 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:09.628867 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe69c7c-fc3b-4556-83bb-6700fa4f34f4 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:09.632356 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ec0b4-43d9-47d6-8c6f-c0344a37be45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:09.633915 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ec0b4-43d9-47d6-8c6f-c0344a37be45 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:09.696351 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6555eb-5eee-48ab-9d31-9870fe8cde02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:09.697797 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6555eb-5eee-48ab-9d31-9870fe8cde02 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:09.698480 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6555eb-5eee-48ab-9d31-9870fe8cde02 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:09.699170 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6555eb-5eee-48ab-9d31-9870fe8cde02 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:09.700653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6555eb-5eee-48ab-9d31-9870fe8cde02 None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:09.701990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6555eb-5eee-48ab-9d31-9870fe8cde02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:09.704854 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6555eb-5eee-48ab-9d31-9870fe8cde02 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:09.724010 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 329/643] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 1 16:20:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:09.725960 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6555eb-5eee-48ab-9d31-9870fe8cde02 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:09.774018 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 315/644] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:20:09.775019 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ec0b4-43d9-47d6-8c6f-c0344a37be45 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:09.786242 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:09.900883 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6555eb-5eee-48ab-9d31-9870fe8cde02 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:09.943417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ec0b4-43d9-47d6-8c6f-c0344a37be45 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:09.944674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:09.956031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78900262-d9b0-4e41-aab3-32e61ddcae45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:09.957111 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78900262-d9b0-4e41-aab3-32e61ddcae45 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:09.957603 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78900262-d9b0-4e41-aab3-32e61ddcae45 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:09.958097 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78900262-d9b0-4e41-aab3-32e61ddcae45 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:09.959488 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78900262-d9b0-4e41-aab3-32e61ddcae45 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:09.960065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78900262-d9b0-4e41-aab3-32e61ddcae45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:09.962043 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78900262-d9b0-4e41-aab3-32e61ddcae45 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:09.991578 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 330/645] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Sep 1 16:20:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:09.993148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78900262-d9b0-4e41-aab3-32e61ddcae45 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:10.008059 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ba0ba-f252-4a03-889a-d2aced0e18d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:10.009895 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ba0ba-f252-4a03-889a-d2aced0e18d1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:10.010566 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ba0ba-f252-4a03-889a-d2aced0e18d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:10.011033 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ba0ba-f252-4a03-889a-d2aced0e18d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:10.032769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ba0ba-f252-4a03-889a-d2aced0e18d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:10.035560 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ba0ba-f252-4a03-889a-d2aced0e18d1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:10.062276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-6b9ba0ba-f252-4a03-889a-d2aced0e18d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:10.062276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:10.062276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:10.062276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:10.062276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:10.062276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:10.062276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:10.062276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:10.062276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:10.062276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:10.062276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:10.062276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:10.062276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:10.062276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:10.062276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:10.062276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:10.063261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:10.063261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:10.063261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:10.063261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:10.063261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:10.063261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:10.063261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:10.063261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:10.063261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:10.063261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:10.063261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:10.063261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:10.063261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:10.063261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:10.063261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:10.063261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:10.063261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:10.064291 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:10.064291 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:10.064291 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:10.064291 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 316/646] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:10.065275 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ba0ba-f252-4a03-889a-d2aced0e18d1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:10.140375 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78900262-d9b0-4e41-aab3-32e61ddcae45 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:10.164198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:10.183809 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487f5b3-dacc-4b54-bdd9-9b197d5abb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:10.184614 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487f5b3-dacc-4b54-bdd9-9b197d5abb62 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:10.185024 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487f5b3-dacc-4b54-bdd9-9b197d5abb62 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:10.185414 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487f5b3-dacc-4b54-bdd9-9b197d5abb62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:10.202095 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487f5b3-dacc-4b54-bdd9-9b197d5abb62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:10.204974 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487f5b3-dacc-4b54-bdd9-9b197d5abb62 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:10.227220 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ba0ba-f252-4a03-889a-d2aced0e18d1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:10.233353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-5487f5b3-dacc-4b54-bdd9-9b197d5abb62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:10.233353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:10.233353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:10.233353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:10.233353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:10.233353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:10.233353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:10.233353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:10.233353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:10.233353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:10.233353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:10.233353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:10.233353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:10.233353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:10.233353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:10.233353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:10.234439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:10.234439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:10.234439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:10.234439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:10.234439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:10.234439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:10.234439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:10.234439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:10.234439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:10.234439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:10.234439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:10.234439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:10.234439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:10.234439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:10.234439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:10.234439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:10.234439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:10.235333 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:10.235333 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:10.235333 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:10.235517 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 331/647] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:10.236849 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487f5b3-dacc-4b54-bdd9-9b197d5abb62 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:10.291271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:10.293566 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00518a70-b7cf-4f15-9148-8cce0bd8fe03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:10.294737 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00518a70-b7cf-4f15-9148-8cce0bd8fe03 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:10.295699 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00518a70-b7cf-4f15-9148-8cce0bd8fe03 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:10.296187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00518a70-b7cf-4f15-9148-8cce0bd8fe03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:10.316451 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00518a70-b7cf-4f15-9148-8cce0bd8fe03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:10.319314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00518a70-b7cf-4f15-9148-8cce0bd8fe03 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:10.345598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-00518a70-b7cf-4f15-9148-8cce0bd8fe03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:10.345598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:10.345598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:10.345598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:10.345598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:10.345598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:10.345598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:10.345598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:10.345598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:10.345598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:10.345598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:10.345598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:10.345598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:10.345598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:10.345598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:10.345598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:10.346835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:10.346835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:10.346835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:10.346835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:10.346835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:10.346835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:10.346835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:10.346835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:10.346835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:10.346835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:10.346835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:10.346835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:10.346835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:10.346835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:10.346835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:10.346835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:10.346835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:10.347920 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:10.347920 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:10.347920 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:10.347920 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 317/648] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:10.349545 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf96f49-fa54-4a3b-b3f3-428afe1cca5a None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:10.350143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf96f49-fa54-4a3b-b3f3-428afe1cca5a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:10.350507 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf96f49-fa54-4a3b-b3f3-428afe1cca5a None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:10.353089 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 318/649] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:10.354317 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf96f49-fa54-4a3b-b3f3-428afe1cca5a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:10.376244 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487f5b3-dacc-4b54-bdd9-9b197d5abb62 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:10.423228 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804a75b-5047-4db0-8581-041eefa1d627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:10.424202 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804a75b-5047-4db0-8581-041eefa1d627 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:10.424593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804a75b-5047-4db0-8581-041eefa1d627 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:10.424961 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804a75b-5047-4db0-8581-041eefa1d627 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:10.518177 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804a75b-5047-4db0-8581-041eefa1d627 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:10.519590 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804a75b-5047-4db0-8581-041eefa1d627 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:10.536696 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf96f49-fa54-4a3b-b3f3-428afe1cca5a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:10.556362 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:10.578826 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:10.591186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65739b9-d27f-485c-a55e-ed78d0c28a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:10.592901 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65739b9-d27f-485c-a55e-ed78d0c28a59 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:10.592901 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65739b9-d27f-485c-a55e-ed78d0c28a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:10.592901 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65739b9-d27f-485c-a55e-ed78d0c28a59 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:10.593594 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65739b9-d27f-485c-a55e-ed78d0c28a59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:10.593903 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65739b9-d27f-485c-a55e-ed78d0c28a59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:10.595330 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65739b9-d27f-485c-a55e-ed78d0c28a59 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:10.608687 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 319/650] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:10.609565 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65739b9-d27f-485c-a55e-ed78d0c28a59 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:10.686755 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 332/651] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:20:10.688808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804a75b-5047-4db0-8581-041eefa1d627 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:10.742293 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65739b9-d27f-485c-a55e-ed78d0c28a59 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:10.796598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622393fb-c192-4386-86c3-18975a67da7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:10.797140 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622393fb-c192-4386-86c3-18975a67da7d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:10.797421 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622393fb-c192-4386-86c3-18975a67da7d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:10.797692 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622393fb-c192-4386-86c3-18975a67da7d None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:10.798357 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622393fb-c192-4386-86c3-18975a67da7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:10.798658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622393fb-c192-4386-86c3-18975a67da7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:10.800078 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622393fb-c192-4386-86c3-18975a67da7d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:10.810389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804a75b-5047-4db0-8581-041eefa1d627 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:10.812171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 320/652] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:10.813492 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06acfe-20a5-4a21-92b3-dad8d889ad2f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:10.813778 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06acfe-20a5-4a21-92b3-dad8d889ad2f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:10.814052 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06acfe-20a5-4a21-92b3-dad8d889ad2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:10.834031 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-bf06acfe-20a5-4a21-92b3-dad8d889ad2f None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:10.835247 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bf06acfe-20a5-4a21-92b3-dad8d889ad2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:10.861484 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:10.870220 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804044f1-2016-46f3-97ca-05a7aa9811fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:10.870859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804044f1-2016-46f3-97ca-05a7aa9811fe None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:10.871140 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804044f1-2016-46f3-97ca-05a7aa9811fe None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:10.871413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804044f1-2016-46f3-97ca-05a7aa9811fe None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:10.872079 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804044f1-2016-46f3-97ca-05a7aa9811fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:10.872382 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804044f1-2016-46f3-97ca-05a7aa9811fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:10.873841 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804044f1-2016-46f3-97ca-05a7aa9811fe None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:10.884785 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:10.892905 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 333/653] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:10.893646 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804044f1-2016-46f3-97ca-05a7aa9811fe None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:10.916416 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 321/654] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:20:10.917883 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06acfe-20a5-4a21-92b3-dad8d889ad2f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:11.034792 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06acfe-20a5-4a21-92b3-dad8d889ad2f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:11.035562 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804044f1-2016-46f3-97ca-05a7aa9811fe None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:11.090070 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07320359-8294-430e-bdcf-ad55ba24b7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:11.090838 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07320359-8294-430e-bdcf-ad55ba24b7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:11.091186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07320359-8294-430e-bdcf-ad55ba24b7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:11.091675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07320359-8294-430e-bdcf-ad55ba24b7e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:11.101739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc0e1a-5b2d-48c9-a845-06977af8fd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:11.102853 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc0e1a-5b2d-48c9-a845-06977af8fd50 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:11.103370 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc0e1a-5b2d-48c9-a845-06977af8fd50 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:11.103870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc0e1a-5b2d-48c9-a845-06977af8fd50 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:11.104396 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07320359-8294-430e-bdcf-ad55ba24b7e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:11.105922 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07320359-8294-430e-bdcf-ad55ba24b7e2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:11.114375 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc0e1a-5b2d-48c9-a845-06977af8fd50 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:11.115849 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc0e1a-5b2d-48c9-a845-06977af8fd50 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:11.128734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-74bc0e1a-5b2d-48c9-a845-06977af8fd50 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:20:11.128734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:11.128734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:11.128734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:11.128734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:11.128734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:11.128734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:11.128734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:11.128734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:11.128734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:11.128734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:11.128734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:11.128734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:11.128734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:11.128734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:11.128734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:11.129739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:11.129739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:11.129739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:11.129739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:11.129739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:11.129739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:11.129739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:11.129739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:11.129739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:11.129739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:11.129739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:11.129739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:11.129739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:11.129739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:11.129739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:11.129739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:11.129739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:11.129739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:11.135896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:11.135896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:11.135896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:11.135896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:11.135896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:11.135896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:11.135896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:11.135896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:11.135896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:20:11.135896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:11.135896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 334/655] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:20:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:11.135896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc0e1a-5b2d-48c9-a845-06977af8fd50 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:11.136585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-07320359-8294-430e-bdcf-ad55ba24b7e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:11.136585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:11.136585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:11.136585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:11.136585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:11.136585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:11.136585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:11.136585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:11.136585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:11.136585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:11.136585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:11.136585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:11.136585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:11.136585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:11.136585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:11.136585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:11.137473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:11.137473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:11.137473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:11.137473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:11.137473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:11.137473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:11.137473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:11.137473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:11.137473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:11.137473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:11.137473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:11.137473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:11.137473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:11.137473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:11.137473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:11.137473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:11.137473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:11.138358 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:11.138358 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:11.138358 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:11.142088 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 322/656] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:11.143328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07320359-8294-430e-bdcf-ad55ba24b7e2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:11.165749 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:11.213494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:11.262043 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc0e1a-5b2d-48c9-a845-06977af8fd50 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:11.304750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1b19e-412d-465d-87fd-175fd4611371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:11.305318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1b19e-412d-465d-87fd-175fd4611371 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:11.305620 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1b19e-412d-465d-87fd-175fd4611371 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:11.305893 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1b19e-412d-465d-87fd-175fd4611371 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:11.309048 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07320359-8294-430e-bdcf-ad55ba24b7e2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:11.315450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1b19e-412d-465d-87fd-175fd4611371 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:11.316944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1b19e-412d-465d-87fd-175fd4611371 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:11.330276 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-d6d1b19e-412d-465d-87fd-175fd4611371 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 16:20:11.330276 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:11.330276 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:11.330276 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:11.330276 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:11.330276 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:11.330276 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:11.330276 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:11.330276 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:11.330276 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:11.330276 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:11.330276 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:11.330276 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:11.330276 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:11.330276 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:11.330276 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:11.332429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:11.332429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:11.332429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:11.332429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:11.332429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:11.332429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:11.332429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:11.332429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:11.332429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:11.332429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:11.332429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:11.332429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:11.332429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:11.332429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:11.332429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:11.332429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:11.332429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:11.332429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:11.334445 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:11.334445 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:11.334445 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:11.334445 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:11.334445 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:11.334445 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:11.334445 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:11.334445 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:11.334445 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 16:20:11.334445 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:11.336104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 335/657] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 1 16:20:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:11.337721 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1b19e-412d-465d-87fd-175fd4611371 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:11.350010 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e3442-1556-438c-b843-ffeaaeab2a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:11.350662 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e3442-1556-438c-b843-ffeaaeab2a92 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:11.350938 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e3442-1556-438c-b843-ffeaaeab2a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:11.351210 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e3442-1556-438c-b843-ffeaaeab2a92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:11.359714 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e3442-1556-438c-b843-ffeaaeab2a92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:11.361284 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e3442-1556-438c-b843-ffeaaeab2a92 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:11.375055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-6c5e3442-1556-438c-b843-ffeaaeab2a92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:11.375055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:11.375055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:11.375055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:11.375055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:11.375055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:11.375055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:11.375055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:11.375055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:11.375055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:11.375055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:11.375055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:11.375055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:11.375055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:11.375055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:11.377197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:11.377197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:11.377197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:11.377197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:11.377197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:11.377197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:11.377197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:11.377197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:11.377197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:11.377197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:11.377197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:11.377197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:11.377197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:11.377197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:11.377197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:11.377197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:11.377197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:11.379607 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:11.379607 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:11.379607 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:11.379607 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:11.379607 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:11.379607 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:11.379607 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:11.379607 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:11.379607 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 323/658] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:11.379607 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e3442-1556-438c-b843-ffeaaeab2a92 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:11.464953 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:11.478841 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1b19e-412d-465d-87fd-175fd4611371 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:11.502086 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:11.518506 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e3442-1556-438c-b843-ffeaaeab2a92 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:11.519353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927f557-d4cb-4f4a-bb43-df16ffcf6144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:11.520059 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927f557-d4cb-4f4a-bb43-df16ffcf6144 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:11.520243 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927f557-d4cb-4f4a-bb43-df16ffcf6144 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:11.520519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927f557-d4cb-4f4a-bb43-df16ffcf6144 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:11.521332 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927f557-d4cb-4f4a-bb43-df16ffcf6144 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:11.521635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927f557-d4cb-4f4a-bb43-df16ffcf6144 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:11.523126 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927f557-d4cb-4f4a-bb43-df16ffcf6144 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:11.543491 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 336/659] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Sep 1 16:20:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:11.544352 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927f557-d4cb-4f4a-bb43-df16ffcf6144 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:11.563817 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf8f86-ca50-41dd-8f06-10be11576be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:11.564377 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf8f86-ca50-41dd-8f06-10be11576be2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:11.564741 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf8f86-ca50-41dd-8f06-10be11576be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:11.565070 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf8f86-ca50-41dd-8f06-10be11576be2 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:11.565805 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf8f86-ca50-41dd-8f06-10be11576be2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:11.566258 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf8f86-ca50-41dd-8f06-10be11576be2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:11.568085 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf8f86-ca50-41dd-8f06-10be11576be2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:11.590291 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 324/660] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:11.590291 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf8f86-ca50-41dd-8f06-10be11576be2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:11.662771 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927f557-d4cb-4f4a-bb43-df16ffcf6144 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:11.710863 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da744b6-4a95-443f-9550-e30fdb713d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:11.711514 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da744b6-4a95-443f-9550-e30fdb713d4d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:11.711797 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da744b6-4a95-443f-9550-e30fdb713d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:11.712070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da744b6-4a95-443f-9550-e30fdb713d4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:11.724587 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da744b6-4a95-443f-9550-e30fdb713d4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:11.729593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-9da744b6-4a95-443f-9550-e30fdb713d4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:11.729593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:11.729593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:11.729593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:11.729593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:11.729593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:11.729593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:11.729593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:11.729593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:11.729593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:11.729593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:11.729593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:11.729593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:11.729593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:11.729593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:11.729593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:11.730600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:11.730600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:11.730600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:11.730600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:11.730600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:11.730600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:11.730600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:11.730600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:11.730600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:11.730600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:11.730600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:11.730600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:11.730600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:11.730600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:11.730600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:11.730600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:11.731416 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:11.731416 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:11.731416 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:11.731416 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:11.731416 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:11.731416 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:11.731416 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:11.731416 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:11.731416 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:11.731416 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:11.731416 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:11.731416 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:11.731416 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 337/661] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 1 16:20:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:11.732088 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da744b6-4a95-443f-9550-e30fdb713d4d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:11.739929 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf8f86-ca50-41dd-8f06-10be11576be2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:11.788712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:11.793499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:11.801062 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0377f81-2c0a-4b3c-b070-8248ac6e0def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:11.801813 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0377f81-2c0a-4b3c-b070-8248ac6e0def None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:11.802274 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0377f81-2c0a-4b3c-b070-8248ac6e0def None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:11.802661 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0377f81-2c0a-4b3c-b070-8248ac6e0def None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:11.803502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0377f81-2c0a-4b3c-b070-8248ac6e0def None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:11.803897 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0377f81-2c0a-4b3c-b070-8248ac6e0def None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:11.805614 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0377f81-2c0a-4b3c-b070-8248ac6e0def None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:11.826769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 325/662] 10.222.0.52 () {56 vars in 1139 bytes} [Thu Sep 1 16:20:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:11.827717 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0377f81-2c0a-4b3c-b070-8248ac6e0def None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:11.901189 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da744b6-4a95-443f-9550-e30fdb713d4d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:11.950521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86c243-b451-44ee-8271-078d84f623c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:11.951614 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86c243-b451-44ee-8271-078d84f623c8 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:11.952080 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86c243-b451-44ee-8271-078d84f623c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:11.952558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86c243-b451-44ee-8271-078d84f623c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:11.953927 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86c243-b451-44ee-8271-078d84f623c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:11.954483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86c243-b451-44ee-8271-078d84f623c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:11.957231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86c243-b451-44ee-8271-078d84f623c8 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:11.965513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0377f81-2c0a-4b3c-b070-8248ac6e0def None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:11.979937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 338/663] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:11.981007 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86c243-b451-44ee-8271-078d84f623c8 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:12.015112 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118f411-0a12-47ce-8c81-17b8083c2c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:12.016102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118f411-0a12-47ce-8c81-17b8083c2c2a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:12.016582 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118f411-0a12-47ce-8c81-17b8083c2c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:12.017086 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118f411-0a12-47ce-8c81-17b8083c2c2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:12.098767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:12.112445 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118f411-0a12-47ce-8c81-17b8083c2c2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:12.115285 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118f411-0a12-47ce-8c81-17b8083c2c2a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:12.118870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:12.126785 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86c243-b451-44ee-8271-078d84f623c8 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:12.173681 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185df985-1a63-4d4c-8590-6e55ec2fa697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:12.174458 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185df985-1a63-4d4c-8590-6e55ec2fa697 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:12.174832 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185df985-1a63-4d4c-8590-6e55ec2fa697 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:12.175195 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185df985-1a63-4d4c-8590-6e55ec2fa697 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:12.187230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185df985-1a63-4d4c-8590-6e55ec2fa697 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:12.189655 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185df985-1a63-4d4c-8590-6e55ec2fa697 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:12.210389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-185df985-1a63-4d4c-8590-6e55ec2fa697 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:12.210389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:12.210389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:12.210389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:12.210389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:12.210389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:12.210389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:12.210389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:12.210389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:12.210389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:12.210389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:12.210389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:12.210389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:12.210389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:12.210389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:12.212227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:12.212227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:12.212227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:12.212227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:12.212227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:12.212227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:12.212227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:12.212227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:12.212227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:12.212227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:12.212227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:12.212227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:12.212227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:12.212227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:12.212227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:12.212227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:12.212227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:12.214131 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:12.214131 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:12.214131 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:12.214131 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:12.214131 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:12.214131 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:12.214131 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:12.214131 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:12.214131 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 339/664] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:12.214131 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185df985-1a63-4d4c-8590-6e55ec2fa697 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:12.275164 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 326/665] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:20:12.276792 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118f411-0a12-47ce-8c81-17b8083c2c2a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:12.349982 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185df985-1a63-4d4c-8590-6e55ec2fa697 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:12.391885 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:12.395698 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62755845-9869-4606-9cb0-a7ae7c91870d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:12.396806 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62755845-9869-4606-9cb0-a7ae7c91870d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:12.397325 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62755845-9869-4606-9cb0-a7ae7c91870d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:12.397820 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62755845-9869-4606-9cb0-a7ae7c91870d None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:12.399041 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62755845-9869-4606-9cb0-a7ae7c91870d None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:12.399550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62755845-9869-4606-9cb0-a7ae7c91870d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:12.402073 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62755845-9869-4606-9cb0-a7ae7c91870d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:12.403568 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118f411-0a12-47ce-8c81-17b8083c2c2a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:12.424258 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 340/666] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 1 16:20:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:12.424258 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62755845-9869-4606-9cb0-a7ae7c91870d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:12.449819 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3afb92-a440-496b-9a9e-67ccd966ca67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:12.450639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3afb92-a440-496b-9a9e-67ccd966ca67 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:12.451696 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3afb92-a440-496b-9a9e-67ccd966ca67 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:12.452032 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3afb92-a440-496b-9a9e-67ccd966ca67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:12.454829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:12.536402 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3afb92-a440-496b-9a9e-67ccd966ca67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:12.538239 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3afb92-a440-496b-9a9e-67ccd966ca67 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:12.558039 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62755845-9869-4606-9cb0-a7ae7c91870d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:12.597777 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afbbb3-db27-42de-8ac0-89c827421d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:12.598407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afbbb3-db27-42de-8ac0-89c827421d1b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:12.598687 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afbbb3-db27-42de-8ac0-89c827421d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:12.599241 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afbbb3-db27-42de-8ac0-89c827421d1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:12.599700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afbbb3-db27-42de-8ac0-89c827421d1b None admin] RBAC: Adding query filter params (role.id=93abdb875d35417d91e420a60ccafbd2, scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f, user.id=c2feb3132ad9497aaae8720ed170ef3e) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:12.600059 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afbbb3-db27-42de-8ac0-89c827421d1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:12.601641 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afbbb3-db27-42de-8ac0-89c827421d1b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:12.609413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 341/667] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:12 2022] GET /identity/v3/role_assignments?user.id=c2feb3132ad9497aaae8720ed170ef3e&scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f&role.id=93abdb875d35417d91e420a60ccafbd2 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:12.610816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afbbb3-db27-42de-8ac0-89c827421d1b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:12.656069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:12.678244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 327/668] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:20:12.678244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3afb92-a440-496b-9a9e-67ccd966ca67 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:12.790766 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:12.823379 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afbbb3-db27-42de-8ac0-89c827421d1b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:12.824800 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3afb92-a440-496b-9a9e-67ccd966ca67 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:12.871714 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f2410-4a6e-45d3-bac6-a2aa42419a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:12.872298 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f2410-4a6e-45d3-bac6-a2aa42419a23 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:12.872603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f2410-4a6e-45d3-bac6-a2aa42419a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:12.872991 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f2410-4a6e-45d3-bac6-a2aa42419a23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:12.889317 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f2410-4a6e-45d3-bac6-a2aa42419a23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:12.890826 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f2410-4a6e-45d3-bac6-a2aa42419a23 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:12.896383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47965c60-b6a7-4cb4-ac1a-94e46314fe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:12.897405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47965c60-b6a7-4cb4-ac1a-94e46314fe48 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:12.897779 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47965c60-b6a7-4cb4-ac1a-94e46314fe48 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:12.898133 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47965c60-b6a7-4cb4-ac1a-94e46314fe48 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:12.899299 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47965c60-b6a7-4cb4-ac1a-94e46314fe48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:12.899810 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47965c60-b6a7-4cb4-ac1a-94e46314fe48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:12.901970 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47965c60-b6a7-4cb4-ac1a-94e46314fe48 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:12.916825 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 342/669] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:12.917591 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47965c60-b6a7-4cb4-ac1a-94e46314fe48 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:12.928550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-8a0f2410-4a6e-45d3-bac6-a2aa42419a23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:12.928550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:12.928550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:12.928550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:12.928550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:12.928550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:12.928550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:12.928550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:12.928550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:12.928550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:12.928550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:12.928550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:12.928550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:12.928550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:12.928550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:12.928550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:12.929603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:12.929603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:12.929603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:12.929603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:12.929603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:12.929603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:12.929603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:12.929603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:12.929603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:12.929603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:12.929603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:12.929603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:12.929603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:12.929603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:12.929603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:12.929603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:12.929603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:12.930493 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:12.930493 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:12.930493 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:12.930493 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 328/670] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:12.931673 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f2410-4a6e-45d3-bac6-a2aa42419a23 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:12.988101 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:13.063451 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47965c60-b6a7-4cb4-ac1a-94e46314fe48 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:13.069833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f2410-4a6e-45d3-bac6-a2aa42419a23 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:13.118601 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051aac3-41f6-4908-99ae-7d9e730ad11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:13.119639 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051aac3-41f6-4908-99ae-7d9e730ad11a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:13.120127 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051aac3-41f6-4908-99ae-7d9e730ad11a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:13.120820 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051aac3-41f6-4908-99ae-7d9e730ad11a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:13.128829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bcf22-b778-47a9-a05f-db3c970723da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:13.129825 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bcf22-b778-47a9-a05f-db3c970723da None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:13.130326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bcf22-b778-47a9-a05f-db3c970723da None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:13.130799 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bcf22-b778-47a9-a05f-db3c970723da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:13.136496 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051aac3-41f6-4908-99ae-7d9e730ad11a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:13.138291 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051aac3-41f6-4908-99ae-7d9e730ad11a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:13.142520 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:13.152936 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3bcf22-b778-47a9-a05f-db3c970723da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:13.155758 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3bcf22-b778-47a9-a05f-db3c970723da None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:13.159085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-4051aac3-41f6-4908-99ae-7d9e730ad11a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:13.159085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:13.159085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:13.159085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:13.159085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:13.159085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:13.159085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:13.159085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:13.159085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:13.159085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:13.159085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:13.159085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:13.159085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:13.159085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:13.159085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:13.159085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:13.160179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:13.160179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:13.160179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:13.160179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:13.160179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:13.160179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:13.160179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:13.160179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:13.160179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:13.160179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:13.160179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:13.160179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:13.160179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:13.160179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:13.160179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:13.160179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:13.160179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:13.161360 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:13.161360 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:13.161360 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:13.167496 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 343/671] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:13.167496 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051aac3-41f6-4908-99ae-7d9e730ad11a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:13.175163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-2c3bcf22-b778-47a9-a05f-db3c970723da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:13.175163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:13.175163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:13.175163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:13.175163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:13.175163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:13.175163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:13.175163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:13.175163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:13.175163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:13.175163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:13.175163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:13.175163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:13.175163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:13.175163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:13.175163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:13.184406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:13.184406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:13.184406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:13.184406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:13.184406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:13.184406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:13.184406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:13.184406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:13.184406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:13.184406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:13.184406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:13.184406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:13.184406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:13.184406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:13.184406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:13.184406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:13.184406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:13.186262 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:13.186262 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:13.186262 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:13.186262 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 329/672] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:13.186262 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bcf22-b778-47a9-a05f-db3c970723da None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:13.308569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:13.310062 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051aac3-41f6-4908-99ae-7d9e730ad11a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:13.317523 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bcf22-b778-47a9-a05f-db3c970723da None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:13.366918 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac95762-6320-4011-9a03-15f4c91c730e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:13.367876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac95762-6320-4011-9a03-15f4c91c730e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:13.368113 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac95762-6320-4011-9a03-15f4c91c730e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:13.368375 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac95762-6320-4011-9a03-15f4c91c730e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:13.369261 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac95762-6320-4011-9a03-15f4c91c730e None admin] RBAC: Adding query filter params (role.id=93abdb875d35417d91e420a60ccafbd2, scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f, user.id=55f389ab3ea046008b44f129113de995) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:13.369603 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac95762-6320-4011-9a03-15f4c91c730e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:13.371025 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac95762-6320-4011-9a03-15f4c91c730e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:13.374991 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3d2fb-8c0e-42ef-bff6-d454812a7f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:13.375962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3d2fb-8c0e-42ef-bff6-d454812a7f13 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:13.376433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3d2fb-8c0e-42ef-bff6-d454812a7f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:13.376965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3d2fb-8c0e-42ef-bff6-d454812a7f13 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:13.388770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 344/673] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:13 2022] GET /identity/v3/role_assignments?user.id=55f389ab3ea046008b44f129113de995&scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f&role.id=93abdb875d35417d91e420a60ccafbd2 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:13.389062 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3d2fb-8c0e-42ef-bff6-d454812a7f13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:13.389218 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac95762-6320-4011-9a03-15f4c91c730e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:13.389385 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3d2fb-8c0e-42ef-bff6-d454812a7f13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:13.389385 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3d2fb-8c0e-42ef-bff6-d454812a7f13 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:13.418743 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 330/674] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:13.421078 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3d2fb-8c0e-42ef-bff6-d454812a7f13 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:13.537241 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:13.551467 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac95762-6320-4011-9a03-15f4c91c730e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:13.601931 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccdb7b-a497-4790-b017-55b44a3908ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:13.602950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccdb7b-a497-4790-b017-55b44a3908ad None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:13.603210 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccdb7b-a497-4790-b017-55b44a3908ad None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:13.603702 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccdb7b-a497-4790-b017-55b44a3908ad None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:13.604484 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fccdb7b-a497-4790-b017-55b44a3908ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:13.604969 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fccdb7b-a497-4790-b017-55b44a3908ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:13.608216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fccdb7b-a497-4790-b017-55b44a3908ad None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:13.628214 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 345/675] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:13.629309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccdb7b-a497-4790-b017-55b44a3908ad None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:13.641433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3d2fb-8c0e-42ef-bff6-d454812a7f13 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:13.727350 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276191e0-9181-42ba-aa94-6605c6a6786b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:13.728321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276191e0-9181-42ba-aa94-6605c6a6786b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:13.728321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276191e0-9181-42ba-aa94-6605c6a6786b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:13.728684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276191e0-9181-42ba-aa94-6605c6a6786b None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:13.733514 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276191e0-9181-42ba-aa94-6605c6a6786b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:13.733829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276191e0-9181-42ba-aa94-6605c6a6786b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:13.735377 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276191e0-9181-42ba-aa94-6605c6a6786b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:13.750566 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 331/676] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:13.751574 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276191e0-9181-42ba-aa94-6605c6a6786b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:13.777321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:13.833046 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccdb7b-a497-4790-b017-55b44a3908ad None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:13.885158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:13.927562 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9521b3-6299-4808-a5f7-2e0684b5399a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:13.928788 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9521b3-6299-4808-a5f7-2e0684b5399a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:13.929283 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9521b3-6299-4808-a5f7-2e0684b5399a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:13.929770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9521b3-6299-4808-a5f7-2e0684b5399a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:13.944751 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9521b3-6299-4808-a5f7-2e0684b5399a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:13.947977 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9521b3-6299-4808-a5f7-2e0684b5399a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:13.966190 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276191e0-9181-42ba-aa94-6605c6a6786b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:13.973222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-2e9521b3-6299-4808-a5f7-2e0684b5399a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:13.973222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:13.973222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:13.973222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:13.973222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:13.973222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:13.973222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:13.973222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:13.973222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:13.973222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:13.973222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:13.973222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:13.973222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:13.973222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:13.973222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:13.974168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:13.974168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:13.974168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:13.974168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:13.974168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:13.974168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:13.974168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:13.974168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:13.974168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:13.974168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:13.974168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:13.974168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:13.974168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:13.974168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:13.974168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:13.974168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:13.974168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:13.975036 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:13.975036 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:13.975036 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:13.975036 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:13.975036 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:13.975036 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:13.975036 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:13.975036 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:13.976185 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 346/677] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:13.977334 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9521b3-6299-4808-a5f7-2e0684b5399a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:14.035924 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18278824-fc87-41e3-932c-765f62f5d589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:14.037044 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18278824-fc87-41e3-932c-765f62f5d589 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:14.037605 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18278824-fc87-41e3-932c-765f62f5d589 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:14.038091 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18278824-fc87-41e3-932c-765f62f5d589 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:14.062150 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18278824-fc87-41e3-932c-765f62f5d589 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:14.065381 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18278824-fc87-41e3-932c-765f62f5d589 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:14.095989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-18278824-fc87-41e3-932c-765f62f5d589 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:20:14.095989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:14.095989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:14.095989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:14.095989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:14.095989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:14.095989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:14.095989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:14.095989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:14.095989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:14.095989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:14.095989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:14.095989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:14.095989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:14.095989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:14.095989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:14.098185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:14.098185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:14.098185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:14.098185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:14.098185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:14.098185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:14.098185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:14.098185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:14.098185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:14.098185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:14.098185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:14.098185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:14.098185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:14.098185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:14.098185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:14.098185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:14.098185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:14.098185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:14.100296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:14.100296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:14.100296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:14.100296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:14.100296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:14.100296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:14.100296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:14.100296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:14.100296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:20:14.100296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:14.104237 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 332/678] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:20:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:14.112688 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18278824-fc87-41e3-932c-765f62f5d589 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:14.229542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9521b3-6299-4808-a5f7-2e0684b5399a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:14.240361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:14.266188 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18278824-fc87-41e3-932c-765f62f5d589 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:14.301420 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c176432-0e3d-453d-a29d-8ff0be66a786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:14.302492 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c176432-0e3d-453d-a29d-8ff0be66a786 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:14.302976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c176432-0e3d-453d-a29d-8ff0be66a786 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:14.303468 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c176432-0e3d-453d-a29d-8ff0be66a786 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:14.317500 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c176432-0e3d-453d-a29d-8ff0be66a786 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:14.320342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c176432-0e3d-453d-a29d-8ff0be66a786 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:14.334513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6986765-9585-46e0-8e66-2d3714572ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:14.335871 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6986765-9585-46e0-8e66-2d3714572ccc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:14.336586 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6986765-9585-46e0-8e66-2d3714572ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:14.337313 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6986765-9585-46e0-8e66-2d3714572ccc None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:14.338843 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6986765-9585-46e0-8e66-2d3714572ccc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:14.339598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6986765-9585-46e0-8e66-2d3714572ccc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:14.343307 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6986765-9585-46e0-8e66-2d3714572ccc None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:14.345674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-5c176432-0e3d-453d-a29d-8ff0be66a786 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:14.345674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:14.345674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:14.345674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:14.345674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:14.345674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:14.345674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:14.345674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:14.345674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:14.345674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:14.345674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:14.345674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:14.345674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:14.345674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:14.345674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:14.347550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:14.347550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:14.347550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:14.347550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:14.347550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:14.347550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:14.347550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:14.347550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:14.347550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:14.347550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:14.347550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:14.347550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:14.347550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:14.347550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:14.347550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:14.347550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:14.347550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:14.349662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:14.349662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:14.349662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:14.349662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:14.349662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:14.349662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:14.349662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:14.349662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:14.355675 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 347/679] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:14.357800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c176432-0e3d-453d-a29d-8ff0be66a786 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:14.375385 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 333/680] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:14.377312 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6986765-9585-46e0-8e66-2d3714572ccc None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:14.452495 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:14.525835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6986765-9585-46e0-8e66-2d3714572ccc None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:14.566054 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6aac3c-8e17-4ba9-8a7d-8260799824a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:14.566831 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6aac3c-8e17-4ba9-8a7d-8260799824a1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:14.567214 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6aac3c-8e17-4ba9-8a7d-8260799824a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:14.567608 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6aac3c-8e17-4ba9-8a7d-8260799824a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:14.568432 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6aac3c-8e17-4ba9-8a7d-8260799824a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:14.568898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6aac3c-8e17-4ba9-8a7d-8260799824a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:14.570486 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6aac3c-8e17-4ba9-8a7d-8260799824a1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:14.573111 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:14.581088 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c176432-0e3d-453d-a29d-8ff0be66a786 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:14.592656 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 334/681] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:14.592656 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6aac3c-8e17-4ba9-8a7d-8260799824a1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:14.658444 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac3042-93cb-48bf-a091-a1671de8e4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:14.660430 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac3042-93cb-48bf-a091-a1671de8e4fb None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:14.661389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac3042-93cb-48bf-a091-a1671de8e4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:14.662080 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac3042-93cb-48bf-a091-a1671de8e4fb None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:14.663995 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac3042-93cb-48bf-a091-a1671de8e4fb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:14.664900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac3042-93cb-48bf-a091-a1671de8e4fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:14.667922 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac3042-93cb-48bf-a091-a1671de8e4fb None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:14.710361 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 348/682] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Sep 1 16:20:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:14.712377 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac3042-93cb-48bf-a091-a1671de8e4fb None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:14.738919 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6aac3c-8e17-4ba9-8a7d-8260799824a1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:14.781305 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350f65f-c809-485a-b267-68cf0de41d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:14.781999 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350f65f-c809-485a-b267-68cf0de41d0b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:14.782387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350f65f-c809-485a-b267-68cf0de41d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:14.782768 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350f65f-c809-485a-b267-68cf0de41d0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:14.783758 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350f65f-c809-485a-b267-68cf0de41d0b None admin] RBAC: Adding query filter params (role.id=93abdb875d35417d91e420a60ccafbd2, scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f, user.id=80a92eaeb5c54414864deef3052bd8f2) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:14.784140 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350f65f-c809-485a-b267-68cf0de41d0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:14.785880 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350f65f-c809-485a-b267-68cf0de41d0b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:14.800877 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 335/683] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:14 2022] GET /identity/v3/role_assignments?user.id=80a92eaeb5c54414864deef3052bd8f2&scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f&role.id=93abdb875d35417d91e420a60ccafbd2 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:14.802061 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350f65f-c809-485a-b267-68cf0de41d0b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:14.894410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:14.930498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:14.936199 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac3042-93cb-48bf-a091-a1671de8e4fb None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:14.987469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78f35a-ada6-4b07-86ee-d116efd84d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:14.988096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78f35a-ada6-4b07-86ee-d116efd84d54 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:14.988375 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78f35a-ada6-4b07-86ee-d116efd84d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:14.988677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78f35a-ada6-4b07-86ee-d116efd84d54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:14.989513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78f35a-ada6-4b07-86ee-d116efd84d54 None admin] RBAC: Adding query filter params (role.id=93abdb875d35417d91e420a60ccafbd2, scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f, user.id=0668b918bf2c49c2901838cd22770030) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:14.989722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78f35a-ada6-4b07-86ee-d116efd84d54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:14.991913 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78f35a-ada6-4b07-86ee-d116efd84d54 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:14.998788 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350f65f-c809-485a-b267-68cf0de41d0b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:15.001634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 349/684] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:14 2022] GET /identity/v3/role_assignments?user.id=0668b918bf2c49c2901838cd22770030&scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f&role.id=93abdb875d35417d91e420a60ccafbd2 => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:15.003121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e62c6d-d6cf-4a41-b554-6cce835602b0 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:15.003524 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e62c6d-d6cf-4a41-b554-6cce835602b0 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:15.003805 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e62c6d-d6cf-4a41-b554-6cce835602b0 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:15.009857 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 350/685] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:15.025890 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643985af-27fa-4af4-8c47-afd7eeaad9bc None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:15.026168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643985af-27fa-4af4-8c47-afd7eeaad9bc None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:15.026448 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643985af-27fa-4af4-8c47-afd7eeaad9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:15.058525 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16a18e-27ff-4045-b70c-53b127f5f2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:15.059788 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-643985af-27fa-4af4-8c47-afd7eeaad9bc None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:15.061250 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-643985af-27fa-4af4-8c47-afd7eeaad9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:15.061763 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16a18e-27ff-4045-b70c-53b127f5f2fe None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:15.062274 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16a18e-27ff-4045-b70c-53b127f5f2fe None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:15.062822 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16a18e-27ff-4045-b70c-53b127f5f2fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:15.177915 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16a18e-27ff-4045-b70c-53b127f5f2fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:15.180359 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16a18e-27ff-4045-b70c-53b127f5f2fe None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:15.212026 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 351/686] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:20:15.255849 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:15.330353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 336/687] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:20:15.337317 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643985af-27fa-4af4-8c47-afd7eeaad9bc None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:15.494473 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:15.507243 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643985af-27fa-4af4-8c47-afd7eeaad9bc None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:15.550969 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf99560-a736-4b47-bb6b-5c3a37783bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:15.551629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf99560-a736-4b47-bb6b-5c3a37783bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:15.551907 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf99560-a736-4b47-bb6b-5c3a37783bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:15.552178 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf99560-a736-4b47-bb6b-5c3a37783bb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:15.567196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf99560-a736-4b47-bb6b-5c3a37783bb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:15.568695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf99560-a736-4b47-bb6b-5c3a37783bb3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:15.585647 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-edf99560-a736-4b47-bb6b-5c3a37783bb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:15.585647 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:15.585647 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:15.585647 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:15.585647 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:15.585647 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:15.585647 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:15.585647 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:15.585647 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:15.585647 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:15.585647 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:15.585647 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:15.585647 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:15.585647 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:15.585647 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:15.585647 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:15.586609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:15.586609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:15.586609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:15.586609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:15.586609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:15.586609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:15.586609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:15.586609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:15.586609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:15.586609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:15.586609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:15.586609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:15.586609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:15.586609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:15.586609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:15.586609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:15.586609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:15.587494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:15.587494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:15.587494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:15.591880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 352/688] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:15.593458 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16a18e-27ff-4045-b70c-53b127f5f2fe None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:15.744226 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16a18e-27ff-4045-b70c-53b127f5f2fe None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:15.785109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf99560-a736-4b47-bb6b-5c3a37783bb3 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:15.812147 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee1069-8e92-42e9-beb7-e9c08de94415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:15.813369 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee1069-8e92-42e9-beb7-e9c08de94415 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:15.814782 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee1069-8e92-42e9-beb7-e9c08de94415 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:15.815269 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee1069-8e92-42e9-beb7-e9c08de94415 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:15.816433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee1069-8e92-42e9-beb7-e9c08de94415 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:15.816997 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee1069-8e92-42e9-beb7-e9c08de94415 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:15.820571 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee1069-8e92-42e9-beb7-e9c08de94415 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:15.844887 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 337/689] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:15.848101 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee1069-8e92-42e9-beb7-e9c08de94415 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:15.906594 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:16.098732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf99560-a736-4b47-bb6b-5c3a37783bb3 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:16.110862 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee1069-8e92-42e9-beb7-e9c08de94415 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:16.190061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601ff83-f946-402a-9d7c-5e9c378a88b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:16.191150 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601ff83-f946-402a-9d7c-5e9c378a88b5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:16.191620 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601ff83-f946-402a-9d7c-5e9c378a88b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:16.192084 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601ff83-f946-402a-9d7c-5e9c378a88b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:16.225115 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601ff83-f946-402a-9d7c-5e9c378a88b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:16.229336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601ff83-f946-402a-9d7c-5e9c378a88b5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:16.235294 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c069f0-f442-4e44-9fbe-df18c8529a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:16.235952 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c069f0-f442-4e44-9fbe-df18c8529a93 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:16.236223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c069f0-f442-4e44-9fbe-df18c8529a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:16.236506 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c069f0-f442-4e44-9fbe-df18c8529a93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:16.238881 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:16.253140 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c069f0-f442-4e44-9fbe-df18c8529a93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:16.254655 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c069f0-f442-4e44-9fbe-df18c8529a93 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:16.260677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-c601ff83-f946-402a-9d7c-5e9c378a88b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:16.260677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:16.260677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:16.260677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:16.260677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:16.260677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:16.260677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:16.260677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:16.260677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:16.260677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:16.260677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:16.260677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:16.260677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:16.260677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:16.260677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:16.260677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:16.261845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:16.261845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:16.261845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:16.261845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:16.261845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:16.261845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:16.261845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:16.261845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:16.261845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:16.261845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:16.261845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:16.261845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:16.261845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:16.261845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:16.261845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:16.261845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:16.261845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:16.262903 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:16.262903 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:16.262903 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:16.269100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 353/690] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 484 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:16.270191 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601ff83-f946-402a-9d7c-5e9c378a88b5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:16.275865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-f2c069f0-f442-4e44-9fbe-df18c8529a93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:16.275865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:16.275865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:16.275865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:16.275865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:16.275865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:16.275865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:16.275865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:16.275865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:16.275865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:16.275865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:16.275865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:16.275865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:16.275865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:16.275865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:16.277769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:16.277769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:16.277769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:16.277769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:16.277769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:16.277769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:16.277769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:16.277769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:16.277769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:16.277769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:16.277769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:16.277769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:16.277769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:16.277769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:16.277769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:16.277769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:16.277769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:16.279770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:16.279770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:16.279770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:16.279770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:16.279770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:16.279770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:16.279770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:16.279770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:16.279770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 338/691] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:16.285517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c069f0-f442-4e44-9fbe-df18c8529a93 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:16.397459 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:16.423609 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c069f0-f442-4e44-9fbe-df18c8529a93 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:16.470830 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb524322-362c-45ed-810f-7473cce64e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:16.471851 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb524322-362c-45ed-810f-7473cce64e1a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:16.472343 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb524322-362c-45ed-810f-7473cce64e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:16.472868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb524322-362c-45ed-810f-7473cce64e1a None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:16.473829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb524322-362c-45ed-810f-7473cce64e1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:16.474383 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb524322-362c-45ed-810f-7473cce64e1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:16.476121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb524322-362c-45ed-810f-7473cce64e1a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:16.491419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 339/692] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:16.500546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb524322-362c-45ed-810f-7473cce64e1a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:16.536685 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601ff83-f946-402a-9d7c-5e9c378a88b5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:16.599904 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283f36b-67b9-45f5-a0ce-e39aa028f345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:16.600960 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283f36b-67b9-45f5-a0ce-e39aa028f345 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:16.601424 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283f36b-67b9-45f5-a0ce-e39aa028f345 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:16.601883 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283f36b-67b9-45f5-a0ce-e39aa028f345 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:16.603058 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283f36b-67b9-45f5-a0ce-e39aa028f345 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:16.603601 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283f36b-67b9-45f5-a0ce-e39aa028f345 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:16.606505 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283f36b-67b9-45f5-a0ce-e39aa028f345 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:16.632000 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 354/693] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:16.641818 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283f36b-67b9-45f5-a0ce-e39aa028f345 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:16.715684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb524322-362c-45ed-810f-7473cce64e1a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:16.726906 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:16.786315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288cb51f-9244-4652-a7b5-52010b046051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:16.787317 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cb51f-9244-4652-a7b5-52010b046051 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:16.787597 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cb51f-9244-4652-a7b5-52010b046051 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:16.787871 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cb51f-9244-4652-a7b5-52010b046051 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:16.788671 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288cb51f-9244-4652-a7b5-52010b046051 None admin] RBAC: Adding query filter params (role.id=93abdb875d35417d91e420a60ccafbd2, scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f, user.id=748e35d9a1534920860b2234d45f6724) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:16.788978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288cb51f-9244-4652-a7b5-52010b046051 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:16.791545 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288cb51f-9244-4652-a7b5-52010b046051 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:16.796333 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283f36b-67b9-45f5-a0ce-e39aa028f345 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:16.799947 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 340/694] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:16 2022] GET /identity/v3/role_assignments?user.id=748e35d9a1534920860b2234d45f6724&scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f&role.id=93abdb875d35417d91e420a60ccafbd2 => generated 608 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:16.801387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62570caf-80f3-462c-a2f9-8dcc50ce0bea None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:16.801677 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62570caf-80f3-462c-a2f9-8dcc50ce0bea None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:16.801954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62570caf-80f3-462c-a2f9-8dcc50ce0bea None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:16.803595 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 341/695] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:16.818383 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e9b8b-1231-4d51-bd28-3418f15a7de5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:16.818710 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e9b8b-1231-4d51-bd28-3418f15a7de5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:16.818973 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e9b8b-1231-4d51-bd28-3418f15a7de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:16.832977 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:16.864979 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-dd5e9b8b-1231-4d51-bd28-3418f15a7de5 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:16.866241 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dd5e9b8b-1231-4d51-bd28-3418f15a7de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:16.893608 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3bdd1-405d-4f35-a990-79c7c0517479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:16.894318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3bdd1-405d-4f35-a990-79c7c0517479 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:16.894604 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3bdd1-405d-4f35-a990-79c7c0517479 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:16.894872 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3bdd1-405d-4f35-a990-79c7c0517479 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:16.895561 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3bdd1-405d-4f35-a990-79c7c0517479 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:16.897486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3bdd1-405d-4f35-a990-79c7c0517479 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:16.941243 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 355/696] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 1 16:20:16 2022] POST /identity/v3/users => generated 254 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:20:17.037503 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 342/697] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:20:17.324226 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3bdd1-405d-4f35-a990-79c7c0517479 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:17.559623 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3bdd1-405d-4f35-a990-79c7c0517479 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:17.590020 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:17.633812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb554c75-b01f-49a1-bd0f-9284257cbf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:17.634875 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb554c75-b01f-49a1-bd0f-9284257cbf75 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:17.635395 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb554c75-b01f-49a1-bd0f-9284257cbf75 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:17.635854 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb554c75-b01f-49a1-bd0f-9284257cbf75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:17.658055 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb554c75-b01f-49a1-bd0f-9284257cbf75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:17.669104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-fb554c75-b01f-49a1-bd0f-9284257cbf75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:17.669104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:17.669104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:17.669104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:17.669104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:17.669104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:17.669104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:17.669104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:17.669104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:17.669104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:17.669104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:17.669104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:17.669104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:17.669104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:17.669104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:17.669104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:17.670839 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:17.670839 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:17.670839 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:17.670839 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:17.670839 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:17.670839 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:17.670839 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:17.670839 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:17.670839 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:17.670839 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:17.670839 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:17.670839 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:17.670839 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:17.670839 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:17.670839 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:17.670839 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:17.671684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:17.671684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:17.671684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:17.671684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:17.671684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:17.671684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:17.671684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:17.671684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:17.671684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:17.671684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:17.671684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:17.671684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:17.672417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 356/698] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:20:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:17.681654 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e9b8b-1231-4d51-bd28-3418f15a7de5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:17.928733 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e9b8b-1231-4d51-bd28-3418f15a7de5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:17.998070 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:18.017082 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e19b6c-3bc5-412d-8239-22718bc4317f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:18.018108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e19b6c-3bc5-412d-8239-22718bc4317f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:18.018591 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e19b6c-3bc5-412d-8239-22718bc4317f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:18.019070 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e19b6c-3bc5-412d-8239-22718bc4317f None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:18.020299 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e19b6c-3bc5-412d-8239-22718bc4317f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:18.020866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e19b6c-3bc5-412d-8239-22718bc4317f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:18.023454 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e19b6c-3bc5-412d-8239-22718bc4317f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:18.047766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 343/699] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:20:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:18.056676 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb554c75-b01f-49a1-bd0f-9284257cbf75 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:18.171639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30d817-8670-4aec-b3d5-4de4a0dac1b7 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:18.172342 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30d817-8670-4aec-b3d5-4de4a0dac1b7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:18.172876 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30d817-8670-4aec-b3d5-4de4a0dac1b7 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:18.174882 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 344/700] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:20:18.180864 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fca564-cbf4-4c13-b8fb-6721a3538a16 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:18.181806 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fca564-cbf4-4c13-b8fb-6721a3538a16 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:18.182436 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fca564-cbf4-4c13-b8fb-6721a3538a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:18.204210 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a5fca564-cbf4-4c13-b8fb-6721a3538a16 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:18.205816 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a5fca564-cbf4-4c13-b8fb-6721a3538a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:18.376337 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb554c75-b01f-49a1-bd0f-9284257cbf75 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:18.397418 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 345/701] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:20:18.400301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1dbe99-f9bc-4d5f-b8b9-80f849a07d22 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:18.401206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1dbe99-f9bc-4d5f-b8b9-80f849a07d22 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:18.401986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1dbe99-f9bc-4d5f-b8b9-80f849a07d22 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:18.405279 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 346/702] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:18.417844 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a705e-f352-4f17-92ec-5e74daa1252d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:18.418751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a705e-f352-4f17-92ec-5e74daa1252d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:18.419532 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a705e-f352-4f17-92ec-5e74daa1252d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:18.436509 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8542b-cf27-466d-8b37-4e35dda0955c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:18.437196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8542b-cf27-466d-8b37-4e35dda0955c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:18.437480 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8542b-cf27-466d-8b37-4e35dda0955c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:18.437756 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8542b-cf27-466d-8b37-4e35dda0955c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:18.462774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8542b-cf27-466d-8b37-4e35dda0955c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:18.464290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8542b-cf27-466d-8b37-4e35dda0955c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:18.465846 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-617a705e-f352-4f17-92ec-5e74daa1252d None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:18.467125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-617a705e-f352-4f17-92ec-5e74daa1252d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:18.502862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-09c8542b-cf27-466d-8b37-4e35dda0955c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:18.502862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:18.502862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:18.502862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:18.502862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:18.502862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:18.502862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:18.502862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:18.502862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:18.502862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:18.502862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:18.502862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:18.502862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:18.502862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:18.502862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:18.502862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:18.503878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:18.503878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:18.503878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:18.503878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:18.503878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:18.503878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:18.503878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:18.503878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:18.503878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:18.503878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:18.503878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:18.503878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:18.503878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:18.503878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:18.503878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:18.503878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:18.503878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:18.504795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:18.504795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:18.504795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:18.505556 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 357/703] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 450 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:18.515082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8542b-cf27-466d-8b37-4e35dda0955c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:18.617185 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:18.736665 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 347/704] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:20:18.739371 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a705e-f352-4f17-92ec-5e74daa1252d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:18.823225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8542b-cf27-466d-8b37-4e35dda0955c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:18.869480 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b960e1-b253-4cbf-8dbb-cf525144bdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:18.870280 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b960e1-b253-4cbf-8dbb-cf525144bdfe None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:18.870659 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b960e1-b253-4cbf-8dbb-cf525144bdfe None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:18.871040 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b960e1-b253-4cbf-8dbb-cf525144bdfe None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:18.871852 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b960e1-b253-4cbf-8dbb-cf525144bdfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:18.874149 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b960e1-b253-4cbf-8dbb-cf525144bdfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:18.876163 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b960e1-b253-4cbf-8dbb-cf525144bdfe None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:18.890753 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 358/705] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:18.899348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b960e1-b253-4cbf-8dbb-cf525144bdfe None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:18.925561 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:18.985325 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a705e-f352-4f17-92ec-5e74daa1252d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:19.032873 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e66c4d-a234-4a02-8259-6649281a85f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:19.033732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e66c4d-a234-4a02-8259-6649281a85f3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:19.034080 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e66c4d-a234-4a02-8259-6649281a85f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:19.034351 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e66c4d-a234-4a02-8259-6649281a85f3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:19.035899 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e66c4d-a234-4a02-8259-6649281a85f3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:19.042801 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e66c4d-a234-4a02-8259-6649281a85f3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:19.062650 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-83e66c4d-a234-4a02-8259-6649281a85f3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:20:19.062650 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:19.062650 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:19.062650 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:19.062650 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:19.062650 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:19.062650 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:19.062650 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:19.062650 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:20:19.062650 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:19.062650 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:19.062650 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:19.062650 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:19.062650 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:19.062650 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:19.062650 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:19.062650 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:19.066513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:19.066513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:19.066513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:19.066513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:19.066513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:19.066513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:19.066513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:19.066513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:19.066513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:19.066513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:19.066513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:19.066513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:19.066513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:19.066513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:19.066513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:19.066513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:19.071366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:19.071366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:19.071366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:19.071366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:19.071366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:19.071366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:19.071366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:19.071366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:19.071366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:19.071366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:19.071366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:19.071366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:19.071366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:20:19.071366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:19.071366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 348/706] 10.222.0.52 () {56 vars in 1129 bytes} [Thu Sep 1 16:20:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:19.074547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e66c4d-a234-4a02-8259-6649281a85f3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:19.106180 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:19.127508 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b960e1-b253-4cbf-8dbb-cf525144bdfe None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:19.175430 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74d904-7452-4f6a-960b-c68dea4e7e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:19.176098 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74d904-7452-4f6a-960b-c68dea4e7e87 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:19.176368 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74d904-7452-4f6a-960b-c68dea4e7e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:19.176694 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74d904-7452-4f6a-960b-c68dea4e7e87 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:19.186218 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74d904-7452-4f6a-960b-c68dea4e7e87 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:19.187896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74d904-7452-4f6a-960b-c68dea4e7e87 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:19.202318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-8f74d904-7452-4f6a-960b-c68dea4e7e87 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:20:19.202318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:19.202318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:19.202318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:19.202318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:19.202318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:19.202318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:19.202318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:19.202318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:19.202318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:19.202318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:19.202318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:19.202318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:19.202318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:19.202318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:19.202318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:19.205600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:19.205600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:19.205600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:19.205600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:19.205600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:19.205600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:19.205600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:19.205600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:19.205600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:19.205600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:19.205600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:19.205600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:19.205600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:19.205600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:19.205600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:19.205600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:19.205600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:19.205600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:19.208979 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:19.208979 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:19.208979 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:19.208979 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:19.208979 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:19.208979 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:19.208979 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:19.208979 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:19.208979 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:20:19.208979 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:19.208979 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 359/707] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Sep 1 16:20:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:19.221992 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e66c4d-a234-4a02-8259-6649281a85f3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:19.222239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74d904-7452-4f6a-960b-c68dea4e7e87 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:19.226317 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:19.248649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d866c03-9084-42ed-8d16-6a0e532c4469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:19.250384 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d866c03-9084-42ed-8d16-6a0e532c4469 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:19.250854 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d866c03-9084-42ed-8d16-6a0e532c4469 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:19.251308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d866c03-9084-42ed-8d16-6a0e532c4469 None admin] PATH_INFO: `/v3/services/network` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:19.252107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d866c03-9084-42ed-8d16-6a0e532c4469 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:19.253915 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d866c03-9084-42ed-8d16-6a0e532c4469 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:19.265258 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-7d866c03-9084-42ed-8d16-6a0e532c4469 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:20:19.265258 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:19.265258 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:19.265258 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:19.265258 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:19.265258 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:19.265258 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:19.265258 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:19.265258 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:20:19.265258 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:19.265258 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:19.265258 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:19.265258 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:19.265258 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:19.265258 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:19.265258 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:19.265258 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:19.266333 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:19.266333 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:19.266333 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:19.266333 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:19.266333 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:19.266333 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:19.266333 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:19.266333 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:19.266333 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:19.266333 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:19.266333 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:19.266333 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:19.266333 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:19.266333 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:19.266333 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:19.266333 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:19.267155 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:19.267155 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:19.267155 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:19.267155 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:19.267155 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:19.267155 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:19.267155 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:19.267155 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:19.267155 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:19.267155 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:19.267155 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:19.267155 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:19.267155 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:20:19.267155 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:19.270082 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 349/708] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:19 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:19.271212 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d866c03-9084-42ed-8d16-6a0e532c4469 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:19.341905 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74d904-7452-4f6a-960b-c68dea4e7e87 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:19.383996 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febb0e2-6a34-45a3-a641-ce945db152e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:19.384320 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febb0e2-6a34-45a3-a641-ce945db152e5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:19.384556 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febb0e2-6a34-45a3-a641-ce945db152e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:19.384867 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febb0e2-6a34-45a3-a641-ce945db152e5 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:19.385532 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febb0e2-6a34-45a3-a641-ce945db152e5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:19.385932 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febb0e2-6a34-45a3-a641-ce945db152e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:19.387490 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febb0e2-6a34-45a3-a641-ce945db152e5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:19.392840 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d866c03-9084-42ed-8d16-6a0e532c4469 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:19.398648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 360/709] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Sep 1 16:20:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:19.398648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febb0e2-6a34-45a3-a641-ce945db152e5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:19.414844 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:19.452437 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba54886-69dd-4583-8e6b-46cebb948063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:19.453098 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba54886-69dd-4583-8e6b-46cebb948063 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:19.453403 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba54886-69dd-4583-8e6b-46cebb948063 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:19.454008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba54886-69dd-4583-8e6b-46cebb948063 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:19.454966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba54886-69dd-4583-8e6b-46cebb948063 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:19.456339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba54886-69dd-4583-8e6b-46cebb948063 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:19.458002 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba54886-69dd-4583-8e6b-46cebb948063 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:19.483968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 350/710] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Sep 1 16:20:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:19.484902 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba54886-69dd-4583-8e6b-46cebb948063 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:19.548789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:19.552681 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febb0e2-6a34-45a3-a641-ce945db152e5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:19.602542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ae6fa-57d5-4314-ba66-2cf28e20fe53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:19.604213 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ae6fa-57d5-4314-ba66-2cf28e20fe53 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:19.604749 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ae6fa-57d5-4314-ba66-2cf28e20fe53 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:19.605231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ae6fa-57d5-4314-ba66-2cf28e20fe53 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:19.606605 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ae6fa-57d5-4314-ba66-2cf28e20fe53 None admin] RBAC: Adding query filter params (name=network) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:19.608123 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ae6fa-57d5-4314-ba66-2cf28e20fe53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:19.610257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ae6fa-57d5-4314-ba66-2cf28e20fe53 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:19.620673 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 361/711] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Sep 1 16:20:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:19.620673 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ae6fa-57d5-4314-ba66-2cf28e20fe53 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:19.654836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba54886-69dd-4583-8e6b-46cebb948063 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:19.728464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:19.739351 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60b74e-9835-4731-953a-8bffc417805b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:19.740196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60b74e-9835-4731-953a-8bffc417805b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:19.740455 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60b74e-9835-4731-953a-8bffc417805b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:19.740829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60b74e-9835-4731-953a-8bffc417805b None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:19.741588 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60b74e-9835-4731-953a-8bffc417805b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:19.741920 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60b74e-9835-4731-953a-8bffc417805b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:19.744345 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60b74e-9835-4731-953a-8bffc417805b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:19.760656 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 351/712] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Sep 1 16:20:19 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:19.760656 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60b74e-9835-4731-953a-8bffc417805b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:19.802539 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ae6fa-57d5-4314-ba66-2cf28e20fe53 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:19.896923 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83cf23-b059-403a-8c2a-521998e41933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:19.896923 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83cf23-b059-403a-8c2a-521998e41933 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:19.897819 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83cf23-b059-403a-8c2a-521998e41933 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:19.898112 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83cf23-b059-403a-8c2a-521998e41933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:20.014522 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83cf23-b059-403a-8c2a-521998e41933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:20.016029 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83cf23-b059-403a-8c2a-521998e41933 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:20.025247 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60b74e-9835-4731-953a-8bffc417805b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:20.032516 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:20.111951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd430b0-cb7f-41b1-84c4-2701216568f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:20.113195 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd430b0-cb7f-41b1-84c4-2701216568f6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:20.113780 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd430b0-cb7f-41b1-84c4-2701216568f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:20.114590 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd430b0-cb7f-41b1-84c4-2701216568f6 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:20.116116 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd430b0-cb7f-41b1-84c4-2701216568f6 None admin] RBAC: Adding query filter params (type=network) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:20.116834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd430b0-cb7f-41b1-84c4-2701216568f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:20.119786 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd430b0-cb7f-41b1-84c4-2701216568f6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:20.121634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:20.134959 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 352/713] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Sep 1 16:20:19 2022] GET /identity/v3/services?type=network => generated 124 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:20.165792 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 362/714] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:20:20.174860 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd430b0-cb7f-41b1-84c4-2701216568f6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:20.315456 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79298a-8201-4da2-beaa-83057fb205ab None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:20.316020 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79298a-8201-4da2-beaa-83057fb205ab None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:20.316510 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79298a-8201-4da2-beaa-83057fb205ab None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:20.323530 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 363/715] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:20 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:20.333236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7edf41-e1d2-4dc3-a48b-03b95697a0e0 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:20.333727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7edf41-e1d2-4dc3-a48b-03b95697a0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:20.334214 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7edf41-e1d2-4dc3-a48b-03b95697a0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:20.410934 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd430b0-cb7f-41b1-84c4-2701216568f6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:20.422572 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4b7edf41-e1d2-4dc3-a48b-03b95697a0e0 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:20.424605 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4b7edf41-e1d2-4dc3-a48b-03b95697a0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:20.472424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebacb1-5543-40bd-97d0-82f5052e2ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:20.472424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebacb1-5543-40bd-97d0-82f5052e2ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:20.472424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebacb1-5543-40bd-97d0-82f5052e2ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:20.472424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ebacb1-5543-40bd-97d0-82f5052e2ad2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:20.490102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ebacb1-5543-40bd-97d0-82f5052e2ad2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:20.492027 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ebacb1-5543-40bd-97d0-82f5052e2ad2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:20.524080 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-d3ebacb1-5543-40bd-97d0-82f5052e2ad2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:20.524080 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:20.524080 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:20.524080 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:20.524080 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:20.524080 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:20.524080 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:20.524080 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:20.524080 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:20.524080 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:20.524080 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:20.524080 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:20.524080 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:20.524080 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:20.524080 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:20.524080 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:20.526021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:20.526021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:20.526021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:20.526021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:20.526021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:20.526021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:20.526021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:20.526021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:20.526021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:20.526021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:20.526021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:20.526021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:20.526021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:20.526021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:20.526021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:20.526021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:20.526021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:20.527794 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:20.527794 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:20.527794 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:20.527794 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 353/716] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:20.534477 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebacb1-5543-40bd-97d0-82f5052e2ad2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:20.607910 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:20.646070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 364/717] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:20:20.648740 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52c3d0-ad85-4f1d-994f-7909c0cecead None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:20.649543 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52c3d0-ad85-4f1d-994f-7909c0cecead None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:20.650644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52c3d0-ad85-4f1d-994f-7909c0cecead None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:20.654853 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 365/718] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:20.666123 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff86d1-f24f-4513-abc7-397fd0985830 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:20.666597 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff86d1-f24f-4513-abc7-397fd0985830 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:20.667069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff86d1-f24f-4513-abc7-397fd0985830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:20.718110 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-79ff86d1-f24f-4513-abc7-397fd0985830 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:20.720124 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-79ff86d1-f24f-4513-abc7-397fd0985830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:20.881336 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ebacb1-5543-40bd-97d0-82f5052e2ad2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:20.927540 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 366/719] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:20:20.973391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58128a2f-bb2a-42e3-9f52-8398708ef73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:20.974304 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58128a2f-bb2a-42e3-9f52-8398708ef73c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:20.974798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58128a2f-bb2a-42e3-9f52-8398708ef73c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:20.975287 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58128a2f-bb2a-42e3-9f52-8398708ef73c None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:20.976503 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58128a2f-bb2a-42e3-9f52-8398708ef73c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:20.977064 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58128a2f-bb2a-42e3-9f52-8398708ef73c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:20.979611 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58128a2f-bb2a-42e3-9f52-8398708ef73c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:21.012797 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 354/720] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 478 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:21.020027 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff86d1-f24f-4513-abc7-397fd0985830 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:21.137154 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:21.220127 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff86d1-f24f-4513-abc7-397fd0985830 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:21.261741 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58128a2f-bb2a-42e3-9f52-8398708ef73c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:21.277852 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5db6fa-aef5-4104-9336-9b0122024fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:21.278977 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5db6fa-aef5-4104-9336-9b0122024fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:21.279477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5db6fa-aef5-4104-9336-9b0122024fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:21.281527 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5db6fa-aef5-4104-9336-9b0122024fc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:21.310920 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5db6fa-aef5-4104-9336-9b0122024fc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:21.314024 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5db6fa-aef5-4104-9336-9b0122024fc1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:21.351953 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-6c5db6fa-aef5-4104-9336-9b0122024fc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:21.351953 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:21.351953 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:21.351953 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:21.351953 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:21.351953 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:21.351953 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:21.351953 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:21.351953 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:21.351953 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:21.351953 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:21.351953 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:21.351953 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:21.351953 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:21.351953 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:21.353732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:21.353732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:21.353732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:21.353732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:21.353732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:21.353732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:21.353732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:21.353732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:21.353732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:21.353732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:21.353732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:21.353732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:21.353732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:21.353732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:21.353732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:21.353732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:21.353732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:21.355405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:21.355405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:21.355405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:21.355405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:21.355405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:21.355405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:21.355405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:21.355405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:21.368883 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 367/721] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:21.378412 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5db6fa-aef5-4104-9336-9b0122024fc1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:21.439062 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:21.480855 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58128a2f-bb2a-42e3-9f52-8398708ef73c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:21.553895 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e0194-2e76-4fe0-be31-4118d0411364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:21.555474 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e0194-2e76-4fe0-be31-4118d0411364 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:21.556234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e0194-2e76-4fe0-be31-4118d0411364 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:21.557040 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e0194-2e76-4fe0-be31-4118d0411364 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:21.578719 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e0194-2e76-4fe0-be31-4118d0411364 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:21.588962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-f16e0194-2e76-4fe0-be31-4118d0411364 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:21.588962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:21.588962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:21.588962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:21.588962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:21.588962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:21.588962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:21.588962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:21.588962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:21.588962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:21.588962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:21.588962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:21.588962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:21.588962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:21.588962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:21.588962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:21.590773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:21.590773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:21.590773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:21.590773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:21.590773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:21.590773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:21.590773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:21.590773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:21.590773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:21.590773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:21.590773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:21.590773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:21.590773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:21.590773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:21.590773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:21.590773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:21.593011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:21.593011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:21.593011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:21.593011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:21.593011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:21.593011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:21.593011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:21.593011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:21.593011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:21.593011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:21.593011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:21.593011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:21.597745 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 355/722] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:20:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:21.599720 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e0194-2e76-4fe0-be31-4118d0411364 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:21.632051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5db6fa-aef5-4104-9336-9b0122024fc1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:21.641338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:21.705013 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d82a74-8367-4687-8263-c486f7ed7c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:21.705994 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d82a74-8367-4687-8263-c486f7ed7c5b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:21.706451 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d82a74-8367-4687-8263-c486f7ed7c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:21.706914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d82a74-8367-4687-8263-c486f7ed7c5b None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:21.708149 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d82a74-8367-4687-8263-c486f7ed7c5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:21.708693 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d82a74-8367-4687-8263-c486f7ed7c5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:21.711373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d82a74-8367-4687-8263-c486f7ed7c5b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:21.736042 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 368/723] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:21.737531 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d82a74-8367-4687-8263-c486f7ed7c5b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:21.799643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e0194-2e76-4fe0-be31-4118d0411364 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:21.872290 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b444545-a0ff-4c3e-973d-2565a87ec923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:21.874905 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b444545-a0ff-4c3e-973d-2565a87ec923 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:21.875396 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b444545-a0ff-4c3e-973d-2565a87ec923 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:21.875868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b444545-a0ff-4c3e-973d-2565a87ec923 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:21.902199 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:21.905574 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b444545-a0ff-4c3e-973d-2565a87ec923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:21.918513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-0b444545-a0ff-4c3e-973d-2565a87ec923 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:21.918513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:21.918513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:21.918513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:21.918513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:21.918513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:21.918513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:21.918513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:21.918513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:21.918513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:21.918513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:21.918513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:21.918513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:21.918513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:21.918513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:21.918513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:21.921339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:21.921339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:21.921339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:21.921339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:21.921339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:21.921339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:21.921339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:21.921339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:21.921339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:21.921339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:21.921339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:21.921339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:21.921339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:21.921339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:21.921339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:21.921339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:21.924328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:21.924328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:21.924328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:21.924328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:21.924328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:21.924328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:21.924328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:21.924328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:21.924328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:21.924328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:21.924328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:21.924328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:21.924328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 356/724] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 1 16:20:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:21.924328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b444545-a0ff-4c3e-973d-2565a87ec923 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:21.965568 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d82a74-8367-4687-8263-c486f7ed7c5b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:22.040133 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82151f08-9911-4ebf-af2a-ae549c1b7449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:22.041673 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82151f08-9911-4ebf-af2a-ae549c1b7449 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:22.042414 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82151f08-9911-4ebf-af2a-ae549c1b7449 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:22.043218 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82151f08-9911-4ebf-af2a-ae549c1b7449 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:22.045177 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82151f08-9911-4ebf-af2a-ae549c1b7449 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:22.045631 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82151f08-9911-4ebf-af2a-ae549c1b7449 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:22.051583 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82151f08-9911-4ebf-af2a-ae549c1b7449 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:22.069581 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 369/725] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:20:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:22.071269 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82151f08-9911-4ebf-af2a-ae549c1b7449 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:22.101126 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:22.155750 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b444545-a0ff-4c3e-973d-2565a87ec923 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:22.224410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e8903-ae62-4026-9a97-76a9c936c231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:22.225978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e8903-ae62-4026-9a97-76a9c936c231 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:22.226808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e8903-ae62-4026-9a97-76a9c936c231 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:22.227548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e8903-ae62-4026-9a97-76a9c936c231 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:22.229183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e8903-ae62-4026-9a97-76a9c936c231 None admin] RBAC: Adding query filter params (role.id=a8896546a02c42489ef73c7ad7c43542, scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f, user.id=55f389ab3ea046008b44f129113de995) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:22.230029 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e8903-ae62-4026-9a97-76a9c936c231 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:22.233545 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e8903-ae62-4026-9a97-76a9c936c231 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:22.245713 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 357/726] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:21 2022] GET /identity/v3/role_assignments?user.id=55f389ab3ea046008b44f129113de995&scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f&role.id=a8896546a02c42489ef73c7ad7c43542 => generated 259 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:22.247739 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e8903-ae62-4026-9a97-76a9c936c231 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:22.273361 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82151f08-9911-4ebf-af2a-ae549c1b7449 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:22.377987 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbde2f-fc8a-4157-8a22-5fce6cd071cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:22.379028 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbde2f-fc8a-4157-8a22-5fce6cd071cb None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:22.379509 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbde2f-fc8a-4157-8a22-5fce6cd071cb None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:22.379989 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbde2f-fc8a-4157-8a22-5fce6cd071cb None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:22.381273 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addbde2f-fc8a-4157-8a22-5fce6cd071cb None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:22.381793 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addbde2f-fc8a-4157-8a22-5fce6cd071cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:22.386043 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:22.392489 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addbde2f-fc8a-4157-8a22-5fce6cd071cb None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:22.422756 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 370/727] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 1 16:20:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:22.428638 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbde2f-fc8a-4157-8a22-5fce6cd071cb None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:22.481024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e8903-ae62-4026-9a97-76a9c936c231 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:22.557817 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56402bf-3cff-452e-8fab-3681b1185371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:22.559647 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56402bf-3cff-452e-8fab-3681b1185371 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:22.561114 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56402bf-3cff-452e-8fab-3681b1185371 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:22.561998 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56402bf-3cff-452e-8fab-3681b1185371 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:22.584259 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56402bf-3cff-452e-8fab-3681b1185371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:22.587771 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56402bf-3cff-452e-8fab-3681b1185371 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:22.620881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-c56402bf-3cff-452e-8fab-3681b1185371 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:22.620881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:22.620881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:22.620881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:22.620881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:22.620881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:22.620881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:22.620881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:22.620881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:22.620881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:22.620881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:22.620881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:22.620881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:22.620881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:22.620881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:22.620881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:22.623353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:22.623353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:22.623353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:22.623353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:22.623353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:22.623353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:22.623353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:22.623353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:22.623353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:22.623353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:22.623353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:22.623353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:22.623353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:22.623353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:22.623353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:22.623353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:22.623353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:22.626911 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:22.626911 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:22.626911 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:22.630394 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 358/728] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:22.638315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56402bf-3cff-452e-8fab-3681b1185371 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:22.765202 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:22.819121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56402bf-3cff-452e-8fab-3681b1185371 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:22.835150 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbde2f-fc8a-4157-8a22-5fce6cd071cb None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:22.863987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:22.907376 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727bab6-2494-4b14-b1c6-4cdf17b2c461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:22.908012 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727bab6-2494-4b14-b1c6-4cdf17b2c461 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:22.908296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727bab6-2494-4b14-b1c6-4cdf17b2c461 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:22.908597 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727bab6-2494-4b14-b1c6-4cdf17b2c461 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:22.909307 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727bab6-2494-4b14-b1c6-4cdf17b2c461 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:22.909621 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727bab6-2494-4b14-b1c6-4cdf17b2c461 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:22.911070 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727bab6-2494-4b14-b1c6-4cdf17b2c461 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:22.929061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e73c32-d125-4a74-81e6-b29c398d94bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:22.930604 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e73c32-d125-4a74-81e6-b29c398d94bd None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:22.931318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e73c32-d125-4a74-81e6-b29c398d94bd None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:22.932026 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e73c32-d125-4a74-81e6-b29c398d94bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:22.959556 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 359/729] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:22.973772 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727bab6-2494-4b14-b1c6-4cdf17b2c461 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:23.161288 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e73c32-d125-4a74-81e6-b29c398d94bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:23.164721 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e73c32-d125-4a74-81e6-b29c398d94bd None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:23.203462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-b9e73c32-d125-4a74-81e6-b29c398d94bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:23.203462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:23.203462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:23.203462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:23.203462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:23.203462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:23.203462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:23.203462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:23.203462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:23.203462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:23.203462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:23.203462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:23.203462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:23.203462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:23.203462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:23.203462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:23.205625 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:23.205625 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:23.205625 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:23.205625 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:23.205625 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:23.205625 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:23.205625 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:23.205625 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:23.205625 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:23.205625 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:23.205625 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:23.205625 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:23.205625 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:23.205625 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:23.205625 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:23.205625 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:23.205625 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:23.207364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:23.207364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:23.207364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:23.211291 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 371/730] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 784 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:23.222960 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e73c32-d125-4a74-81e6-b29c398d94bd None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:23.287201 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727bab6-2494-4b14-b1c6-4cdf17b2c461 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:23.373972 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b076a3-ceed-4482-a426-de82b452adc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:23.375331 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b076a3-ceed-4482-a426-de82b452adc3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:23.375828 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b076a3-ceed-4482-a426-de82b452adc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:23.376310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b076a3-ceed-4482-a426-de82b452adc3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:23.392922 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b076a3-ceed-4482-a426-de82b452adc3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:23.395811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b076a3-ceed-4482-a426-de82b452adc3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:23.421681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-94b076a3-ceed-4482-a426-de82b452adc3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:20:23.421681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:23.421681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:23.421681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:23.421681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:23.421681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:23.421681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:23.421681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:23.421681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:23.421681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:23.421681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:23.421681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:23.421681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:23.421681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:23.421681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:23.421681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:23.423504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:23.423504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:23.423504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:23.423504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:23.423504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:23.423504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:23.423504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:23.423504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:23.423504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:23.423504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:23.423504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:23.423504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:23.423504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:23.423504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:23.423504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:23.423504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:23.423504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:23.423504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:23.426604 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:23.426604 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:23.426604 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:23.426604 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:23.426604 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:23.426604 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:23.426604 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:23.426604 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:23.426604 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:20:23.426604 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:23.426604 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 360/731] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:20:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 451 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:23.426604 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89f081-25fb-4eee-b3a6-9c6228fb2907 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:23.429204 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89f081-25fb-4eee-b3a6-9c6228fb2907 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:23.429204 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89f081-25fb-4eee-b3a6-9c6228fb2907 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:23.437107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 361/732] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:23.439972 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89cdb0-cc11-40ce-b2d7-3dbfbf7081df None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:23.440373 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89cdb0-cc11-40ce-b2d7-3dbfbf7081df None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:23.441024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89cdb0-cc11-40ce-b2d7-3dbfbf7081df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:23.481214 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4c89cdb0-cc11-40ce-b2d7-3dbfbf7081df None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:23.482605 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4c89cdb0-cc11-40ce-b2d7-3dbfbf7081df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:23.485248 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e73c32-d125-4a74-81e6-b29c398d94bd None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:23.520714 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:23.536544 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:23.547646 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82704bad-19f7-4333-bf3e-73bbf42d6a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:23.548273 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82704bad-19f7-4333-bf3e-73bbf42d6a34 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:23.548550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82704bad-19f7-4333-bf3e-73bbf42d6a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:23.548863 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82704bad-19f7-4333-bf3e-73bbf42d6a34 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:23.549527 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82704bad-19f7-4333-bf3e-73bbf42d6a34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:23.549836 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82704bad-19f7-4333-bf3e-73bbf42d6a34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:23.551373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82704bad-19f7-4333-bf3e-73bbf42d6a34 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:23.573414 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 372/733] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:23.574557 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82704bad-19f7-4333-bf3e-73bbf42d6a34 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:23.611382 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 362/734] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:20:23.613708 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcacf14-de52-47d1-80d3-ddcb6fc35e6a None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:23.614203 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcacf14-de52-47d1-80d3-ddcb6fc35e6a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:23.614767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcacf14-de52-47d1-80d3-ddcb6fc35e6a None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:23.625280 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 363/735] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:23 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:23.626807 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcacf14-de52-47d1-80d3-ddcb6fc35e6a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:23.786573 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82704bad-19f7-4333-bf3e-73bbf42d6a34 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:23.835131 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcacf14-de52-47d1-80d3-ddcb6fc35e6a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:23.850335 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731741c5-9733-48fa-8527-766c85806941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:23.851348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731741c5-9733-48fa-8527-766c85806941 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:23.851843 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731741c5-9733-48fa-8527-766c85806941 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:23.852325 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731741c5-9733-48fa-8527-766c85806941 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:23.853477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731741c5-9733-48fa-8527-766c85806941 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:23.854044 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731741c5-9733-48fa-8527-766c85806941 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:23.855796 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731741c5-9733-48fa-8527-766c85806941 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:23.882674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 373/736] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Sep 1 16:20:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:23.884413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8d56e-339d-4c95-b495-01db3a7baba1 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:23.884967 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8d56e-339d-4c95-b495-01db3a7baba1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:23.885449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8d56e-339d-4c95-b495-01db3a7baba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:23.908224 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-d2a8d56e-339d-4c95-b495-01db3a7baba1 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:23.910008 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d2a8d56e-339d-4c95-b495-01db3a7baba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:23.931823 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a3bfc-cc68-4834-8629-10c3291ad7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:23.933544 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a3bfc-cc68-4834-8629-10c3291ad7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:23.934569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a3bfc-cc68-4834-8629-10c3291ad7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:23.935498 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a3bfc-cc68-4834-8629-10c3291ad7f6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:23.952486 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a3bfc-cc68-4834-8629-10c3291ad7f6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:23.955782 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a3bfc-cc68-4834-8629-10c3291ad7f6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:23.966434 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:23.984592 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-945a3bfc-cc68-4834-8629-10c3291ad7f6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:20:23.984592 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:23.984592 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:23.984592 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:23.984592 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:23.984592 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:23.984592 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:23.984592 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:23.984592 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:23.984592 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:23.984592 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:23.984592 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:23.984592 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:23.984592 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:23.984592 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:23.984592 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:23.986448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:23.986448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:23.986448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:23.986448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:23.986448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:23.986448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:23.986448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:23.986448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:23.986448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:23.986448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:23.986448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:23.986448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:23.986448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:23.986448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:23.986448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:23.986448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:23.986448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:23.986448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:23.988324 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:23.988324 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:23.988324 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:23.988324 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:23.988324 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:23.988324 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:23.988324 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:23.988324 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:23.988324 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:20:23.988324 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:23.993234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 364/737] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Sep 1 16:20:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:23.995562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a3bfc-cc68-4834-8629-10c3291ad7f6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:24.000353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 374/738] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:20:24.002868 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8d56e-339d-4c95-b495-01db3a7baba1 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:24.036892 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:24.136763 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a3bfc-cc68-4834-8629-10c3291ad7f6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:24.177241 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc83441-374a-4804-ab56-296608aa7f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:24.178246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc83441-374a-4804-ab56-296608aa7f9b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:24.178724 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc83441-374a-4804-ab56-296608aa7f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:24.179191 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc83441-374a-4804-ab56-296608aa7f9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:24.216767 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8d56e-339d-4c95-b495-01db3a7baba1 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:24.265007 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc83441-374a-4804-ab56-296608aa7f9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:24.267035 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc83441-374a-4804-ab56-296608aa7f9b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:24.287478 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4062a72-7d71-43dc-bfb1-b05b4900eae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:24.288506 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4062a72-7d71-43dc-bfb1-b05b4900eae0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:24.289068 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4062a72-7d71-43dc-bfb1-b05b4900eae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:24.289552 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4062a72-7d71-43dc-bfb1-b05b4900eae0 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:24.291892 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4062a72-7d71-43dc-bfb1-b05b4900eae0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:24.292708 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4062a72-7d71-43dc-bfb1-b05b4900eae0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:24.296665 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4062a72-7d71-43dc-bfb1-b05b4900eae0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:24.304696 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:24.348520 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 375/739] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Sep 1 16:20:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:24.350194 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4062a72-7d71-43dc-bfb1-b05b4900eae0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:24.398371 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 365/740] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:20:24.400125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc83441-374a-4804-ab56-296608aa7f9b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:24.420441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:24.523168 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc83441-374a-4804-ab56-296608aa7f9b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:24.545223 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4062a72-7d71-43dc-bfb1-b05b4900eae0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:24.555469 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:24.572329 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55362623-d5f2-4497-b47c-270afd1fc1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:24.574365 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55362623-d5f2-4497-b47c-270afd1fc1ab None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:24.574365 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55362623-d5f2-4497-b47c-270afd1fc1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:24.574543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55362623-d5f2-4497-b47c-270afd1fc1ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:24.604357 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27833a9f-d493-43c6-bcbd-000d50aaca6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:24.605150 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27833a9f-d493-43c6-bcbd-000d50aaca6c None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:24.605456 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27833a9f-d493-43c6-bcbd-000d50aaca6c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:24.605774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27833a9f-d493-43c6-bcbd-000d50aaca6c None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:24.607471 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27833a9f-d493-43c6-bcbd-000d50aaca6c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:24.609574 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27833a9f-d493-43c6-bcbd-000d50aaca6c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:24.648769 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 376/741] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 1 16:20:24 2022] POST /identity/v3/services => generated 240 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:20:24.648769 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27833a9f-d493-43c6-bcbd-000d50aaca6c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:24.713537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55362623-d5f2-4497-b47c-270afd1fc1ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:24.716509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55362623-d5f2-4497-b47c-270afd1fc1ab None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:24.849624 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:24.878575 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27833a9f-d493-43c6-bcbd-000d50aaca6c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:24.896148 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 366/742] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:20:24.896686 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55362623-d5f2-4497-b47c-270afd1fc1ab None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:24.941290 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:24.943589 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6889f90-239b-4f82-8965-aeabaddb9c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:24.945837 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6889f90-239b-4f82-8965-aeabaddb9c7b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:24.946401 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6889f90-239b-4f82-8965-aeabaddb9c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:24.948792 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6889f90-239b-4f82-8965-aeabaddb9c7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:24.963447 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6889f90-239b-4f82-8965-aeabaddb9c7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:24.965100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6889f90-239b-4f82-8965-aeabaddb9c7b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:24.989558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-d6889f90-239b-4f82-8965-aeabaddb9c7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:24.989558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:24.989558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:24.989558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:24.989558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:24.989558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:24.989558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:24.989558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:24.989558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:24.989558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:24.989558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:24.989558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:24.989558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:24.989558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:24.989558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:24.989558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:24.990701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:24.990701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:24.990701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:24.990701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:24.990701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:24.990701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:24.990701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:24.990701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:24.990701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:24.990701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:24.990701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:24.990701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:24.990701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:24.990701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:24.990701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:24.990701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:24.990701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:24.991898 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:24.991898 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:24.991898 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:24.992218 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 377/743] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:24.994652 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b744c4b-bbe7-4c5e-9f6b-e38ac6c87bdb None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:24.995153 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b744c4b-bbe7-4c5e-9f6b-e38ac6c87bdb None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:24.995624 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b744c4b-bbe7-4c5e-9f6b-e38ac6c87bdb None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:24.998651 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 378/744] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:25.000454 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b744c4b-bbe7-4c5e-9f6b-e38ac6c87bdb None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:25.056406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55362623-d5f2-4497-b47c-270afd1fc1ab None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:25.110571 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64875bc6-ffcd-41ec-8f5f-6b6d2cc03af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:25.111382 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64875bc6-ffcd-41ec-8f5f-6b6d2cc03af4 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:25.111873 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64875bc6-ffcd-41ec-8f5f-6b6d2cc03af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:25.112280 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64875bc6-ffcd-41ec-8f5f-6b6d2cc03af4 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:25.113303 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64875bc6-ffcd-41ec-8f5f-6b6d2cc03af4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:25.114880 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64875bc6-ffcd-41ec-8f5f-6b6d2cc03af4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:25.135575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 367/745] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 1 16:20:24 2022] POST /identity/v3/services => generated 251 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:20:25.144689 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64875bc6-ffcd-41ec-8f5f-6b6d2cc03af4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:25.191275 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b744c4b-bbe7-4c5e-9f6b-e38ac6c87bdb None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:25.257573 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:25.272360 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c0a6f-ce6b-4c5d-a1a4-f6204e3e6cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:25.274303 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c0a6f-ce6b-4c5d-a1a4-f6204e3e6cea None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:25.274916 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c0a6f-ce6b-4c5d-a1a4-f6204e3e6cea None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:25.276992 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c0a6f-ce6b-4c5d-a1a4-f6204e3e6cea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:25.280245 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64875bc6-ffcd-41ec-8f5f-6b6d2cc03af4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:25.294647 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:25.302781 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c0a6f-ce6b-4c5d-a1a4-f6204e3e6cea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:25.306034 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c0a6f-ce6b-4c5d-a1a4-f6204e3e6cea None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:25.325825 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c8ed6-b6d5-47bf-9117-d301bc2ce6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:25.327312 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c8ed6-b6d5-47bf-9117-d301bc2ce6b3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:25.327812 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c8ed6-b6d5-47bf-9117-d301bc2ce6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:25.328267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c8ed6-b6d5-47bf-9117-d301bc2ce6b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:25.329192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c8ed6-b6d5-47bf-9117-d301bc2ce6b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:25.329694 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c8ed6-b6d5-47bf-9117-d301bc2ce6b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:25.331424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c8ed6-b6d5-47bf-9117-d301bc2ce6b3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:25.339281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-060c0a6f-ce6b-4c5d-a1a4-f6204e3e6cea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:25.339281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:25.339281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:25.339281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:25.339281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:25.339281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:25.339281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:25.339281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:25.339281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:25.339281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:25.339281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:25.339281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:25.339281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:25.339281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:25.339281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:25.339281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:25.340327 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:25.340327 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:25.340327 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:25.340327 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:25.340327 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:25.340327 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:25.340327 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:25.340327 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:25.340327 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:25.340327 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:25.340327 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:25.340327 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:25.340327 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:25.340327 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:25.340327 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:25.340327 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:25.340327 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:25.341930 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:25.341930 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:25.341930 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:25.343753 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 379/746] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:25.346521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27683a9-15c6-4f8c-8af9-02b195a04ac5 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:25.347178 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27683a9-15c6-4f8c-8af9-02b195a04ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:25.347788 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27683a9-15c6-4f8c-8af9-02b195a04ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:25.355274 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 368/747] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:25.357112 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c8ed6-b6d5-47bf-9117-d301bc2ce6b3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:25.386026 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b27683a9-15c6-4f8c-8af9-02b195a04ac5 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:25.388879 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b27683a9-15c6-4f8c-8af9-02b195a04ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:25.516974 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 380/748] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:25.516974 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27683a9-15c6-4f8c-8af9-02b195a04ac5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:25.519628 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c8ed6-b6d5-47bf-9117-d301bc2ce6b3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:25.602499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603da2b-ac14-468e-9e3e-dde9248035f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:25.602499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603da2b-ac14-468e-9e3e-dde9248035f7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:25.602499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603da2b-ac14-468e-9e3e-dde9248035f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:25.602499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603da2b-ac14-468e-9e3e-dde9248035f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:25.602928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603da2b-ac14-468e-9e3e-dde9248035f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:25.602928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603da2b-ac14-468e-9e3e-dde9248035f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:25.602928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603da2b-ac14-468e-9e3e-dde9248035f7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:25.633061 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 369/749] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:25.641550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603da2b-ac14-468e-9e3e-dde9248035f7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:25.652893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:25.743439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27683a9-15c6-4f8c-8af9-02b195a04ac5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:25.788551 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:25.822077 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f5f54-5d84-45e4-8700-1fb1ee17968a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:25.822737 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f5f54-5d84-45e4-8700-1fb1ee17968a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:25.823011 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f5f54-5d84-45e4-8700-1fb1ee17968a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:25.823281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f5f54-5d84-45e4-8700-1fb1ee17968a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:25.838232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f5f54-5d84-45e4-8700-1fb1ee17968a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:25.839746 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f5f54-5d84-45e4-8700-1fb1ee17968a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:25.856844 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603da2b-ac14-468e-9e3e-dde9248035f7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:25.865253 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-330f5f54-5d84-45e4-8700-1fb1ee17968a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:25.865253 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:25.865253 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:25.865253 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:25.865253 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:25.865253 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:25.865253 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:25.865253 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:25.865253 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:25.865253 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:25.865253 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:25.865253 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:25.865253 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:25.865253 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:25.865253 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:25.866722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:25.866722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:25.866722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:25.866722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:25.866722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:25.866722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:25.866722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:25.866722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:25.866722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:25.866722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:25.866722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:25.866722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:25.866722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:25.866722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:25.866722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:25.866722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:25.866722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:25.868142 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:25.868142 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:25.868142 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:25.868142 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:25.868142 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:25.868142 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:25.868142 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:25.868142 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:25.871412 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 381/750] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:25.872988 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f5f54-5d84-45e4-8700-1fb1ee17968a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:25.937346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231c0a9-3f2d-4a0b-aa12-71b2f734f15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:25.938911 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231c0a9-3f2d-4a0b-aa12-71b2f734f15c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:25.939641 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231c0a9-3f2d-4a0b-aa12-71b2f734f15c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:25.940374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231c0a9-3f2d-4a0b-aa12-71b2f734f15c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:25.955998 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231c0a9-3f2d-4a0b-aa12-71b2f734f15c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:25.958082 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231c0a9-3f2d-4a0b-aa12-71b2f734f15c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:25.980206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-4231c0a9-3f2d-4a0b-aa12-71b2f734f15c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:25.980206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:25.980206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:25.980206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:25.980206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:25.980206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:25.980206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:25.980206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:25.980206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:25.980206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:25.980206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:25.980206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:25.980206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:25.980206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:25.980206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:25.982538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:25.982538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:25.982538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:25.982538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:25.982538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:25.982538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:25.982538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:25.982538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:25.982538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:25.982538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:25.982538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:25.982538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:25.982538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:25.982538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:25.982538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:25.982538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:25.982538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:25.984297 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:25.984297 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:25.984297 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:25.984297 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:25.984297 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:25.984297 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:25.984297 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:25.984297 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:25.984297 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 370/751] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:25.986656 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231c0a9-3f2d-4a0b-aa12-71b2f734f15c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:26.099109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f5f54-5d84-45e4-8700-1fb1ee17968a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:26.131206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:26.162063 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45c385-5647-4c65-bf36-00346da72ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:26.163086 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45c385-5647-4c65-bf36-00346da72ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:26.163557 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45c385-5647-4c65-bf36-00346da72ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:26.164029 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45c385-5647-4c65-bf36-00346da72ef0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:26.183710 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45c385-5647-4c65-bf36-00346da72ef0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:26.193770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-da45c385-5647-4c65-bf36-00346da72ef0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:26.193770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:26.193770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:26.193770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:26.193770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:26.193770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:26.193770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:26.193770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:26.193770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:26.193770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:26.193770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:26.193770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:26.193770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:26.193770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:26.193770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:26.193770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:26.195640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:26.195640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:26.195640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:26.195640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:26.195640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:26.195640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:26.195640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:26.195640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:26.195640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:26.195640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:26.195640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:26.195640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:26.195640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:26.195640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:26.195640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:26.195640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:26.197321 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:26.197321 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:26.197321 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:26.197321 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:26.197321 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:26.197321 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:26.197321 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:26.197321 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:26.197321 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:26.197321 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:26.197321 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:26.197321 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:26.204324 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 382/752] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:20:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:26.205917 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45c385-5647-4c65-bf36-00346da72ef0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:26.224586 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231c0a9-3f2d-4a0b-aa12-71b2f734f15c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:26.287514 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:26.311583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ced6a2-f494-4f51-80c8-8e7299a39ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:26.313415 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ced6a2-f494-4f51-80c8-8e7299a39ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:26.314172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ced6a2-f494-4f51-80c8-8e7299a39ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:26.315242 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ced6a2-f494-4f51-80c8-8e7299a39ef3 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:26.317480 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ced6a2-f494-4f51-80c8-8e7299a39ef3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:26.318639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ced6a2-f494-4f51-80c8-8e7299a39ef3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:26.323023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ced6a2-f494-4f51-80c8-8e7299a39ef3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:26.351332 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 371/753] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:26.353333 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ced6a2-f494-4f51-80c8-8e7299a39ef3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:26.410724 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45c385-5647-4c65-bf36-00346da72ef0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:26.477814 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3636f-94c8-46a9-8068-e837f632a55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:26.479463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3636f-94c8-46a9-8068-e837f632a55f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:26.480335 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3636f-94c8-46a9-8068-e837f632a55f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:26.481101 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3636f-94c8-46a9-8068-e837f632a55f None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:26.482696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3636f-94c8-46a9-8068-e837f632a55f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:26.483534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3636f-94c8-46a9-8068-e837f632a55f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:26.486675 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3636f-94c8-46a9-8068-e837f632a55f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:26.513366 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 383/754] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:26.515355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3636f-94c8-46a9-8068-e837f632a55f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:26.565955 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ced6a2-f494-4f51-80c8-8e7299a39ef3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:26.622653 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:26.645944 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f93d1b-ea80-4685-8b26-4b40af915006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:26.647059 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f93d1b-ea80-4685-8b26-4b40af915006 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:26.647561 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f93d1b-ea80-4685-8b26-4b40af915006 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:26.648024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f93d1b-ea80-4685-8b26-4b40af915006 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:26.649260 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f93d1b-ea80-4685-8b26-4b40af915006 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:26.649753 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f93d1b-ea80-4685-8b26-4b40af915006 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:26.652433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f93d1b-ea80-4685-8b26-4b40af915006 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:26.671169 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 372/755] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:20:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:26.678449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f93d1b-ea80-4685-8b26-4b40af915006 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:26.684731 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:26.689153 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3636f-94c8-46a9-8068-e837f632a55f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:26.734050 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ef6b4-de99-4491-92a1-cdd5afeb55dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:26.735076 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ef6b4-de99-4491-92a1-cdd5afeb55dc None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:26.735595 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ef6b4-de99-4491-92a1-cdd5afeb55dc None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:26.736075 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ef6b4-de99-4491-92a1-cdd5afeb55dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:26.737230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ef6b4-de99-4491-92a1-cdd5afeb55dc None admin] RBAC: Adding query filter params (role.id=a8896546a02c42489ef73c7ad7c43542, scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f, user.id=748e35d9a1534920860b2234d45f6724) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:26.737839 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ef6b4-de99-4491-92a1-cdd5afeb55dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:26.739589 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ef6b4-de99-4491-92a1-cdd5afeb55dc None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:26.748248 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 384/756] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:26 2022] GET /identity/v3/role_assignments?user.id=748e35d9a1534920860b2234d45f6724&scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f&role.id=a8896546a02c42489ef73c7ad7c43542 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:26.750346 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ef6b4-de99-4491-92a1-cdd5afeb55dc None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:26.886782 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ef6b4-de99-4491-92a1-cdd5afeb55dc None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:26.930419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f93d1b-ea80-4685-8b26-4b40af915006 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:26.936757 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410eae8-3be7-4b39-b4cd-d9bb8cb93af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:26.937873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410eae8-3be7-4b39-b4cd-d9bb8cb93af5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:26.938377 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410eae8-3be7-4b39-b4cd-d9bb8cb93af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:26.938924 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410eae8-3be7-4b39-b4cd-d9bb8cb93af5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:26.953693 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410eae8-3be7-4b39-b4cd-d9bb8cb93af5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:26.955630 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410eae8-3be7-4b39-b4cd-d9bb8cb93af5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:26.973944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-8410eae8-3be7-4b39-b4cd-d9bb8cb93af5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:26.973944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:26.973944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:26.973944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:26.973944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:26.973944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:26.973944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:26.973944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:26.973944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:26.973944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:26.973944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:26.973944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:26.973944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:26.973944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:26.973944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:26.973944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:26.974990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:26.974990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:26.974990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:26.974990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:26.974990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:26.974990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:26.974990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:26.974990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:26.974990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:26.974990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:26.974990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:26.974990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:26.974990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:26.974990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:26.974990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:26.974990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:26.974990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:26.975867 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:26.975867 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:26.975867 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:26.978100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 385/757] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:26.984745 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410eae8-3be7-4b39-b4cd-d9bb8cb93af5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:27.003033 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebc8c8-a559-472a-acf5-23644691be14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:27.004096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebc8c8-a559-472a-acf5-23644691be14 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:27.004775 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebc8c8-a559-472a-acf5-23644691be14 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:27.005214 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebc8c8-a559-472a-acf5-23644691be14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:27.006659 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebc8c8-a559-472a-acf5-23644691be14 None admin] RBAC: Adding query filter params (role.id=93abdb875d35417d91e420a60ccafbd2, scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f, user.id=3c001a902faf4b3c8d8f23f2e017c706) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:27.007253 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebc8c8-a559-472a-acf5-23644691be14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:27.010102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:27.011303 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebc8c8-a559-472a-acf5-23644691be14 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:27.031408 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 373/758] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:26 2022] GET /identity/v3/role_assignments?user.id=3c001a902faf4b3c8d8f23f2e017c706&scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f&role.id=93abdb875d35417d91e420a60ccafbd2 => generated 259 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:27.132074 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410eae8-3be7-4b39-b4cd-d9bb8cb93af5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:27.174495 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580d65c-f524-4ba4-8890-f8bcff6b6dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:27.175738 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580d65c-f524-4ba4-8890-f8bcff6b6dfd None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:27.176232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580d65c-f524-4ba4-8890-f8bcff6b6dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:27.176750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580d65c-f524-4ba4-8890-f8bcff6b6dfd None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:27.177654 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580d65c-f524-4ba4-8890-f8bcff6b6dfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:27.178180 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580d65c-f524-4ba4-8890-f8bcff6b6dfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:27.179934 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580d65c-f524-4ba4-8890-f8bcff6b6dfd None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:27.200813 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 386/759] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:27.204674 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebc8c8-a559-472a-acf5-23644691be14 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:27.329040 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:27.443620 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebc8c8-a559-472a-acf5-23644691be14 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:27.542575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accbb3f-80a6-4813-8430-fddcfb3ad083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:27.544225 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accbb3f-80a6-4813-8430-fddcfb3ad083 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:27.544719 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accbb3f-80a6-4813-8430-fddcfb3ad083 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:27.545207 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accbb3f-80a6-4813-8430-fddcfb3ad083 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:27.566757 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accbb3f-80a6-4813-8430-fddcfb3ad083 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:27.569758 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accbb3f-80a6-4813-8430-fddcfb3ad083 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:27.603588 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-0accbb3f-80a6-4813-8430-fddcfb3ad083 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:20:27.603588 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:27.603588 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:27.603588 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:27.603588 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:27.603588 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:27.603588 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:27.603588 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:27.603588 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:27.603588 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:27.603588 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:27.603588 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:27.603588 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:27.603588 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:27.603588 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:27.603588 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:27.604954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:27.604954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:27.604954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:27.604954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:27.604954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:27.604954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:27.604954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:27.604954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:27.604954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:27.604954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:27.604954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:27.604954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:27.604954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:27.604954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:27.604954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:27.604954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:27.604954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:27.604954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:27.606599 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:27.606599 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:27.606599 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:27.606599 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:27.606599 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:27.606599 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:27.606599 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:27.606599 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:27.606599 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:20:27.606599 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:27.606599 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 374/760] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Sep 1 16:20:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:27.614124 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580d65c-f524-4ba4-8890-f8bcff6b6dfd None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:27.698592 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ace75d-8ca6-4e87-af51-2f286b1c7245 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:27.698941 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ace75d-8ca6-4e87-af51-2f286b1c7245 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:27.699357 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ace75d-8ca6-4e87-af51-2f286b1c7245 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:27.702734 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 375/761] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:27.721381 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ec2af-d698-4044-83a7-f7711015d1e9 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:27.721912 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ec2af-d698-4044-83a7-f7711015d1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:27.722382 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ec2af-d698-4044-83a7-f7711015d1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:27.773272 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:27.790567 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1e4ec2af-d698-4044-83a7-f7711015d1e9 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:27.792573 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1e4ec2af-d698-4044-83a7-f7711015d1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:27.797380 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580d65c-f524-4ba4-8890-f8bcff6b6dfd None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:27.848196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8221fb-a930-45a6-a55f-23f25254db45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:27.849278 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8221fb-a930-45a6-a55f-23f25254db45 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:27.849761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8221fb-a930-45a6-a55f-23f25254db45 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:27.850204 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8221fb-a930-45a6-a55f-23f25254db45 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:27.851586 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8221fb-a930-45a6-a55f-23f25254db45 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:27.852126 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8221fb-a930-45a6-a55f-23f25254db45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:27.854941 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8221fb-a930-45a6-a55f-23f25254db45 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:27.925366 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 387/762] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Sep 1 16:20:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:27.931146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8221fb-a930-45a6-a55f-23f25254db45 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:27.996841 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 376/763] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:28.126767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4608f83-e47b-45cc-9070-d6b45371b301 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:28.127100 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4608f83-e47b-45cc-9070-d6b45371b301 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:28.127332 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4608f83-e47b-45cc-9070-d6b45371b301 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:28.128900 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 377/764] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:20:28.144888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900b854-d59a-4237-b956-dd41661bd835 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:28.145624 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900b854-d59a-4237-b956-dd41661bd835 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:28.146132 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900b854-d59a-4237-b956-dd41661bd835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:28.154195 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8221fb-a930-45a6-a55f-23f25254db45 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:28.182876 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8900b854-d59a-4237-b956-dd41661bd835 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:28.184118 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8900b854-d59a-4237-b956-dd41661bd835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:28.228877 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b94277-7a31-42a0-a189-6a5674a5b2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:28.229536 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b94277-7a31-42a0-a189-6a5674a5b2d3 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:28.229818 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b94277-7a31-42a0-a189-6a5674a5b2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:28.230096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b94277-7a31-42a0-a189-6a5674a5b2d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:28.233385 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:28.252824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b94277-7a31-42a0-a189-6a5674a5b2d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:28.254358 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b94277-7a31-42a0-a189-6a5674a5b2d3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:28.282774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-27b94277-7a31-42a0-a189-6a5674a5b2d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:28.282774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:28.282774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:28.282774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:28.282774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:28.282774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:28.282774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:28.282774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:28.282774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:28.282774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:28.282774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:28.282774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:28.282774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:28.282774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:28.282774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:28.282774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:28.283827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:28.283827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:28.283827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:28.283827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:28.283827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:28.283827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:28.283827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:28.283827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:28.283827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:28.283827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:28.283827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:28.283827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:28.283827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:28.283827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:28.283827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:28.283827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:28.283827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:28.284770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:28.284770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:28.284770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:28.287774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:28.288122 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 388/765] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:28.297748 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b94277-7a31-42a0-a189-6a5674a5b2d3 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:28.360590 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 378/766] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:28.363416 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900b854-d59a-4237-b956-dd41661bd835 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:28.485542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b94277-7a31-42a0-a189-6a5674a5b2d3 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:28.563693 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8ee80-b602-403d-b7df-e3e2d856c7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:28.564258 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8ee80-b602-403d-b7df-e3e2d856c7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:28.564611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8ee80-b602-403d-b7df-e3e2d856c7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:28.564916 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8ee80-b602-403d-b7df-e3e2d856c7a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:28.565602 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8ee80-b602-403d-b7df-e3e2d856c7a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:28.565907 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8ee80-b602-403d-b7df-e3e2d856c7a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:28.567332 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8ee80-b602-403d-b7df-e3e2d856c7a2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:28.581897 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900b854-d59a-4237-b956-dd41661bd835 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:28.596248 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 389/767] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:28.602169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8ee80-b602-403d-b7df-e3e2d856c7a2 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:28.662596 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:28.685104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a2bbd-922f-4a46-8161-05d62859af97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:28.686217 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a2bbd-922f-4a46-8161-05d62859af97 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:28.686677 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a2bbd-922f-4a46-8161-05d62859af97 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:28.687143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a2bbd-922f-4a46-8161-05d62859af97 None admin] PATH_INFO: `/v3/services/network` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:28.688138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a2bbd-922f-4a46-8161-05d62859af97 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:28.690793 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a2bbd-922f-4a46-8161-05d62859af97 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:28.721829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-826a2bbd-922f-4a46-8161-05d62859af97 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:20:28.721829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:28.721829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:28.721829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:28.721829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:28.721829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:28.721829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:28.721829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:28.721829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:20:28.721829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:28.721829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:28.721829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:28.721829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:28.721829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:28.721829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:28.721829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:28.721829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:28.723846 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:28.723846 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:28.723846 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:28.723846 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:28.723846 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:28.723846 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:28.723846 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:28.723846 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:28.723846 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:28.723846 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:28.723846 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:28.723846 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:28.723846 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:28.723846 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:28.723846 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:28.723846 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:28.725536 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:28.725536 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:28.725536 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:28.725536 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:28.725536 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:28.725536 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:28.725536 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:28.725536 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:28.725536 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:28.725536 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:28.725536 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:28.725536 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:28.725536 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:20:28.725536 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:28.725536 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 379/768] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:28 2022] GET /identity/v3/services/network => generated 88 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:28.727009 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a2bbd-922f-4a46-8161-05d62859af97 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:28.775815 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:28.807091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8ee80-b602-403d-b7df-e3e2d856c7a2 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:28.875815 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8128564-3527-4412-9e1b-c4424abdcbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:28.876811 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8128564-3527-4412-9e1b-c4424abdcbba None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:28.877287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8128564-3527-4412-9e1b-c4424abdcbba None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:28.877752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8128564-3527-4412-9e1b-c4424abdcbba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:28.891059 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8128564-3527-4412-9e1b-c4424abdcbba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:28.894107 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8128564-3527-4412-9e1b-c4424abdcbba None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:28.916653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-a8128564-3527-4412-9e1b-c4424abdcbba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:28.916653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:28.916653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:28.916653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:28.916653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:28.916653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:28.916653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:28.916653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:28.916653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:28.916653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:28.916653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:28.916653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:28.916653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:28.916653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:28.916653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:28.918383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:28.918383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:28.918383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:28.918383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:28.918383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:28.918383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:28.918383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:28.918383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:28.918383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:28.918383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:28.918383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:28.918383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:28.918383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:28.918383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:28.918383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:28.918383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:28.918383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:28.920153 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:28.920153 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:28.920153 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:28.920153 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:28.920153 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:28.920153 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:28.920153 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:28.920153 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:28.920153 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 390/769] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:28.921164 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8128564-3527-4412-9e1b-c4424abdcbba None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:28.938293 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a2bbd-922f-4a46-8161-05d62859af97 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:28.990401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96ecd1-6654-4955-897b-8692ba0c075f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:28.991059 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96ecd1-6654-4955-897b-8692ba0c075f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:28.991327 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96ecd1-6654-4955-897b-8692ba0c075f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:28.991660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96ecd1-6654-4955-897b-8692ba0c075f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:28.992291 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96ecd1-6654-4955-897b-8692ba0c075f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:28.993817 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96ecd1-6654-4955-897b-8692ba0c075f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:29.005406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-8d96ecd1-6654-4955-897b-8692ba0c075f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:20:29.005406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:29.005406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:29.005406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:29.005406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:29.005406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:29.005406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:29.005406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:29.005406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:20:29.005406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:29.005406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:29.005406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:29.005406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:29.005406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:29.005406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:29.005406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:29.005406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:29.009162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:29.009162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:29.009162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:29.009162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:29.009162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:29.009162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:29.009162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:29.009162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:29.009162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:29.009162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:29.009162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:29.009162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:29.009162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:29.009162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:29.009162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:29.009162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:29.012963 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:29.012963 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:29.012963 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:29.012963 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:29.012963 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:29.012963 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:29.012963 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:29.012963 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:29.012963 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:29.012963 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:29.012963 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:29.012963 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:29.012963 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:20:29.012963 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:29.012963 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 380/770] 10.222.0.52 () {56 vars in 1129 bytes} [Thu Sep 1 16:20:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:29.023978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96ecd1-6654-4955-897b-8692ba0c075f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:29.151097 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8128564-3527-4412-9e1b-c4424abdcbba None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:29.161891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:29.200475 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51788ac0-af7e-4bf1-b05b-8632c48e667c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:29.201551 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51788ac0-af7e-4bf1-b05b-8632c48e667c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:29.202024 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51788ac0-af7e-4bf1-b05b-8632c48e667c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:29.202499 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51788ac0-af7e-4bf1-b05b-8632c48e667c None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:29.203419 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51788ac0-af7e-4bf1-b05b-8632c48e667c None admin] RBAC: Adding query filter params (name=network) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:29.203915 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51788ac0-af7e-4bf1-b05b-8632c48e667c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:29.205555 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51788ac0-af7e-4bf1-b05b-8632c48e667c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:29.216890 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 391/771] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Sep 1 16:20:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:29.218183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51788ac0-af7e-4bf1-b05b-8632c48e667c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:29.224996 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:29.234085 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96ecd1-6654-4955-897b-8692ba0c075f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:29.337930 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d8441-f9bc-4938-a9fb-f2064eb22739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:29.339407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d8441-f9bc-4938-a9fb-f2064eb22739 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:29.339927 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d8441-f9bc-4938-a9fb-f2064eb22739 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:29.340492 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d8441-f9bc-4938-a9fb-f2064eb22739 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:29.343862 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d8441-f9bc-4938-a9fb-f2064eb22739 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:29.344443 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d8441-f9bc-4938-a9fb-f2064eb22739 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:29.348552 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d8441-f9bc-4938-a9fb-f2064eb22739 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:29.374871 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 381/772] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:29.376282 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d8441-f9bc-4938-a9fb-f2064eb22739 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:29.380165 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51788ac0-af7e-4bf1-b05b-8632c48e667c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:29.444674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe55c1-7d4b-48fa-b5d2-39e6ab9779e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:29.445751 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe55c1-7d4b-48fa-b5d2-39e6ab9779e4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:29.446349 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe55c1-7d4b-48fa-b5d2-39e6ab9779e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:29.446902 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe55c1-7d4b-48fa-b5d2-39e6ab9779e4 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:29.447785 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe55c1-7d4b-48fa-b5d2-39e6ab9779e4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:29.448399 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe55c1-7d4b-48fa-b5d2-39e6ab9779e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:29.450648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe55c1-7d4b-48fa-b5d2-39e6ab9779e4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:29.461171 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 392/773] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Sep 1 16:20:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:29.462542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe55c1-7d4b-48fa-b5d2-39e6ab9779e4 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:29.541170 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d8441-f9bc-4938-a9fb-f2064eb22739 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:29.542269 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:29.592658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31416194-3c2c-47dd-b85d-676ab3eb98ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:29.593501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31416194-3c2c-47dd-b85d-676ab3eb98ec None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:29.593911 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31416194-3c2c-47dd-b85d-676ab3eb98ec None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:29.594328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31416194-3c2c-47dd-b85d-676ab3eb98ec None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:29.595101 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31416194-3c2c-47dd-b85d-676ab3eb98ec None admin] RBAC: Adding query filter params (type=network) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:29.595509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31416194-3c2c-47dd-b85d-676ab3eb98ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:29.597108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31416194-3c2c-47dd-b85d-676ab3eb98ec None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:29.603803 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 382/774] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Sep 1 16:20:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:29.610404 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31416194-3c2c-47dd-b85d-676ab3eb98ec None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:29.657989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:29.729681 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe55c1-7d4b-48fa-b5d2-39e6ab9779e4 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:29.773750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87a17f-5f19-4664-863c-4cbfa9390ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:29.774627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87a17f-5f19-4664-863c-4cbfa9390ef1 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:29.775050 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87a17f-5f19-4664-863c-4cbfa9390ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:29.775378 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87a17f-5f19-4664-863c-4cbfa9390ef1 None admin] PATH_INFO: `/v3/projects/43f5c22e38824a8b8dff2f9b4bc1df3f/users/55f389ab3ea046008b44f129113de995/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:29.777581 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87a17f-5f19-4664-863c-4cbfa9390ef1 None admin] RBAC: Authorizing `identity:create_grant(project_id=43f5c22e38824a8b8dff2f9b4bc1df3f, user_id=55f389ab3ea046008b44f129113de995, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:29.779925 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87a17f-5f19-4664-863c-4cbfa9390ef1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:29.793402 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31416194-3c2c-47dd-b85d-676ab3eb98ec None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:29.798037 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 393/775] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 1 16:20:29 2022] PUT /identity/v3/projects/43f5c22e38824a8b8dff2f9b4bc1df3f/users/55f389ab3ea046008b44f129113de995/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:20:29.798701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87a17f-5f19-4664-863c-4cbfa9390ef1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:29.866684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580c544-03c9-4b6f-ab0a-823d9a4e4e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:29.868339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580c544-03c9-4b6f-ab0a-823d9a4e4e87 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:29.869255 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580c544-03c9-4b6f-ab0a-823d9a4e4e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:29.870278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580c544-03c9-4b6f-ab0a-823d9a4e4e87 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:29.872029 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580c544-03c9-4b6f-ab0a-823d9a4e4e87 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:29.872979 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580c544-03c9-4b6f-ab0a-823d9a4e4e87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:29.876603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580c544-03c9-4b6f-ab0a-823d9a4e4e87 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:29.892774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 383/776] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Sep 1 16:20:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:29.895773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832d99c-08d0-4b9a-a139-9e3bfad1734b None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:29.896731 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832d99c-08d0-4b9a-a139-9e3bfad1734b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:29.898008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832d99c-08d0-4b9a-a139-9e3bfad1734b None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:29.901912 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 384/777] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:29.904861 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832d99c-08d0-4b9a-a139-9e3bfad1734b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:29.927443 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:29.938763 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87a17f-5f19-4664-863c-4cbfa9390ef1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:30.017006 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507761a-922f-4291-8b31-16fed4fe71f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:30.017920 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507761a-922f-4291-8b31-16fed4fe71f5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:30.018401 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507761a-922f-4291-8b31-16fed4fe71f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:30.018821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507761a-922f-4291-8b31-16fed4fe71f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:30.020038 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507761a-922f-4291-8b31-16fed4fe71f5 None admin] RBAC: Adding query filter params (interface=public, service_id=0e357a9ed3394935a0e9d69944fb79ac, region_id=RegionOne) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:30.020548 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507761a-922f-4291-8b31-16fed4fe71f5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:30.022989 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507761a-922f-4291-8b31-16fed4fe71f5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:30.037244 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 394/778] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Sep 1 16:20:29 2022] GET /identity/v3/endpoints?service_id=0e357a9ed3394935a0e9d69944fb79ac&interface=public®ion_id=RegionOne => generated 194 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:30.040064 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeff0b3-693b-4a34-8f6c-369da9b6fee9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:30.040064 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeff0b3-693b-4a34-8f6c-369da9b6fee9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:30.040428 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeff0b3-693b-4a34-8f6c-369da9b6fee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:30.070732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-0eeff0b3-693b-4a34-8f6c-369da9b6fee9 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:30.072096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0eeff0b3-693b-4a34-8f6c-369da9b6fee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:30.104123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:30.126068 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832d99c-08d0-4b9a-a139-9e3bfad1734b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:30.160190 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 395/779] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:30.165837 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeff0b3-693b-4a34-8f6c-369da9b6fee9 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:30.180062 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b594ab0-8350-4631-a6ef-168fbe48e7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:30.181082 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b594ab0-8350-4631-a6ef-168fbe48e7c2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:30.181544 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b594ab0-8350-4631-a6ef-168fbe48e7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:30.181990 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b594ab0-8350-4631-a6ef-168fbe48e7c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:30.183038 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b594ab0-8350-4631-a6ef-168fbe48e7c2 None admin] RBAC: Adding query filter params (interface=public, service_id=1599eb85c36c46e9b2c065dca5cf3c4c, region_id=RegionOne) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:30.183569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b594ab0-8350-4631-a6ef-168fbe48e7c2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:30.186698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b594ab0-8350-4631-a6ef-168fbe48e7c2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:30.197132 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 385/780] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Sep 1 16:20:29 2022] GET /identity/v3/endpoints?service_id=1599eb85c36c46e9b2c065dca5cf3c4c&interface=public®ion_id=RegionOne => generated 194 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:30.203769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b594ab0-8350-4631-a6ef-168fbe48e7c2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:30.382654 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:30.408884 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b594ab0-8350-4631-a6ef-168fbe48e7c2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:30.411343 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeff0b3-693b-4a34-8f6c-369da9b6fee9 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:30.465079 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ff672-cb2e-42f8-ac35-aba754c78f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:30.466326 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ff672-cb2e-42f8-ac35-aba754c78f59 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:30.466607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ff672-cb2e-42f8-ac35-aba754c78f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:30.466883 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ff672-cb2e-42f8-ac35-aba754c78f59 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:30.467525 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ff672-cb2e-42f8-ac35-aba754c78f59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:30.469117 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ff672-cb2e-42f8-ac35-aba754c78f59 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:30.475586 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 396/781] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Sep 1 16:20:30 2022] GET /identity/v3/services => generated 772 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:30.502879 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffd5f8-0f6e-41ed-9264-6aa7b908cf2a None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:30.503221 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffd5f8-0f6e-41ed-9264-6aa7b908cf2a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:30.503450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffd5f8-0f6e-41ed-9264-6aa7b908cf2a None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:30.505386 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 397/782] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:30.511569 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90c6a9-7a4b-499e-b680-163127c51162 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:30.511877 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90c6a9-7a4b-499e-b680-163127c51162 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:30.512058 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90c6a9-7a4b-499e-b680-163127c51162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:30.516135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86974e-4ef9-4b22-ba77-2d0078a37765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:30.517821 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86974e-4ef9-4b22-ba77-2d0078a37765 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:30.517821 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86974e-4ef9-4b22-ba77-2d0078a37765 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:30.517821 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86974e-4ef9-4b22-ba77-2d0078a37765 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:30.518088 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86974e-4ef9-4b22-ba77-2d0078a37765 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:30.520899 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86974e-4ef9-4b22-ba77-2d0078a37765 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:30.526469 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 386/783] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Sep 1 16:20:30 2022] GET /identity/v3/services => generated 772 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:30.528432 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86974e-4ef9-4b22-ba77-2d0078a37765 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:30.553392 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-7f90c6a9-7a4b-499e-b680-163127c51162 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:30.555167 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7f90c6a9-7a4b-499e-b680-163127c51162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:30.581155 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:30.704813 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 398/784] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:20:30.788354 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86974e-4ef9-4b22-ba77-2d0078a37765 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:30.862782 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8da993-d938-4060-a730-b121bcfdae53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:30.863504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8da993-d938-4060-a730-b121bcfdae53 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:30.864010 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8da993-d938-4060-a730-b121bcfdae53 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:30.864318 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8da993-d938-4060-a730-b121bcfdae53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:30.886315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8da993-d938-4060-a730-b121bcfdae53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:30.896928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-8b8da993-d938-4060-a730-b121bcfdae53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:30.896928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:30.896928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:30.896928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:30.896928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:30.896928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:30.896928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:30.896928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:30.896928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:30.896928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:30.896928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:30.896928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:30.896928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:30.896928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:30.896928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:30.896928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:30.897935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:30.897935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:30.897935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:30.897935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:30.897935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:30.897935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:30.897935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:30.897935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:30.897935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:30.897935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:30.897935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:30.897935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:30.897935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:30.897935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:30.897935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:30.897935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:30.898845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:30.898845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:30.898845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:30.898845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:30.898845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:30.898845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:30.898845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:30.898845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:30.898845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:30.898845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:30.898845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:30.898845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:30.900013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 387/785] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:20:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:30.909852 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90c6a9-7a4b-499e-b680-163127c51162 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:31.058378 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:31.105255 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90c6a9-7a4b-499e-b680-163127c51162 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:31.159519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2583f69-ac76-4cba-aa4b-61c5174f4c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:31.160143 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2583f69-ac76-4cba-aa4b-61c5174f4c3e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:31.160425 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2583f69-ac76-4cba-aa4b-61c5174f4c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:31.160719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2583f69-ac76-4cba-aa4b-61c5174f4c3e None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:31.161407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2583f69-ac76-4cba-aa4b-61c5174f4c3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:31.161710 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2583f69-ac76-4cba-aa4b-61c5174f4c3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:31.163130 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2583f69-ac76-4cba-aa4b-61c5174f4c3e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:31.171625 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8da993-d938-4060-a730-b121bcfdae53 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:31.179466 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 399/786] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:20:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:31.187023 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2583f69-ac76-4cba-aa4b-61c5174f4c3e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:31.355611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2583f69-ac76-4cba-aa4b-61c5174f4c3e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:31.401484 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc00d4-6b18-4d72-a889-ff3ea04b96bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:31.402522 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc00d4-6b18-4d72-a889-ff3ea04b96bd None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:31.403934 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc00d4-6b18-4d72-a889-ff3ea04b96bd None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:31.404471 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc00d4-6b18-4d72-a889-ff3ea04b96bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:31.419043 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc00d4-6b18-4d72-a889-ff3ea04b96bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:31.421036 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc00d4-6b18-4d72-a889-ff3ea04b96bd None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:31.423791 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:31.433408 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:31.441600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-1efc00d4-6b18-4d72-a889-ff3ea04b96bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:31.441600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:31.441600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:31.441600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:31.441600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:31.441600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:31.441600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:31.441600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:31.441600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:31.441600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:31.441600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:31.441600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:31.441600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:31.441600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:31.441600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:31.441600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:31.442950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:31.442950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:31.442950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:31.442950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:31.442950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:31.442950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:31.442950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:31.442950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:31.442950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:31.442950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:31.442950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:31.442950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:31.442950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:31.442950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:31.442950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:31.442950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:31.442950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:31.443878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:31.443878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:31.443878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:31.444820 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 400/787] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:31.452371 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc00d4-6b18-4d72-a889-ff3ea04b96bd None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:31.494814 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8da993-d938-4060-a730-b121bcfdae53 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:31.601347 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b1b30-49ce-43f1-bdb6-be9807eef5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:31.602541 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b1b30-49ce-43f1-bdb6-be9807eef5a7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:31.604433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b1b30-49ce-43f1-bdb6-be9807eef5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:31.605227 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b1b30-49ce-43f1-bdb6-be9807eef5a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:31.634500 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b1b30-49ce-43f1-bdb6-be9807eef5a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:31.641766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-9b4b1b30-49ce-43f1-bdb6-be9807eef5a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:31.641766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:31.641766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:31.641766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:31.641766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:31.641766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:31.641766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:31.641766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:31.641766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:31.641766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:31.641766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:31.641766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:31.641766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:31.641766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:31.641766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:31.641766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:31.642789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:31.642789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:31.642789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:31.642789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:31.642789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:31.642789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:31.642789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:31.642789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:31.642789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:31.642789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:31.642789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:31.642789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:31.642789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:31.642789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:31.642789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:31.642789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:31.643622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:31.643622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:31.643622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:31.643622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:31.643622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:31.643622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:31.643622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:31.643622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:31.643622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:31.643622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:31.643622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:31.643622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:31.649425 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 388/788] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 1 16:20:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 478 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:31.657011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b1b30-49ce-43f1-bdb6-be9807eef5a7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:31.673758 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc00d4-6b18-4d72-a889-ff3ea04b96bd None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:31.757351 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45ad5d-7ed4-4ce3-abee-a79691b065c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:31.758027 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45ad5d-7ed4-4ce3-abee-a79691b065c2 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:31.758312 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45ad5d-7ed4-4ce3-abee-a79691b065c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:31.758586 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45ad5d-7ed4-4ce3-abee-a79691b065c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:31.759251 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45ad5d-7ed4-4ce3-abee-a79691b065c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:31.759555 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45ad5d-7ed4-4ce3-abee-a79691b065c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:31.761171 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45ad5d-7ed4-4ce3-abee-a79691b065c2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:31.785356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 401/789] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:31.791612 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45ad5d-7ed4-4ce3-abee-a79691b065c2 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:31.914961 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b1b30-49ce-43f1-bdb6-be9807eef5a7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:31.929381 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:31.986302 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba1bf1-41ed-4d32-9ccc-b77f20cc4807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:31.987435 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba1bf1-41ed-4d32-9ccc-b77f20cc4807 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:31.987942 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba1bf1-41ed-4d32-9ccc-b77f20cc4807 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:31.988434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba1bf1-41ed-4d32-9ccc-b77f20cc4807 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:31.989353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba1bf1-41ed-4d32-9ccc-b77f20cc4807 None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:31.989871 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba1bf1-41ed-4d32-9ccc-b77f20cc4807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:31.991553 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba1bf1-41ed-4d32-9ccc-b77f20cc4807 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:31.999633 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45ad5d-7ed4-4ce3-abee-a79691b065c2 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:32.002126 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:32.017126 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 389/790] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 1 16:20:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:32.024365 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba1bf1-41ed-4d32-9ccc-b77f20cc4807 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:32.051974 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132d790-0688-4549-a789-dd1f3b4370b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:32.052660 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132d790-0688-4549-a789-dd1f3b4370b3 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:32.052952 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132d790-0688-4549-a789-dd1f3b4370b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:32.053224 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132d790-0688-4549-a789-dd1f3b4370b3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:32.069016 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132d790-0688-4549-a789-dd1f3b4370b3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:32.071370 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132d790-0688-4549-a789-dd1f3b4370b3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:32.100290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-4132d790-0688-4549-a789-dd1f3b4370b3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:20:32.100290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:32.100290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:32.100290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:32.100290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:32.100290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:32.100290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:32.100290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:32.100290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:32.100290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:32.100290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:32.100290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:32.100290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:32.100290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:32.100290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:32.100290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:32.101493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:32.101493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:32.101493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:32.101493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:32.101493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:32.101493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:32.101493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:32.101493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:32.101493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:32.101493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:32.101493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:32.101493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:32.101493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:32.101493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:32.101493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:32.101493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:32.101493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:32.101493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:32.102441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:32.102441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:32.102441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:32.102441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:32.102441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:32.102441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:32.102441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:32.102441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:32.102441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:20:32.102441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:32.102441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 402/791] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:20:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:32.108138 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132d790-0688-4549-a789-dd1f3b4370b3 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:32.279454 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba1bf1-41ed-4d32-9ccc-b77f20cc4807 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:32.299997 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132d790-0688-4549-a789-dd1f3b4370b3 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:32.339876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:32.370783 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad8013-757e-4a51-87f7-06e630293922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:32.372422 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad8013-757e-4a51-87f7-06e630293922 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:32.372964 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad8013-757e-4a51-87f7-06e630293922 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:32.373437 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad8013-757e-4a51-87f7-06e630293922 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:32.384975 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96779f39-7e22-4e29-ad8b-16b14d5b9233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:32.385980 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96779f39-7e22-4e29-ad8b-16b14d5b9233 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:32.386433 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96779f39-7e22-4e29-ad8b-16b14d5b9233 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:32.387125 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96779f39-7e22-4e29-ad8b-16b14d5b9233 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:32.388642 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96779f39-7e22-4e29-ad8b-16b14d5b9233 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:32.389763 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96779f39-7e22-4e29-ad8b-16b14d5b9233 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:32.392720 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96779f39-7e22-4e29-ad8b-16b14d5b9233 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:32.398620 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad8013-757e-4a51-87f7-06e630293922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:32.401551 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad8013-757e-4a51-87f7-06e630293922 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:32.449278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-51ad8013-757e-4a51-87f7-06e630293922 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:32.449278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:32.449278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:32.449278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:32.449278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:32.449278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:32.449278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:32.449278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:32.449278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:32.449278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:32.449278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:32.449278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:32.449278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:32.449278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:32.449278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:32.449278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:32.450868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:32.450868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:32.450868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:32.450868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:32.450868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:32.450868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:32.450868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:32.450868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:32.450868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:32.450868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:32.450868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:32.450868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:32.450868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:32.450868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:32.450868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:32.450868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:32.450868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:32.451739 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:32.451739 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:32.451739 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:32.453730 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 390/792] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:32.458397 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad8013-757e-4a51-87f7-06e630293922 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:32.463576 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 403/793] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Sep 1 16:20:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:32.470393 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96779f39-7e22-4e29-ad8b-16b14d5b9233 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:32.580746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:32.683342 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad8013-757e-4a51-87f7-06e630293922 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:32.741855 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96779f39-7e22-4e29-ad8b-16b14d5b9233 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:32.797261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b772e-dd50-4507-a05a-d5e1bd0f8877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:32.798995 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b772e-dd50-4507-a05a-d5e1bd0f8877 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:32.799676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b772e-dd50-4507-a05a-d5e1bd0f8877 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:32.800163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b772e-dd50-4507-a05a-d5e1bd0f8877 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:32.801369 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b772e-dd50-4507-a05a-d5e1bd0f8877 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:32.801894 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b772e-dd50-4507-a05a-d5e1bd0f8877 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:32.804542 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b772e-dd50-4507-a05a-d5e1bd0f8877 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:32.831770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 391/794] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:32.835363 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff63d9-ed1d-4a20-b91b-a61a6f17c0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:32.836052 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff63d9-ed1d-4a20-b91b-a61a6f17c0ac None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:32.836336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff63d9-ed1d-4a20-b91b-a61a6f17c0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:32.836655 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff63d9-ed1d-4a20-b91b-a61a6f17c0ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:32.843211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b772e-dd50-4507-a05a-d5e1bd0f8877 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:32.874233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff63d9-ed1d-4a20-b91b-a61a6f17c0ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:32.875696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff63d9-ed1d-4a20-b91b-a61a6f17c0ac None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:32.910124 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-c2ff63d9-ed1d-4a20-b91b-a61a6f17c0ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:32.910124 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:32.910124 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:32.910124 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:32.910124 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:32.910124 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:32.910124 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:32.910124 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:32.910124 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:32.910124 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:32.910124 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:32.910124 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:32.910124 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:32.910124 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:32.910124 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:32.910124 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:32.911999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:32.911999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:32.911999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:32.911999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:32.911999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:32.911999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:32.911999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:32.911999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:32.911999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:32.911999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:32.911999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:32.911999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:32.911999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:32.911999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:32.911999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:32.911999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:32.911999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:32.913826 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:32.913826 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:32.913826 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:32.913826 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 404/795] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 442 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:32.918852 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff63d9-ed1d-4a20-b91b-a61a6f17c0ac None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:33.006900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:33.068860 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b772e-dd50-4507-a05a-d5e1bd0f8877 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:33.101958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:33.166805 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862fea0-ec8c-48e5-9f8d-227d0d751d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:33.168436 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862fea0-ec8c-48e5-9f8d-227d0d751d23 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:33.169217 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862fea0-ec8c-48e5-9f8d-227d0d751d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:33.169961 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862fea0-ec8c-48e5-9f8d-227d0d751d23 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:33.198758 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862fea0-ec8c-48e5-9f8d-227d0d751d23 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:33.202504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862fea0-ec8c-48e5-9f8d-227d0d751d23 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:33.227383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff63d9-ed1d-4a20-b91b-a61a6f17c0ac None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:33.242721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-3862fea0-ec8c-48e5-9f8d-227d0d751d23 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:20:33.242721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:33.242721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:33.242721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:33.242721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:33.242721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:33.242721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:33.242721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:33.242721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:33.242721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:33.242721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:33.242721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:33.242721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:33.242721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:33.242721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:33.242721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:33.244533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:33.244533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:33.244533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:33.244533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:33.244533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:33.244533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:33.244533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:33.244533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:33.244533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:33.244533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:33.244533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:33.244533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:33.244533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:33.244533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:33.244533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:33.244533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:33.244533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:33.244533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:33.247579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:33.247579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:33.247579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:33.247579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:33.247579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:33.247579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:33.247579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:33.247579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:33.247579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:20:33.247579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:33.247579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 392/796] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Sep 1 16:20:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:33.249699 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee961ba-cba5-4bcc-8211-b5f894399eb3 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:33.249699 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee961ba-cba5-4bcc-8211-b5f894399eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:33.249699 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee961ba-cba5-4bcc-8211-b5f894399eb3 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:33.258649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 393/797] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:33.260265 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee961ba-cba5-4bcc-8211-b5f894399eb3 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:33.299886 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f89050-0b9c-4bda-b3d6-d21d6be0b63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:33.300942 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f89050-0b9c-4bda-b3d6-d21d6be0b63a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:33.301350 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f89050-0b9c-4bda-b3d6-d21d6be0b63a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:33.301808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f89050-0b9c-4bda-b3d6-d21d6be0b63a None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:33.303067 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f89050-0b9c-4bda-b3d6-d21d6be0b63a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:33.303600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f89050-0b9c-4bda-b3d6-d21d6be0b63a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:33.306468 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f89050-0b9c-4bda-b3d6-d21d6be0b63a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:33.332802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 405/798] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:33.335465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7036caf-c6cd-43c7-bfb9-1943d0cacf14 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:33.335964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7036caf-c6cd-43c7-bfb9-1943d0cacf14 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:33.336414 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7036caf-c6cd-43c7-bfb9-1943d0cacf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:33.371899 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e7036caf-c6cd-43c7-bfb9-1943d0cacf14 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:33.374418 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e7036caf-c6cd-43c7-bfb9-1943d0cacf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:33.477496 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee961ba-cba5-4bcc-8211-b5f894399eb3 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:33.521227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 406/799] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:33.522764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7036caf-c6cd-43c7-bfb9-1943d0cacf14 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:33.560108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:33.585989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117809a9-69cb-4389-841e-8b4fe928433c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:33.586987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117809a9-69cb-4389-841e-8b4fe928433c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:33.587441 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117809a9-69cb-4389-841e-8b4fe928433c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:33.587898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117809a9-69cb-4389-841e-8b4fe928433c None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:33.589282 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117809a9-69cb-4389-841e-8b4fe928433c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:33.589782 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117809a9-69cb-4389-841e-8b4fe928433c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:33.593172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117809a9-69cb-4389-841e-8b4fe928433c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:33.665202 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 394/800] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Sep 1 16:20:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:33.666314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2597db-b00e-4c8a-9713-183621b833a9 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:33.666606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2597db-b00e-4c8a-9713-183621b833a9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:33.666885 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2597db-b00e-4c8a-9713-183621b833a9 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:33.673501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 395/801] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:33.674469 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2597db-b00e-4c8a-9713-183621b833a9 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:33.730724 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7036caf-c6cd-43c7-bfb9-1943d0cacf14 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:33.739339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:33.790744 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad5f06-6eaf-41bb-bf5e-64edaa70cefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:33.791390 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad5f06-6eaf-41bb-bf5e-64edaa70cefd None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:33.791664 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad5f06-6eaf-41bb-bf5e-64edaa70cefd None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:33.791933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad5f06-6eaf-41bb-bf5e-64edaa70cefd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:33.800483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad5f06-6eaf-41bb-bf5e-64edaa70cefd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:33.801535 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad5f06-6eaf-41bb-bf5e-64edaa70cefd None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:33.814182 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-10ad5f06-6eaf-41bb-bf5e-64edaa70cefd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:33.814182 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:33.814182 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:33.814182 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:33.814182 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:33.814182 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:33.814182 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:33.814182 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:33.814182 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:33.814182 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:33.814182 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:33.814182 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:33.814182 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:33.814182 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:33.814182 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:33.816136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:33.816136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:33.816136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:33.816136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:33.816136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:33.816136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:33.816136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:33.816136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:33.816136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:33.816136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:33.816136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:33.816136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:33.816136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:33.816136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:33.816136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:33.816136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:33.816136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:33.818156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:33.818156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:33.818156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:33.818156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:33.818156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:33.818156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:33.818156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:33.818156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:33.820261 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 407/802] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:33.821697 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d35b5-da7f-4b6c-8d72-7321834654e5 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:33.821985 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d35b5-da7f-4b6c-8d72-7321834654e5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:33.822272 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d35b5-da7f-4b6c-8d72-7321834654e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:33.843368 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e46d35b5-da7f-4b6c-8d72-7321834654e5 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:33.845538 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e46d35b5-da7f-4b6c-8d72-7321834654e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:33.881840 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2597db-b00e-4c8a-9713-183621b833a9 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:33.924142 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da882db-c0a3-4c9a-9e33-43490a59515f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:33.924739 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da882db-c0a3-4c9a-9e33-43490a59515f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:33.925020 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da882db-c0a3-4c9a-9e33-43490a59515f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:33.925293 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da882db-c0a3-4c9a-9e33-43490a59515f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:33.937845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da882db-c0a3-4c9a-9e33-43490a59515f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:33.939418 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da882db-c0a3-4c9a-9e33-43490a59515f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:33.958629 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-0da882db-c0a3-4c9a-9e33-43490a59515f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:33.958629 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:33.958629 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:33.958629 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:33.958629 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:33.958629 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:33.958629 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:33.958629 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:33.958629 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:33.958629 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:33.958629 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:33.958629 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:33.958629 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:33.958629 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:33.958629 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:33.958629 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:33.967083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:33.967083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:33.967083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:33.967083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:33.967083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:33.967083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:33.967083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:33.967083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:33.967083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:33.967083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:33.967083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:33.967083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:33.967083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:33.967083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:33.967083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:33.967083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:33.967083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:33.968882 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:33.968882 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:33.968882 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:33.968882 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 396/803] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:33.968882 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92439784-40b0-4c27-a4be-3fba9cfbb6db None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:33.968882 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92439784-40b0-4c27-a4be-3fba9cfbb6db None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:33.968882 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92439784-40b0-4c27-a4be-3fba9cfbb6db None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:33.968882 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 397/804] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:33.968882 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92439784-40b0-4c27-a4be-3fba9cfbb6db None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:33.974547 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 408/805] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:33.975967 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d35b5-da7f-4b6c-8d72-7321834654e5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:33.990944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:34.145997 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:34.182491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92439784-40b0-4c27-a4be-3fba9cfbb6db None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:34.191903 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d35b5-da7f-4b6c-8d72-7321834654e5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:34.228864 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf1770-c9f2-4b28-afa2-91c92f41f6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:34.229487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf1770-c9f2-4b28-afa2-91c92f41f6cf None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:34.229771 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf1770-c9f2-4b28-afa2-91c92f41f6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:34.230032 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf1770-c9f2-4b28-afa2-91c92f41f6cf None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:34.230801 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf1770-c9f2-4b28-afa2-91c92f41f6cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:34.231106 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf1770-c9f2-4b28-afa2-91c92f41f6cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:34.232675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf1770-c9f2-4b28-afa2-91c92f41f6cf None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:34.253394 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 398/806] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:34.254898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3fc8c-82ba-4b09-a3e1-be79cfecdfaa None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:34.255187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3fc8c-82ba-4b09-a3e1-be79cfecdfaa None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:34.255471 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3fc8c-82ba-4b09-a3e1-be79cfecdfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:34.264538 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ea615-bec8-48b2-be97-8805c9e78422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:34.266771 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ea615-bec8-48b2-be97-8805c9e78422 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:34.267263 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ea615-bec8-48b2-be97-8805c9e78422 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:34.267754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ea615-bec8-48b2-be97-8805c9e78422 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:34.269024 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ea615-bec8-48b2-be97-8805c9e78422 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:34.269574 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ea615-bec8-48b2-be97-8805c9e78422 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:34.272249 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ea615-bec8-48b2-be97-8805c9e78422 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:34.278402 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-94c3fc8c-82ba-4b09-a3e1-be79cfecdfaa None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:34.279693 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-94c3fc8c-82ba-4b09-a3e1-be79cfecdfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:34.297085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 409/807] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:34.297928 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ea615-bec8-48b2-be97-8805c9e78422 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:34.363570 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 399/808] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:34.364427 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3fc8c-82ba-4b09-a3e1-be79cfecdfaa None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:34.424951 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:34.461571 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:34.480127 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ea615-bec8-48b2-be97-8805c9e78422 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:34.503759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3fc8c-82ba-4b09-a3e1-be79cfecdfaa None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:34.528216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02087c-24ef-4c56-8bda-f3a8c02b4745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:34.528913 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02087c-24ef-4c56-8bda-f3a8c02b4745 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:34.529246 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02087c-24ef-4c56-8bda-f3a8c02b4745 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:34.529522 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02087c-24ef-4c56-8bda-f3a8c02b4745 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:34.541471 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02087c-24ef-4c56-8bda-f3a8c02b4745 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:34.547708 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-1b02087c-24ef-4c56-8bda-f3a8c02b4745 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:34.547708 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:34.547708 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:34.547708 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:34.547708 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:34.547708 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:34.547708 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:34.547708 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:34.547708 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:34.547708 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:34.547708 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:34.547708 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:34.547708 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:34.547708 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:34.547708 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:34.547708 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:34.548712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:34.548712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:34.548712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:34.548712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:34.548712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:34.548712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:34.548712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:34.548712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:34.548712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:34.548712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:34.548712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:34.548712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:34.548712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:34.548712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:34.548712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:34.548712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:34.549560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:34.549560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:34.549560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:34.549560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:34.549560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:34.549560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:34.549560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:34.549560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:34.549560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:34.549560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:34.549560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:34.549560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:34.549560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 410/809] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:20:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:34.550248 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02087c-24ef-4c56-8bda-f3a8c02b4745 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:34.565549 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f39f3d-34c9-41e3-a84e-713618b085a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:34.566623 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f39f3d-34c9-41e3-a84e-713618b085a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:34.567001 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f39f3d-34c9-41e3-a84e-713618b085a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:34.567423 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f39f3d-34c9-41e3-a84e-713618b085a0 None admin] PATH_INFO: `/v3/projects/43f5c22e38824a8b8dff2f9b4bc1df3f/users/748e35d9a1534920860b2234d45f6724/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:34.571599 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f39f3d-34c9-41e3-a84e-713618b085a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=43f5c22e38824a8b8dff2f9b4bc1df3f, user_id=748e35d9a1534920860b2234d45f6724, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:34.574025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f39f3d-34c9-41e3-a84e-713618b085a0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:34.603530 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 400/810] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 1 16:20:34 2022] PUT /identity/v3/projects/43f5c22e38824a8b8dff2f9b4bc1df3f/users/748e35d9a1534920860b2234d45f6724/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:20:34.604824 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f39f3d-34c9-41e3-a84e-713618b085a0 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:34.734975 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02087c-24ef-4c56-8bda-f3a8c02b4745 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:34.778252 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:34.794321 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1167489-1201-443c-98da-ebc6c416f39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:34.794990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1167489-1201-443c-98da-ebc6c416f39c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:34.795269 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1167489-1201-443c-98da-ebc6c416f39c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:34.795539 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1167489-1201-443c-98da-ebc6c416f39c None admin] PATH_INFO: `/v3/services/network` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:34.796154 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1167489-1201-443c-98da-ebc6c416f39c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:34.797661 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1167489-1201-443c-98da-ebc6c416f39c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:34.811118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-f1167489-1201-443c-98da-ebc6c416f39c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:20:34.811118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:34.811118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:34.811118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:34.811118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:34.811118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:34.811118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:34.811118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:34.811118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:20:34.811118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:34.811118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:34.811118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:34.811118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:34.811118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:34.811118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:34.811118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:34.811118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:34.812183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:34.812183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:34.812183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:34.812183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:34.812183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:34.812183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:34.812183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:34.812183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:34.812183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:34.812183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:34.812183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:34.812183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:34.812183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:34.812183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:34.812183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:34.812183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:34.813064 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:34.813064 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:34.813064 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:34.813064 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:34.813064 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:34.813064 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:34.813064 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:34.813064 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:34.813064 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:34.813064 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:34.813064 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:34.813064 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:34.813064 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:20:34.813064 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:34.813064 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 411/811] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:34 2022] GET /identity/v3/services/network => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:34.813860 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1167489-1201-443c-98da-ebc6c416f39c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:34.875658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f39f3d-34c9-41e3-a84e-713618b085a0 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:34.933028 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:34.942161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ae0fc-5e84-4608-93d3-3b810f3ef97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:34.943868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ae0fc-5e84-4608-93d3-3b810f3ef97f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:34.944691 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ae0fc-5e84-4608-93d3-3b810f3ef97f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:34.944999 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ae0fc-5e84-4608-93d3-3b810f3ef97f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:34.955502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ae0fc-5e84-4608-93d3-3b810f3ef97f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:34.957049 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ae0fc-5e84-4608-93d3-3b810f3ef97f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:34.962449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1167489-1201-443c-98da-ebc6c416f39c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:34.978160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-8c8ae0fc-5e84-4608-93d3-3b810f3ef97f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:34.978160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:34.978160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:34.978160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:34.978160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:34.978160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:34.978160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:34.978160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:34.978160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:34.978160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:34.978160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:34.978160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:34.978160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:34.978160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:34.978160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:34.979328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:34.979328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:34.979328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:34.979328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:34.979328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:34.979328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:34.979328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:34.979328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:34.979328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:34.979328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:34.979328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:34.979328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:34.979328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:34.979328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:34.979328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:34.979328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:34.979328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:34.980402 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:34.980402 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:34.980402 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:34.980402 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:34.980402 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:34.980402 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:34.980402 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:34.980402 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:34.980913 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 401/812] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:34.981949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ae0fc-5e84-4608-93d3-3b810f3ef97f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:35.010497 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca21a96-9919-4236-8f27-de23422cdb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:35.011467 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca21a96-9919-4236-8f27-de23422cdb43 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:35.011835 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca21a96-9919-4236-8f27-de23422cdb43 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:35.012695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca21a96-9919-4236-8f27-de23422cdb43 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:35.013436 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca21a96-9919-4236-8f27-de23422cdb43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:35.013743 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca21a96-9919-4236-8f27-de23422cdb43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:35.015351 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca21a96-9919-4236-8f27-de23422cdb43 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:35.026391 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 412/813] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:20:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:35.027289 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca21a96-9919-4236-8f27-de23422cdb43 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:35.123028 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:35.134620 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ae0fc-5e84-4608-93d3-3b810f3ef97f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:35.176016 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55f865-07be-4056-a041-9a416506d7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:35.176841 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55f865-07be-4056-a041-9a416506d7d9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:35.177132 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55f865-07be-4056-a041-9a416506d7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:35.177411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55f865-07be-4056-a041-9a416506d7d9 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:35.178064 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55f865-07be-4056-a041-9a416506d7d9 None admin] RBAC: Adding query filter params (name=network) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:35.178367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55f865-07be-4056-a041-9a416506d7d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:35.179816 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55f865-07be-4056-a041-9a416506d7d9 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:35.186473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 402/814] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Sep 1 16:20:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:35.187490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55f865-07be-4056-a041-9a416506d7d9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:35.210092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca21a96-9919-4236-8f27-de23422cdb43 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:35.256508 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca0dca-a0a8-4f99-a9cb-994413fca56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:35.257494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca0dca-a0a8-4f99-a9cb-994413fca56b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:35.257890 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca0dca-a0a8-4f99-a9cb-994413fca56b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:35.258054 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca0dca-a0a8-4f99-a9cb-994413fca56b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:35.258646 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca0dca-a0a8-4f99-a9cb-994413fca56b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:35.260062 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca0dca-a0a8-4f99-a9cb-994413fca56b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:35.274663 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:35.279092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-dcca0dca-a0a8-4f99-a9cb-994413fca56b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:20:35.279092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:35.279092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:35.279092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:35.279092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:35.279092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:35.279092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:35.279092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:35.279092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:20:35.279092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:35.279092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:35.279092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:35.279092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:35.279092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:35.279092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:35.279092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:35.279092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:35.280464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:35.280464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:35.280464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:35.280464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:35.280464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:35.280464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:35.280464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:35.280464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:35.280464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:35.280464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:35.280464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:35.280464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:35.280464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:35.280464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:35.280464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:35.280464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:35.281339 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:35.281339 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:35.281339 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:35.281339 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:35.281339 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:35.281339 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:35.281339 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:35.281339 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:35.281339 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:35.281339 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:35.281339 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:35.281339 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:35.281339 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:20:35.281339 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:35.281339 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 413/815] 10.222.0.52 () {56 vars in 1129 bytes} [Thu Sep 1 16:20:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:35.283024 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca0dca-a0a8-4f99-a9cb-994413fca56b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:35.341532 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55f865-07be-4056-a041-9a416506d7d9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:35.385148 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe4217-ce07-4863-b0f4-eef433c8a629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:35.386046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe4217-ce07-4863-b0f4-eef433c8a629 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:35.386474 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe4217-ce07-4863-b0f4-eef433c8a629 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:35.387461 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe4217-ce07-4863-b0f4-eef433c8a629 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:35.388334 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe4217-ce07-4863-b0f4-eef433c8a629 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:35.388829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe4217-ce07-4863-b0f4-eef433c8a629 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:35.390330 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe4217-ce07-4863-b0f4-eef433c8a629 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:35.406220 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 403/816] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:35.407156 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe4217-ce07-4863-b0f4-eef433c8a629 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:35.471607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca0dca-a0a8-4f99-a9cb-994413fca56b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:35.504362 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:35.538642 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033300b9-dc2d-42d4-835c-a579084fedca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:35.539781 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033300b9-dc2d-42d4-835c-a579084fedca None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:35.540243 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033300b9-dc2d-42d4-835c-a579084fedca None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:35.540769 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033300b9-dc2d-42d4-835c-a579084fedca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:35.561723 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033300b9-dc2d-42d4-835c-a579084fedca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:35.564655 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033300b9-dc2d-42d4-835c-a579084fedca None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:35.591224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe4217-ce07-4863-b0f4-eef433c8a629 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:35.595711 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-033300b9-dc2d-42d4-835c-a579084fedca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:35.595711 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:35.595711 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:35.595711 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:35.595711 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:35.595711 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:35.595711 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:35.595711 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:35.595711 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:35.595711 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:35.595711 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:35.595711 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:35.595711 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:35.595711 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:35.595711 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:35.595711 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:35.597795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:35.597795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:35.597795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:35.597795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:35.597795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:35.597795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:35.597795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:35.597795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:35.597795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:35.597795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:35.597795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:35.597795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:35.597795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:35.597795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:35.597795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:35.597795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:35.597795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:35.599846 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:35.599846 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:35.599846 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:35.605688 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 414/817] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:35.607375 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033300b9-dc2d-42d4-835c-a579084fedca None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:35.621817 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:35.661053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6ca8c-07d9-4bbe-a493-8a5de5974395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:35.662092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6ca8c-07d9-4bbe-a493-8a5de5974395 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:35.662583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6ca8c-07d9-4bbe-a493-8a5de5974395 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:35.663079 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6ca8c-07d9-4bbe-a493-8a5de5974395 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:35.664297 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6ca8c-07d9-4bbe-a493-8a5de5974395 None admin] RBAC: Adding query filter params (type=network) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:35.664877 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6ca8c-07d9-4bbe-a493-8a5de5974395 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:35.667579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6ca8c-07d9-4bbe-a493-8a5de5974395 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:35.681647 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 404/818] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Sep 1 16:20:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:35.681647 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6ca8c-07d9-4bbe-a493-8a5de5974395 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:35.799959 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033300b9-dc2d-42d4-835c-a579084fedca None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:35.852445 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc360d-def9-4f1f-817c-602193c0b3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:35.853816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc360d-def9-4f1f-817c-602193c0b3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:35.854562 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc360d-def9-4f1f-817c-602193c0b3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:35.854989 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc360d-def9-4f1f-817c-602193c0b3c5 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:35.856375 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc360d-def9-4f1f-817c-602193c0b3c5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:35.856862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc360d-def9-4f1f-817c-602193c0b3c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:35.858974 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6ca8c-07d9-4bbe-a493-8a5de5974395 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:35.863599 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc360d-def9-4f1f-817c-602193c0b3c5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:35.875402 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 415/819] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Sep 1 16:20:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:35.876328 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc360d-def9-4f1f-817c-602193c0b3c5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:35.930143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094015a-12d0-4f27-980a-808e8b6083e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:35.931532 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094015a-12d0-4f27-980a-808e8b6083e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:35.932162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094015a-12d0-4f27-980a-808e8b6083e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:35.932837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094015a-12d0-4f27-980a-808e8b6083e9 None admin] PATH_INFO: `/v3/projects/43f5c22e38824a8b8dff2f9b4bc1df3f/users/3c001a902faf4b3c8d8f23f2e017c706/roles/93abdb875d35417d91e420a60ccafbd2` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:35.934594 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:35.961309 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094015a-12d0-4f27-980a-808e8b6083e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=43f5c22e38824a8b8dff2f9b4bc1df3f, user_id=3c001a902faf4b3c8d8f23f2e017c706, role_id=93abdb875d35417d91e420a60ccafbd2)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:35.964097 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094015a-12d0-4f27-980a-808e8b6083e9 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:35.996666 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 405/820] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 1 16:20:35 2022] PUT /identity/v3/projects/43f5c22e38824a8b8dff2f9b4bc1df3f/users/3c001a902faf4b3c8d8f23f2e017c706/roles/93abdb875d35417d91e420a60ccafbd2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:20:35.996666 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094015a-12d0-4f27-980a-808e8b6083e9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:36.076684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:36.129543 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc360d-def9-4f1f-817c-602193c0b3c5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:36.232007 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b31695-0764-448c-9307-8c164392478f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:36.233148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b31695-0764-448c-9307-8c164392478f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:36.233665 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b31695-0764-448c-9307-8c164392478f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:36.234128 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b31695-0764-448c-9307-8c164392478f None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:36.235539 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b31695-0764-448c-9307-8c164392478f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:36.236092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b31695-0764-448c-9307-8c164392478f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:36.239019 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b31695-0764-448c-9307-8c164392478f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:36.248374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094015a-12d0-4f27-980a-808e8b6083e9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:36.265115 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 416/821] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:36.266691 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b31695-0764-448c-9307-8c164392478f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:36.326585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c81709-0801-43b5-8361-8aaa72f31a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:36.327438 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c81709-0801-43b5-8361-8aaa72f31a68 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:36.327765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c81709-0801-43b5-8361-8aaa72f31a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:36.328219 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c81709-0801-43b5-8361-8aaa72f31a68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:36.329015 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c81709-0801-43b5-8361-8aaa72f31a68 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:36.330764 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c81709-0801-43b5-8361-8aaa72f31a68 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:36.380877 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 406/822] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:20:35 2022] POST /identity/v3/endpoints => generated 337 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:20:36.380877 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c81709-0801-43b5-8361-8aaa72f31a68 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:36.486737 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:36.536818 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b31695-0764-448c-9307-8c164392478f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:36.589337 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:36.626233 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c81709-0801-43b5-8361-8aaa72f31a68 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:36.697491 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8668ca-6709-4043-b016-8262edecb130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:36.698477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8668ca-6709-4043-b016-8262edecb130 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:36.698950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8668ca-6709-4043-b016-8262edecb130 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:36.699455 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8668ca-6709-4043-b016-8262edecb130 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:36.700514 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8668ca-6709-4043-b016-8262edecb130 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:36.703592 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8668ca-6709-4043-b016-8262edecb130 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:36.705511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8668ca-6709-4043-b016-8262edecb130 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:36.719369 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 417/823] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Sep 1 16:20:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:36.729630 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8668ca-6709-4043-b016-8262edecb130 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:36.731868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5b4c5-a35e-44d2-b092-50b295efee45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:36.732960 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5b4c5-a35e-44d2-b092-50b295efee45 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:36.733429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5b4c5-a35e-44d2-b092-50b295efee45 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:36.733899 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5b4c5-a35e-44d2-b092-50b295efee45 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:36.751960 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5b4c5-a35e-44d2-b092-50b295efee45 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:36.754677 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5b4c5-a35e-44d2-b092-50b295efee45 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:36.780276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-1cc5b4c5-a35e-44d2-b092-50b295efee45 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:20:36.780276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:36.780276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:36.780276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:36.780276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:36.780276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:36.780276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:36.780276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:36.780276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:36.780276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:36.780276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:36.780276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:36.780276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:36.780276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:36.780276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:36.780276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:36.782314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:36.782314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:36.782314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:36.782314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:36.782314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:36.782314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:36.782314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:36.782314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:36.782314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:36.782314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:36.782314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:36.782314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:36.782314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:36.782314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:36.782314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:36.782314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:36.782314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:36.782314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:36.784229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:36.784229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:36.784229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:36.784229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:36.784229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:36.784229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:36.784229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:36.784229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:36.784229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:20:36.784229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:36.788749 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 407/824] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Sep 1 16:20:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:36.792131 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5b4c5-a35e-44d2-b092-50b295efee45 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:36.966673 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8668ca-6709-4043-b016-8262edecb130 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:36.989773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5b4c5-a35e-44d2-b092-50b295efee45 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:37.022102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb51782c-43ee-4e06-8039-27228ed1ea57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:37.022819 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51782c-43ee-4e06-8039-27228ed1ea57 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:37.023104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51782c-43ee-4e06-8039-27228ed1ea57 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:37.023481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51782c-43ee-4e06-8039-27228ed1ea57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:37.024211 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb51782c-43ee-4e06-8039-27228ed1ea57 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:37.025695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb51782c-43ee-4e06-8039-27228ed1ea57 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:37.044494 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd818f6-ee66-42fd-9a70-b70d1c1f8744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:37.045196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd818f6-ee66-42fd-9a70-b70d1c1f8744 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:37.045465 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd818f6-ee66-42fd-9a70-b70d1c1f8744 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:37.045758 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd818f6-ee66-42fd-9a70-b70d1c1f8744 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:37.046480 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd818f6-ee66-42fd-9a70-b70d1c1f8744 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:37.046790 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd818f6-ee66-42fd-9a70-b70d1c1f8744 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:37.048702 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd818f6-ee66-42fd-9a70-b70d1c1f8744 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:37.067990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 418/825] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:20:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:20:37.067990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57b2d0-7589-47e2-aa03-14b8ca0585b0 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:37.067990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57b2d0-7589-47e2-aa03-14b8ca0585b0 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:37.067990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57b2d0-7589-47e2-aa03-14b8ca0585b0 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:37.067990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 419/826] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:37.076656 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:37.076907 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4f2bc-10d7-4962-a633-1ff8dc8e67ea None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:37.076907 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4f2bc-10d7-4962-a633-1ff8dc8e67ea None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:37.076907 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4f2bc-10d7-4962-a633-1ff8dc8e67ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:37.098599 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 408/827] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Sep 1 16:20:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:37.105134 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd818f6-ee66-42fd-9a70-b70d1c1f8744 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:37.112208 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c2f4f2bc-10d7-4962-a633-1ff8dc8e67ea None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:37.113949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c2f4f2bc-10d7-4962-a633-1ff8dc8e67ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:37.128583 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:37.274769 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 420/828] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:20:37.308757 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd818f6-ee66-42fd-9a70-b70d1c1f8744 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:37.359849 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011ca04-c200-4213-b125-dfb9d0f351ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:37.360488 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011ca04-c200-4213-b125-dfb9d0f351ed None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:37.360822 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011ca04-c200-4213-b125-dfb9d0f351ed None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:37.361104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011ca04-c200-4213-b125-dfb9d0f351ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:37.441806 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:37.445994 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011ca04-c200-4213-b125-dfb9d0f351ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:37.447743 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011ca04-c200-4213-b125-dfb9d0f351ed None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:37.580543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 409/829] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:37 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:20:37.581915 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4f2bc-10d7-4962-a633-1ff8dc8e67ea None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:37.712760 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4f2bc-10d7-4962-a633-1ff8dc8e67ea None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:37.775365 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011ca04-c200-4213-b125-dfb9d0f351ed None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:37.783297 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0cc0e-7815-42b1-86eb-9f7573661dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:37.784377 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0cc0e-7815-42b1-86eb-9f7573661dcd None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:37.784894 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0cc0e-7815-42b1-86eb-9f7573661dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:37.785367 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0cc0e-7815-42b1-86eb-9f7573661dcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:37.799069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:37.806282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0cc0e-7815-42b1-86eb-9f7573661dcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:37.809984 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0cc0e-7815-42b1-86eb-9f7573661dcd None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:37.842069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-abd0cc0e-7815-42b1-86eb-9f7573661dcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:37.842069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:37.842069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:37.842069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:37.842069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:37.842069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:37.842069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:37.842069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:37.842069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:37.842069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:37.842069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:37.842069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:37.842069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:37.842069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:37.842069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:37.842069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:37.843936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:37.843936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:37.843936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:37.843936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:37.843936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:37.843936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:37.843936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:37.843936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:37.843936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:37.843936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:37.843936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:37.843936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:37.843936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:37.843936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:37.843936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:37.843936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:37.843936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:37.846263 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:37.846263 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:37.846263 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:37.846263 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 421/830] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:37.851737 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0cc0e-7815-42b1-86eb-9f7573661dcd None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:37.974682 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:37.985874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011ca04-c200-4213-b125-dfb9d0f351ed None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:38.038866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0cc0e-7815-42b1-86eb-9f7573661dcd None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:38.067740 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443e092-9839-4161-9fcd-c8a9acb0b73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:38.068995 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443e092-9839-4161-9fcd-c8a9acb0b73a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:38.070105 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443e092-9839-4161-9fcd-c8a9acb0b73a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:38.070105 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443e092-9839-4161-9fcd-c8a9acb0b73a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:38.093073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0443e092-9839-4161-9fcd-c8a9acb0b73a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:38.094571 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedebedf-ee12-4548-8112-4dfc0078d40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:38.095472 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedebedf-ee12-4548-8112-4dfc0078d40b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:38.095973 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedebedf-ee12-4548-8112-4dfc0078d40b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:38.096466 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedebedf-ee12-4548-8112-4dfc0078d40b None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:38.097410 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedebedf-ee12-4548-8112-4dfc0078d40b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:38.097951 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedebedf-ee12-4548-8112-4dfc0078d40b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:38.099596 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedebedf-ee12-4548-8112-4dfc0078d40b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:38.103171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-0443e092-9839-4161-9fcd-c8a9acb0b73a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:38.103171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:38.103171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:38.103171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:38.103171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:38.103171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:38.103171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:38.103171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:38.103171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:38.103171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:38.103171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:38.103171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:38.103171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:38.103171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:38.103171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:38.103171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:38.104238 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:38.104238 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:38.104238 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:38.104238 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:38.104238 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:38.104238 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:38.104238 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:38.104238 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:38.104238 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:38.104238 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:38.104238 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:38.104238 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:38.104238 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:38.104238 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:38.104238 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:38.104238 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:38.105180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:38.105180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:38.105180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:38.105180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:38.105180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:38.105180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:38.105180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:38.105180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:38.105180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:38.105180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:38.105180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:38.105180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:38.113425 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 410/831] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:20:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:38.115061 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443e092-9839-4161-9fcd-c8a9acb0b73a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:38.120120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 422/832] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:38.129792 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedebedf-ee12-4548-8112-4dfc0078d40b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:38.205510 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:38.272149 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedebedf-ee12-4548-8112-4dfc0078d40b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:38.315912 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00f3bd-75c6-4d61-aae9-fd86b2f52b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:38.317092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00f3bd-75c6-4d61-aae9-fd86b2f52b70 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:38.317671 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00f3bd-75c6-4d61-aae9-fd86b2f52b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:38.318163 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00f3bd-75c6-4d61-aae9-fd86b2f52b70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:38.320137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443e092-9839-4161-9fcd-c8a9acb0b73a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:38.328185 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00f3bd-75c6-4d61-aae9-fd86b2f52b70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:38.330126 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00f3bd-75c6-4d61-aae9-fd86b2f52b70 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:38.347972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-ae00f3bd-75c6-4d61-aae9-fd86b2f52b70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:38.347972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:38.347972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:38.347972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:38.347972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:38.347972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:38.347972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:38.347972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:38.347972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:38.347972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:38.347972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:38.347972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:38.347972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:38.347972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:38.347972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:38.348962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:38.348962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:38.348962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:38.348962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:38.348962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:38.348962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:38.348962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:38.348962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:38.348962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:38.348962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:38.348962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:38.348962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:38.348962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:38.348962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:38.348962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:38.348962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:38.348962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:38.349886 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:38.349886 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:38.349886 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:38.349886 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:38.349886 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:38.349886 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:38.349886 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:38.349886 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:38.360553 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 423/833] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:38.362036 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00f3bd-75c6-4d61-aae9-fd86b2f52b70 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:38.426656 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ecf52-6822-490c-82d9-e661da490432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:38.427713 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ecf52-6822-490c-82d9-e661da490432 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:38.428168 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ecf52-6822-490c-82d9-e661da490432 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:38.429108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ecf52-6822-490c-82d9-e661da490432 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:38.429883 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ecf52-6822-490c-82d9-e661da490432 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:38.430417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ecf52-6822-490c-82d9-e661da490432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:38.433046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ecf52-6822-490c-82d9-e661da490432 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:38.467307 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 411/834] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:20:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:38.475532 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ecf52-6822-490c-82d9-e661da490432 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:38.542457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:38.594529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00f3bd-75c6-4d61-aae9-fd86b2f52b70 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:38.619053 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:38.676052 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0aa8d-56cd-480b-9fec-080fde4f03f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:38.677956 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0aa8d-56cd-480b-9fec-080fde4f03f0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:38.678850 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0aa8d-56cd-480b-9fec-080fde4f03f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:38.679695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0aa8d-56cd-480b-9fec-080fde4f03f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:38.681316 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0aa8d-56cd-480b-9fec-080fde4f03f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:38.682190 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0aa8d-56cd-480b-9fec-080fde4f03f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:38.686392 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0aa8d-56cd-480b-9fec-080fde4f03f0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:38.710710 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ecf52-6822-490c-82d9-e661da490432 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:38.712533 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 424/835] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:38.723621 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8d5fe-061f-4c09-8aa6-f961bfacb55f None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:38.724054 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8d5fe-061f-4c09-8aa6-f961bfacb55f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:38.724506 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8d5fe-061f-4c09-8aa6-f961bfacb55f None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:38.735283 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 425/836] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:38 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:38.736985 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8d5fe-061f-4c09-8aa6-f961bfacb55f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:38.775789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fbbe1-c965-40bb-b7bf-6ee5c1aee163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:38.776523 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fbbe1-c965-40bb-b7bf-6ee5c1aee163 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:38.776935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fbbe1-c965-40bb-b7bf-6ee5c1aee163 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:38.778057 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fbbe1-c965-40bb-b7bf-6ee5c1aee163 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:38.791702 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fbbe1-c965-40bb-b7bf-6ee5c1aee163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:38.794060 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fbbe1-c965-40bb-b7bf-6ee5c1aee163 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:38.815925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-450fbbe1-c965-40bb-b7bf-6ee5c1aee163 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:38.815925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:38.815925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:38.815925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:38.815925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:38.815925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:38.815925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:38.815925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:38.815925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:38.815925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:38.815925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:38.815925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:38.815925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:38.815925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:38.815925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:38.815925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:38.818123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:38.818123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:38.818123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:38.818123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:38.818123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:38.818123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:38.818123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:38.818123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:38.818123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:38.818123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:38.818123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:38.818123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:38.818123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:38.818123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:38.818123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:38.818123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:38.818123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:38.820120 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:38.820120 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:38.820120 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:38.823695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 412/837] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:38.825858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abe9e5-8a3b-43dc-a28c-5fc792249a6b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:38.826217 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abe9e5-8a3b-43dc-a28c-5fc792249a6b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:38.826573 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abe9e5-8a3b-43dc-a28c-5fc792249a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:38.851396 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d9abe9e5-8a3b-43dc-a28c-5fc792249a6b None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:38.852828 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d9abe9e5-8a3b-43dc-a28c-5fc792249a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:38.981119 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 413/838] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:38.981119 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abe9e5-8a3b-43dc-a28c-5fc792249a6b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:38.981119 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:38.982318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8d5fe-061f-4c09-8aa6-f961bfacb55f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:39.053749 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3426911-24de-4971-ab7e-2f5f98ca1222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:39.054493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3426911-24de-4971-ab7e-2f5f98ca1222 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:39.054769 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3426911-24de-4971-ab7e-2f5f98ca1222 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:39.055242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3426911-24de-4971-ab7e-2f5f98ca1222 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:39.056075 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3426911-24de-4971-ab7e-2f5f98ca1222 None admin] RBAC: Adding query filter params (role.id=a8896546a02c42489ef73c7ad7c43542, scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f, user.id=55f389ab3ea046008b44f129113de995) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:39.056445 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3426911-24de-4971-ab7e-2f5f98ca1222 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:39.058332 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3426911-24de-4971-ab7e-2f5f98ca1222 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:39.071458 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 426/839] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:38 2022] GET /identity/v3/role_assignments?user.id=55f389ab3ea046008b44f129113de995&scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f&role.id=a8896546a02c42489ef73c7ad7c43542 => generated 608 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:39.143340 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abe9e5-8a3b-43dc-a28c-5fc792249a6b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:39.198606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cee4b-3bea-4e25-ae4b-98e63468c37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:39.200801 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cee4b-3bea-4e25-ae4b-98e63468c37c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:39.201795 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cee4b-3bea-4e25-ae4b-98e63468c37c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:39.202672 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cee4b-3bea-4e25-ae4b-98e63468c37c None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:39.203957 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585cee4b-3bea-4e25-ae4b-98e63468c37c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:39.204496 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585cee4b-3bea-4e25-ae4b-98e63468c37c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:39.206219 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585cee4b-3bea-4e25-ae4b-98e63468c37c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:39.221214 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 414/840] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:39.228181 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3426911-24de-4971-ab7e-2f5f98ca1222 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:39.278887 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:39.349665 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cee4b-3bea-4e25-ae4b-98e63468c37c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:39.401555 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3426911-24de-4971-ab7e-2f5f98ca1222 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:39.438217 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:39.458337 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1a844-2151-4949-bd78-f569eec36d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:39.459277 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1a844-2151-4949-bd78-f569eec36d8a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:39.459717 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1a844-2151-4949-bd78-f569eec36d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:39.460137 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1a844-2151-4949-bd78-f569eec36d8a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:39.470510 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1a844-2151-4949-bd78-f569eec36d8a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:39.473507 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1a844-2151-4949-bd78-f569eec36d8a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:39.489090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-4eb1a844-2151-4949-bd78-f569eec36d8a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:20:39.489090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:39.489090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:39.489090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:39.489090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:39.489090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:39.489090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:39.489090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:39.489090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:39.489090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:39.489090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:39.489090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:39.489090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:39.489090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:39.489090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:39.489090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:39.490397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:39.490397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:39.490397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:39.490397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:39.490397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:39.490397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:39.490397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:39.490397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:39.490397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:39.490397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:39.490397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:39.490397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:39.490397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:39.490397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:39.490397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:39.490397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:39.490397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:39.490397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:39.491542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:39.491542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:39.491542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:39.491542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:39.491542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:39.491542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:39.491542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:39.491542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:39.491542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:20:39.491542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:39.499221 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 427/841] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:20:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:39.500857 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1a844-2151-4949-bd78-f569eec36d8a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:39.528283 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cee4b-3bea-4e25-ae4b-98e63468c37c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:39.604343 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9131163-cfa2-48f3-ba50-5ff842e7f44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:39.605781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9131163-cfa2-48f3-ba50-5ff842e7f44b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:39.606283 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9131163-cfa2-48f3-ba50-5ff842e7f44b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:39.606778 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9131163-cfa2-48f3-ba50-5ff842e7f44b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:39.619821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:39.629768 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1a844-2151-4949-bd78-f569eec36d8a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:39.633535 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9131163-cfa2-48f3-ba50-5ff842e7f44b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:39.644499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-d9131163-cfa2-48f3-ba50-5ff842e7f44b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:39.644499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:39.644499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:39.644499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:39.644499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:39.644499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:39.644499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:39.644499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:39.644499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:39.644499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:39.644499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:39.644499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:39.644499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:39.644499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:39.644499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:39.644499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:39.646223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:39.646223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:39.646223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:39.646223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:39.646223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:39.646223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:39.646223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:39.646223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:39.646223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:39.646223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:39.646223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:39.646223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:39.646223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:39.646223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:39.646223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:39.646223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:39.648196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:39.648196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:39.648196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:39.648196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:39.648196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:39.648196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:39.648196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:39.648196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:39.648196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:39.648196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:39.648196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:39.648196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:39.648196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 415/842] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 1 16:20:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:39.654117 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9131163-cfa2-48f3-ba50-5ff842e7f44b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:39.679349 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696a20b-f858-466b-be27-c489fc978545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:39.680403 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696a20b-f858-466b-be27-c489fc978545 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:39.680962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696a20b-f858-466b-be27-c489fc978545 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:39.681439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696a20b-f858-466b-be27-c489fc978545 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:39.682651 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696a20b-f858-466b-be27-c489fc978545 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:39.683228 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696a20b-f858-466b-be27-c489fc978545 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:39.685617 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696a20b-f858-466b-be27-c489fc978545 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:39.712748 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 428/843] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Sep 1 16:20:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:39.714619 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696a20b-f858-466b-be27-c489fc978545 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:39.852044 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9131163-cfa2-48f3-ba50-5ff842e7f44b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:39.870529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696a20b-f858-466b-be27-c489fc978545 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:39.884063 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:39.904568 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc582d0-7403-4a5c-9fd5-031b2dc8ef3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:39.907053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc582d0-7403-4a5c-9fd5-031b2dc8ef3a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:39.907053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc582d0-7403-4a5c-9fd5-031b2dc8ef3a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:39.907053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc582d0-7403-4a5c-9fd5-031b2dc8ef3a None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:39.907053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc582d0-7403-4a5c-9fd5-031b2dc8ef3a None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:39.907628 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc582d0-7403-4a5c-9fd5-031b2dc8ef3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:39.909023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc582d0-7403-4a5c-9fd5-031b2dc8ef3a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:39.923861 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 416/844] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 1 16:20:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:39.925456 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db0916-0f86-462f-9581-fbea6d3e9751 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:39.925925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db0916-0f86-462f-9581-fbea6d3e9751 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:39.926367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db0916-0f86-462f-9581-fbea6d3e9751 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:39.929848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e5196-7e84-4dfb-b8e9-56717a1bf306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:39.931295 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e5196-7e84-4dfb-b8e9-56717a1bf306 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:39.932242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e5196-7e84-4dfb-b8e9-56717a1bf306 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:39.932578 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 417/845] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:39.933137 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e5196-7e84-4dfb-b8e9-56717a1bf306 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:39.934238 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db0916-0f86-462f-9581-fbea6d3e9751 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:39.971561 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:40.086009 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e5196-7e84-4dfb-b8e9-56717a1bf306 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:40.089941 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e5196-7e84-4dfb-b8e9-56717a1bf306 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:40.109239 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db0916-0f86-462f-9581-fbea6d3e9751 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:40.164075 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4362d6-22c7-402d-8ce0-267bbbaec6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:40.164656 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4362d6-22c7-402d-8ce0-267bbbaec6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:40.164924 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4362d6-22c7-402d-8ce0-267bbbaec6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:40.165203 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4362d6-22c7-402d-8ce0-267bbbaec6e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:40.179894 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4362d6-22c7-402d-8ce0-267bbbaec6e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:40.182535 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4362d6-22c7-402d-8ce0-267bbbaec6e5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:40.208400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-2f4362d6-22c7-402d-8ce0-267bbbaec6e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:40.208400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:40.208400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:40.208400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:40.208400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:40.208400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:40.208400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:40.208400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:40.208400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:40.208400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:40.208400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:40.208400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:40.208400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:40.208400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:40.208400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:40.208400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:40.209721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:40.209721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:40.209721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:40.209721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:40.209721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:40.209721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:40.209721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:40.209721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:40.209721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:40.209721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:40.209721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:40.209721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:40.209721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:40.209721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:40.209721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:40.209721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:40.209721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:40.217564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:40.217564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:40.217564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:40.217564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 418/846] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:40.217564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d4f0c-a4f7-41f2-85bb-9d0b3680da9f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:40.217564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d4f0c-a4f7-41f2-85bb-9d0b3680da9f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:40.217564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d4f0c-a4f7-41f2-85bb-9d0b3680da9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:40.248251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b15d4f0c-a4f7-41f2-85bb-9d0b3680da9f None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:40.250485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b15d4f0c-a4f7-41f2-85bb-9d0b3680da9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:40.311677 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:40.317986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 429/847] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:39 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 16:20:40.320227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e5196-7e84-4dfb-b8e9-56717a1bf306 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:40.412562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 419/848] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:40.414192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d4f0c-a4f7-41f2-85bb-9d0b3680da9f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:40.440133 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:40.539643 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e5196-7e84-4dfb-b8e9-56717a1bf306 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:40.611105 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5db762-237c-401d-9b45-0aa535934b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:40.612091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5db762-237c-401d-9b45-0aa535934b40 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:40.612551 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5db762-237c-401d-9b45-0aa535934b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:40.613084 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5db762-237c-401d-9b45-0aa535934b40 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:40.614258 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5db762-237c-401d-9b45-0aa535934b40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:40.614783 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5db762-237c-401d-9b45-0aa535934b40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:40.617220 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5db762-237c-401d-9b45-0aa535934b40 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:40.644049 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 430/849] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:40.652797 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5db762-237c-401d-9b45-0aa535934b40 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:40.688501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d4f0c-a4f7-41f2-85bb-9d0b3680da9f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:40.768095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed20ca6-b0f5-4191-961f-22b90b9d8593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:40.769381 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed20ca6-b0f5-4191-961f-22b90b9d8593 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:40.769979 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed20ca6-b0f5-4191-961f-22b90b9d8593 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:40.770595 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed20ca6-b0f5-4191-961f-22b90b9d8593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:40.789733 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed20ca6-b0f5-4191-961f-22b90b9d8593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:40.792494 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed20ca6-b0f5-4191-961f-22b90b9d8593 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:40.829310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-7ed20ca6-b0f5-4191-961f-22b90b9d8593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:40.829310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:40.829310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:40.829310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:40.829310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:40.829310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:40.829310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:40.829310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:40.829310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:40.829310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:40.829310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:40.829310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:40.829310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:40.829310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:40.829310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:40.829310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:40.831490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:40.831490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:40.831490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:40.831490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:40.831490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:40.831490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:40.831490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:40.831490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:40.831490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:40.831490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:40.831490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:40.831490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:40.831490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:40.831490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:40.831490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:40.831490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:40.831490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:40.833172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:40.833172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:40.833172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:40.834246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 420/850] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:40.836664 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed20ca6-b0f5-4191-961f-22b90b9d8593 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:40.876580 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:40.903775 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5db762-237c-401d-9b45-0aa535934b40 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:40.932882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:40.975407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d5d6f-9033-4ec3-b309-60117193669e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:40.976489 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d5d6f-9033-4ec3-b309-60117193669e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:40.977941 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d5d6f-9033-4ec3-b309-60117193669e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:40.978859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d5d6f-9033-4ec3-b309-60117193669e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:40.991689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d5d6f-9033-4ec3-b309-60117193669e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:40.993230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d5d6f-9033-4ec3-b309-60117193669e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:41.007857 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-ce1d5d6f-9033-4ec3-b309-60117193669e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:20:41.007857 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:41.007857 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:41.007857 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:41.007857 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:41.007857 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:41.007857 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:41.007857 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:41.007857 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:41.007857 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:41.007857 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:41.007857 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:41.007857 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:41.007857 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:41.007857 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:41.007857 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:41.009773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:41.009773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:41.009773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:41.009773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:41.009773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:41.009773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:41.009773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:41.009773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:41.009773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:41.009773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:41.009773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:41.009773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:41.009773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:41.009773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:41.009773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:41.009773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:41.009773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:41.009773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:41.012231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:41.012231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:41.012231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:41.012231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:41.012231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:41.012231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:41.012231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:41.012231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:41.012231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:20:41.012231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:41.012231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 431/851] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Sep 1 16:20:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:41.012231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d5d6f-9033-4ec3-b309-60117193669e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:41.023961 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed20ca6-b0f5-4191-961f-22b90b9d8593 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:41.077167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a029d-bf8a-4246-b4ff-088c44ff4f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:41.077816 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a029d-bf8a-4246-b4ff-088c44ff4f16 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:41.078095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a029d-bf8a-4246-b4ff-088c44ff4f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:41.078400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a029d-bf8a-4246-b4ff-088c44ff4f16 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:41.081772 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a029d-bf8a-4246-b4ff-088c44ff4f16 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:41.081772 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a029d-bf8a-4246-b4ff-088c44ff4f16 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:41.100928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-4d2a029d-bf8a-4246-b4ff-088c44ff4f16 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:20:41.100928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:41.100928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:41.100928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:41.100928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:41.100928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:41.100928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:41.100928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:41.100928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:20:41.100928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:41.100928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:41.100928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:41.100928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:41.100928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:41.100928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:41.100928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:41.100928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:41.102249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:41.102249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:41.102249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:41.102249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:41.102249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:41.102249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:41.102249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:41.102249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:41.102249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:41.102249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:41.102249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:41.102249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:41.102249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:41.102249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:41.102249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:41.102249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:41.103083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:41.103083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:41.103083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:41.103083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:41.103083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:41.103083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:41.103083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:41.103083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:41.103083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:41.103083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:41.103083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:41.103083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:41.103083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:20:41.103083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:41.103083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 421/852] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 1 16:20:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:41.104605 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a029d-bf8a-4246-b4ff-088c44ff4f16 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:41.189050 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d5d6f-9033-4ec3-b309-60117193669e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:41.243371 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:41.267658 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f13bbe-0d87-472f-8fbb-b5cb5c83681d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:41.268667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f13bbe-0d87-472f-8fbb-b5cb5c83681d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:41.269142 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f13bbe-0d87-472f-8fbb-b5cb5c83681d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:41.269614 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f13bbe-0d87-472f-8fbb-b5cb5c83681d None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:41.270688 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f13bbe-0d87-472f-8fbb-b5cb5c83681d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:41.271204 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f13bbe-0d87-472f-8fbb-b5cb5c83681d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:41.273592 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f13bbe-0d87-472f-8fbb-b5cb5c83681d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:41.280606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a029d-bf8a-4246-b4ff-088c44ff4f16 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:41.297138 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 432/853] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:41.298560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f13bbe-0d87-472f-8fbb-b5cb5c83681d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:41.349157 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad59f2-05ed-47f2-9cde-c759411038a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:41.350186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad59f2-05ed-47f2-9cde-c759411038a1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:41.350594 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad59f2-05ed-47f2-9cde-c759411038a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:41.351048 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad59f2-05ed-47f2-9cde-c759411038a1 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:41.352602 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad59f2-05ed-47f2-9cde-c759411038a1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:41.352602 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad59f2-05ed-47f2-9cde-c759411038a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:41.354971 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad59f2-05ed-47f2-9cde-c759411038a1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:41.359909 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:41.396262 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 422/854] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Sep 1 16:20:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:41.396262 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad59f2-05ed-47f2-9cde-c759411038a1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:41.510505 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f13bbe-0d87-472f-8fbb-b5cb5c83681d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:41.583059 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad59f2-05ed-47f2-9cde-c759411038a1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:41.586682 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972097c6-ec57-4377-a8c1-69c301377aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:41.587648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972097c6-ec57-4377-a8c1-69c301377aeb None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:41.588136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972097c6-ec57-4377-a8c1-69c301377aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:41.588609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972097c6-ec57-4377-a8c1-69c301377aeb None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:41.590357 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972097c6-ec57-4377-a8c1-69c301377aeb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:41.590880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972097c6-ec57-4377-a8c1-69c301377aeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:41.592654 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972097c6-ec57-4377-a8c1-69c301377aeb None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:41.605753 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 433/855] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 1 16:20:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:41.608029 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972097c6-ec57-4377-a8c1-69c301377aeb None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:41.658861 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b7448-30e9-433f-9f09-5ceec9753049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:41.659834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b7448-30e9-433f-9f09-5ceec9753049 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:41.661176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b7448-30e9-433f-9f09-5ceec9753049 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:41.661176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b7448-30e9-433f-9f09-5ceec9753049 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:41.673882 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b7448-30e9-433f-9f09-5ceec9753049 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:41.676231 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b7448-30e9-433f-9f09-5ceec9753049 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:41.681802 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:41.700345 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-754b7448-30e9-433f-9f09-5ceec9753049 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:41.700345 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:41.700345 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:41.700345 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:41.700345 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:41.700345 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:41.700345 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:41.700345 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:41.700345 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:41.700345 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:41.700345 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:41.700345 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:41.700345 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:41.700345 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:41.700345 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:41.702206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:41.702206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:41.702206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:41.702206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:41.702206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:41.702206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:41.702206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:41.702206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:41.702206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:41.702206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:41.702206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:41.702206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:41.702206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:41.702206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:41.702206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:41.702206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:41.702206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:41.705649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:41.705649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:41.705649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:41.705649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:41.705649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:41.705649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:41.705649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:41.705649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:41.705649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 423/856] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:41.705649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b7448-30e9-433f-9f09-5ceec9753049 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:41.752566 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:41.761602 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972097c6-ec57-4377-a8c1-69c301377aeb None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:41.812443 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b379f-5fc3-447f-9546-2ca8f1c53026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:41.813578 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b379f-5fc3-447f-9546-2ca8f1c53026 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:41.814062 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b379f-5fc3-447f-9546-2ca8f1c53026 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:41.814559 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b379f-5fc3-447f-9546-2ca8f1c53026 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:41.860077 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b7448-30e9-433f-9f09-5ceec9753049 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:41.904650 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95305d1a-46a0-4112-b82b-1316841fd124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:41.905506 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95305d1a-46a0-4112-b82b-1316841fd124 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:41.905892 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95305d1a-46a0-4112-b82b-1316841fd124 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:41.906253 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95305d1a-46a0-4112-b82b-1316841fd124 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:41.907203 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95305d1a-46a0-4112-b82b-1316841fd124 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:41.907574 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95305d1a-46a0-4112-b82b-1316841fd124 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:41.909405 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95305d1a-46a0-4112-b82b-1316841fd124 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:41.915804 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 424/857] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 1 16:20:41 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:41.916870 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95305d1a-46a0-4112-b82b-1316841fd124 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:41.926078 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b379f-5fc3-447f-9546-2ca8f1c53026 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:41.928651 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b379f-5fc3-447f-9546-2ca8f1c53026 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:42.036441 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:42.061943 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:42.071149 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 434/858] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:41 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:20:42.074625 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ac4b5-3ad0-4742-bbd9-51c81de184db None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:42.075693 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ac4b5-3ad0-4742-bbd9-51c81de184db None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:42.076127 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ac4b5-3ad0-4742-bbd9-51c81de184db None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:42.087305 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 435/859] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:42.087305 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ac4b5-3ad0-4742-bbd9-51c81de184db None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:42.110846 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95305d1a-46a0-4112-b82b-1316841fd124 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:42.169263 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e759f36-8933-4402-bd83-b2e9c123de61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:42.170215 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e759f36-8933-4402-bd83-b2e9c123de61 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:42.170646 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e759f36-8933-4402-bd83-b2e9c123de61 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:42.171117 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e759f36-8933-4402-bd83-b2e9c123de61 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:42.172465 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e759f36-8933-4402-bd83-b2e9c123de61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:42.173058 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e759f36-8933-4402-bd83-b2e9c123de61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:42.176223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e759f36-8933-4402-bd83-b2e9c123de61 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:42.200454 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 425/860] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:42.203239 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c2434-17fa-4b15-9bb7-79ed4a5427b7 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:42.203667 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c2434-17fa-4b15-9bb7-79ed4a5427b7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:42.204110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c2434-17fa-4b15-9bb7-79ed4a5427b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:42.238132 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e43c2434-17fa-4b15-9bb7-79ed4a5427b7 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:42.240259 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e43c2434-17fa-4b15-9bb7-79ed4a5427b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:42.294852 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ac4b5-3ad0-4742-bbd9-51c81de184db None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:42.357334 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587964f-2b6f-4902-abad-0a28cedc1221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:42.364853 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587964f-2b6f-4902-abad-0a28cedc1221 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:42.365120 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 426/861] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:42.365278 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587964f-2b6f-4902-abad-0a28cedc1221 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:42.365278 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587964f-2b6f-4902-abad-0a28cedc1221 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:42.365602 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c2434-17fa-4b15-9bb7-79ed4a5427b7 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:42.383200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587964f-2b6f-4902-abad-0a28cedc1221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:42.385166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587964f-2b6f-4902-abad-0a28cedc1221 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:42.406315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-e587964f-2b6f-4902-abad-0a28cedc1221 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:42.406315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:42.406315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:42.406315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:42.406315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:42.406315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:42.406315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:42.406315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:42.406315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:42.406315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:42.406315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:42.406315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:42.406315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:42.406315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:42.406315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:42.406315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:42.408160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:42.408160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:42.408160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:42.408160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:42.408160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:42.408160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:42.408160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:42.408160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:42.408160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:42.408160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:42.408160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:42.408160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:42.408160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:42.408160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:42.408160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:42.408160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:42.408160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:42.410222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:42.410222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:42.410222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:42.413495 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 436/862] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:42.414525 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587964f-2b6f-4902-abad-0a28cedc1221 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:42.483751 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:42.587735 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587964f-2b6f-4902-abad-0a28cedc1221 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:42.663626 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:42.669175 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72b61f-627a-4cd9-9411-5ee167e9f232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:42.670130 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72b61f-627a-4cd9-9411-5ee167e9f232 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:42.670917 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72b61f-627a-4cd9-9411-5ee167e9f232 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:42.671391 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72b61f-627a-4cd9-9411-5ee167e9f232 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:42.673004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72b61f-627a-4cd9-9411-5ee167e9f232 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:42.673385 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72b61f-627a-4cd9-9411-5ee167e9f232 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:42.676294 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72b61f-627a-4cd9-9411-5ee167e9f232 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:42.702776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 437/863] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:42.709747 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72b61f-627a-4cd9-9411-5ee167e9f232 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:42.762130 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c2434-17fa-4b15-9bb7-79ed4a5427b7 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:42.833017 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0a60d-aca6-4f13-a0bd-c119e2fbef1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:42.834051 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0a60d-aca6-4f13-a0bd-c119e2fbef1c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:42.834537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0a60d-aca6-4f13-a0bd-c119e2fbef1c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:42.834983 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0a60d-aca6-4f13-a0bd-c119e2fbef1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:42.836391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0a60d-aca6-4f13-a0bd-c119e2fbef1c None admin] RBAC: Adding query filter params (role.id=a8896546a02c42489ef73c7ad7c43542, scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f, user.id=748e35d9a1534920860b2234d45f6724) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:42.836988 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0a60d-aca6-4f13-a0bd-c119e2fbef1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:42.840451 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0a60d-aca6-4f13-a0bd-c119e2fbef1c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:42.851856 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 427/864] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:42 2022] GET /identity/v3/role_assignments?user.id=748e35d9a1534920860b2234d45f6724&scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f&role.id=a8896546a02c42489ef73c7ad7c43542 => generated 608 bytes in 493 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:42.854181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0a60d-aca6-4f13-a0bd-c119e2fbef1c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:42.889385 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72b61f-627a-4cd9-9411-5ee167e9f232 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:42.917359 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:42.994798 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b9c7d-500a-43e2-90e9-2213627037f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:42.998285 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b9c7d-500a-43e2-90e9-2213627037f2 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:42.999435 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b9c7d-500a-43e2-90e9-2213627037f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:43.000195 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b9c7d-500a-43e2-90e9-2213627037f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:43.017551 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b9c7d-500a-43e2-90e9-2213627037f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:43.020809 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b9c7d-500a-43e2-90e9-2213627037f2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:43.040897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-853b9c7d-500a-43e2-90e9-2213627037f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:43.040897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:43.040897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:43.040897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:43.040897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:43.040897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:43.040897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:43.040897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:43.040897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:43.040897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:43.040897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:43.040897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:43.040897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:43.040897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:43.040897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:43.042955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:43.042955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:43.042955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:43.042955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:43.042955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:43.042955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:43.042955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:43.042955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:43.042955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:43.042955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:43.042955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:43.042955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:43.042955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:43.042955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:43.042955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:43.042955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:43.042955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:43.045464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:43.045464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:43.045464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:43.045464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:43.045464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:43.045464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:43.045464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:43.045464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:43.045464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 438/865] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:43.062789 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b9c7d-500a-43e2-90e9-2213627037f2 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:43.080934 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0a60d-aca6-4f13-a0bd-c119e2fbef1c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:43.105178 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:43.125977 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae52b57-ec02-4131-886b-1392f19e2e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:43.126739 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae52b57-ec02-4131-886b-1392f19e2e4c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:43.127019 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae52b57-ec02-4131-886b-1392f19e2e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:43.127946 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae52b57-ec02-4131-886b-1392f19e2e4c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:43.128574 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae52b57-ec02-4131-886b-1392f19e2e4c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:43.130051 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae52b57-ec02-4131-886b-1392f19e2e4c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:43.140965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-0ae52b57-ec02-4131-886b-1392f19e2e4c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:20:43.140965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:43.140965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:43.140965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:43.140965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:43.140965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:43.140965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:43.140965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:43.140965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:20:43.140965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:43.140965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:43.140965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:43.140965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:43.140965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:43.140965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:43.140965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:43.142834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:43.142834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:43.142834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:43.142834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:43.142834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:43.142834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:43.142834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:43.142834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:43.142834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:43.142834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:43.142834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:43.142834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:43.142834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:43.142834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:43.142834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:43.142834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:43.142834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:43.144553 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:43.144553 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:43.144553 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:43.144553 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:43.144553 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:43.144553 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:43.144553 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:43.144553 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:43.144553 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:43.144553 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:43.144553 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:43.144553 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:43.144553 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:20:43.144553 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:43.144553 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 428/866] 10.222.0.52 () {56 vars in 1132 bytes} [Thu Sep 1 16:20:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:43.159029 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae52b57-ec02-4131-886b-1392f19e2e4c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:43.276731 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b9c7d-500a-43e2-90e9-2213627037f2 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:43.329337 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae52b57-ec02-4131-886b-1392f19e2e4c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:43.347703 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa627d-22bc-4a4e-91ac-ec2176dcbb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:43.348836 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa627d-22bc-4a4e-91ac-ec2176dcbb96 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:43.349239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa627d-22bc-4a4e-91ac-ec2176dcbb96 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:43.349628 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa627d-22bc-4a4e-91ac-ec2176dcbb96 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:43.350785 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa627d-22bc-4a4e-91ac-ec2176dcbb96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:43.351234 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa627d-22bc-4a4e-91ac-ec2176dcbb96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:43.353522 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa627d-22bc-4a4e-91ac-ec2176dcbb96 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:43.372095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328aefd8-d07b-4af5-9d15-2d1c6f94bc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:43.372695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328aefd8-d07b-4af5-9d15-2d1c6f94bc99 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:43.372979 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328aefd8-d07b-4af5-9d15-2d1c6f94bc99 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:43.373973 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328aefd8-d07b-4af5-9d15-2d1c6f94bc99 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:43.374646 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328aefd8-d07b-4af5-9d15-2d1c6f94bc99 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:43.374949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328aefd8-d07b-4af5-9d15-2d1c6f94bc99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:43.376419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328aefd8-d07b-4af5-9d15-2d1c6f94bc99 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:43.382224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 429/868] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Sep 1 16:20:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:43.382489 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 439/868] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:43.392570 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa627d-22bc-4a4e-91ac-ec2176dcbb96 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:43.393268 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328aefd8-d07b-4af5-9d15-2d1c6f94bc99 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:43.435440 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:43.489710 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:43.536109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa627d-22bc-4a4e-91ac-ec2176dcbb96 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:43.589258 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328aefd8-d07b-4af5-9d15-2d1c6f94bc99 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:43.591067 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af9d4f-e579-4107-b201-8e67b35a1bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:43.592544 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af9d4f-e579-4107-b201-8e67b35a1bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:43.593425 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af9d4f-e579-4107-b201-8e67b35a1bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:43.594135 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af9d4f-e579-4107-b201-8e67b35a1bc3 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:43.595901 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af9d4f-e579-4107-b201-8e67b35a1bc3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:43.596823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af9d4f-e579-4107-b201-8e67b35a1bc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:43.599722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af9d4f-e579-4107-b201-8e67b35a1bc3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:43.615698 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 440/869] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Sep 1 16:20:43 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:43.635306 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd5b5f-659f-4a80-a794-373d3e83a1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:43.635839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd5b5f-659f-4a80-a794-373d3e83a1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:43.636124 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd5b5f-659f-4a80-a794-373d3e83a1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:43.636403 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd5b5f-659f-4a80-a794-373d3e83a1c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:43.637235 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd5b5f-659f-4a80-a794-373d3e83a1c2 None admin] RBAC: Adding query filter params (role.id=93abdb875d35417d91e420a60ccafbd2, scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f, user.id=3c001a902faf4b3c8d8f23f2e017c706) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:43.638742 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd5b5f-659f-4a80-a794-373d3e83a1c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:43.639104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd5b5f-659f-4a80-a794-373d3e83a1c2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:43.646483 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 430/870] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:43 2022] GET /identity/v3/role_assignments?user.id=3c001a902faf4b3c8d8f23f2e017c706&scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f&role.id=93abdb875d35417d91e420a60ccafbd2 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:44.841827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ae6af-d237-4acf-8ddb-35367e75c91b None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:44.842514 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ae6af-d237-4acf-8ddb-35367e75c91b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:44.843259 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ae6af-d237-4acf-8ddb-35367e75c91b None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:44.846838 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 441/871] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:44.858070 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d6aa0-547b-46e7-b119-dfd42327b784 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:44.858627 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d6aa0-547b-46e7-b119-dfd42327b784 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:44.859042 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d6aa0-547b-46e7-b119-dfd42327b784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:44.890364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7d3d6aa0-547b-46e7-b119-dfd42327b784 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:44.891612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7d3d6aa0-547b-46e7-b119-dfd42327b784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:44.976754 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 431/872] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:45.259888 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ae6af-d237-4acf-8ddb-35367e75c91b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:45.413893 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:45.436610 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ae6af-d237-4acf-8ddb-35367e75c91b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:45.512175 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564d625-b6da-4c46-b6f6-b5c67063c7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:45.513732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564d625-b6da-4c46-b6f6-b5c67063c7ce None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:45.514527 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564d625-b6da-4c46-b6f6-b5c67063c7ce None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:45.515312 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564d625-b6da-4c46-b6f6-b5c67063c7ce None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:45.516880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564d625-b6da-4c46-b6f6-b5c67063c7ce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:45.520157 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564d625-b6da-4c46-b6f6-b5c67063c7ce None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:45.553010 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 442/873] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 1 16:20:45 2022] POST /identity/v3/services => generated 251 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:20:45.759018 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002d82e-0380-49ad-8ad4-91e262e22114 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:45.759279 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002d82e-0380-49ad-8ad4-91e262e22114 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:45.759605 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002d82e-0380-49ad-8ad4-91e262e22114 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:45.761957 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 432/874] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:20:45.772154 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078da5c-4c93-41eb-86ec-fca1712d1ebb None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:45.772543 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078da5c-4c93-41eb-86ec-fca1712d1ebb None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:45.773042 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078da5c-4c93-41eb-86ec-fca1712d1ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:45.806989 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e078da5c-4c93-41eb-86ec-fca1712d1ebb None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:45.809237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e078da5c-4c93-41eb-86ec-fca1712d1ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:45.959229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 443/875] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:45 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:46.465500 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002d82e-0380-49ad-8ad4-91e262e22114 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:46.506223 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bb524-2723-417b-a452-c007611676eb None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:46.506897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bb524-2723-417b-a452-c007611676eb None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:46.507379 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bb524-2723-417b-a452-c007611676eb None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:46.509326 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 444/876] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:46.515899 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3f385-130c-4642-8c24-fde2fb31c553 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:46.516584 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3f385-130c-4642-8c24-fde2fb31c553 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:46.517117 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3f385-130c-4642-8c24-fde2fb31c553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:46.538860 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-75d3f385-130c-4642-8c24-fde2fb31c553 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:46.540458 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-75d3f385-130c-4642-8c24-fde2fb31c553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:46.554525 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:46.643731 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002d82e-0380-49ad-8ad4-91e262e22114 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:46.707894 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e0b4b-2e60-4d00-ad18-e6045ed0b5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:46.708835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e0b4b-2e60-4d00-ad18-e6045ed0b5dc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:46.709416 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e0b4b-2e60-4d00-ad18-e6045ed0b5dc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:46.710008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e0b4b-2e60-4d00-ad18-e6045ed0b5dc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:46.711153 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e0b4b-2e60-4d00-ad18-e6045ed0b5dc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:46.714742 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e0b4b-2e60-4d00-ad18-e6045ed0b5dc None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:46.717601 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 445/877] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:46 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:46.742069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-1f9e0b4b-2e60-4d00-ad18-e6045ed0b5dc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:20:46.742069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:46.742069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:46.742069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:46.742069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:46.742069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:46.742069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:46.742069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:46.742069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:20:46.742069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:46.742069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:46.742069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:46.742069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:46.742069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:46.742069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:46.742069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:46.742069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:46.743987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:46.743987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:46.743987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:46.743987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:46.743987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:46.743987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:46.743987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:46.743987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:46.743987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:46.743987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:46.743987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:46.743987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:46.743987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:46.743987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:46.743987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:46.743987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:46.745678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:46.745678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:46.745678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:46.745678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:46.745678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:46.745678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:46.745678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:46.745678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:46.745678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:46.745678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:46.745678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:46.745678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:46.745678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:20:46.745678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:46.756816 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 433/878] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Sep 1 16:20:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:46.761923 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3f385-130c-4642-8c24-fde2fb31c553 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:46.784224 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:46.864641 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85813622-3deb-4ba5-a685-7cbd213fb313 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:46.864942 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85813622-3deb-4ba5-a685-7cbd213fb313 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:46.865248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85813622-3deb-4ba5-a685-7cbd213fb313 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:46.867000 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 434/879] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:20:46.874872 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968617e-6579-465b-b115-95996570dad7 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:46.875303 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968617e-6579-465b-b115-95996570dad7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:46.875684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968617e-6579-465b-b115-95996570dad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:46.900490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f968617e-6579-465b-b115-95996570dad7 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:46.902997 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f968617e-6579-465b-b115-95996570dad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:46.967463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3f385-130c-4642-8c24-fde2fb31c553 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:47.013119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea9630-e831-476b-b0be-557fbb08409a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:47.013793 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea9630-e831-476b-b0be-557fbb08409a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:47.014175 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea9630-e831-476b-b0be-557fbb08409a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:47.014552 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea9630-e831-476b-b0be-557fbb08409a None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:47.015713 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea9630-e831-476b-b0be-557fbb08409a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:47.015713 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea9630-e831-476b-b0be-557fbb08409a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:47.017281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea9630-e831-476b-b0be-557fbb08409a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:47.027979 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 446/880] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Sep 1 16:20:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:47.029835 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea9630-e831-476b-b0be-557fbb08409a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:47.037680 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 435/881] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:46 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:20:47.131422 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:47.153246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968617e-6579-465b-b115-95996570dad7 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:47.169580 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea9630-e831-476b-b0be-557fbb08409a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:47.210236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff6a09-db6e-42fb-ac5d-acd3b1a3ff1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:47.210859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff6a09-db6e-42fb-ac5d-acd3b1a3ff1e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:47.211167 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff6a09-db6e-42fb-ac5d-acd3b1a3ff1e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:47.211425 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff6a09-db6e-42fb-ac5d-acd3b1a3ff1e None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:47.212050 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff6a09-db6e-42fb-ac5d-acd3b1a3ff1e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:47.212350 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff6a09-db6e-42fb-ac5d-acd3b1a3ff1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:47.213817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff6a09-db6e-42fb-ac5d-acd3b1a3ff1e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:47.219580 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 447/882] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Sep 1 16:20:47 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:47.231193 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:47.357568 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968617e-6579-465b-b115-95996570dad7 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:47.400952 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130fd72-273c-4c06-84da-f4869fda62dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:47.402187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130fd72-273c-4c06-84da-f4869fda62dc None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:47.402477 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130fd72-273c-4c06-84da-f4869fda62dc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:47.402740 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130fd72-273c-4c06-84da-f4869fda62dc None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:47.403418 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130fd72-273c-4c06-84da-f4869fda62dc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:47.404892 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130fd72-273c-4c06-84da-f4869fda62dc None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:47.425654 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 436/883] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 1 16:20:47 2022] POST /identity/v3/services => generated 269 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:20:47.549903 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff6a09-db6e-42fb-ac5d-acd3b1a3ff1e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:47.700696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff6a09-db6e-42fb-ac5d-acd3b1a3ff1e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:47.746387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:47.753756 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5a50e-f6bb-421a-be97-0e08312cb21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:47.754415 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5a50e-f6bb-421a-be97-0e08312cb21a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:47.754689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5a50e-f6bb-421a-be97-0e08312cb21a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:47.754960 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5a50e-f6bb-421a-be97-0e08312cb21a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:47.767895 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5a50e-f6bb-421a-be97-0e08312cb21a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:47.773644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-30c5a50e-f6bb-421a-be97-0e08312cb21a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:20:47.773644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:47.773644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:47.773644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:47.773644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:47.773644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:47.773644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:47.773644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:47.773644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:47.773644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:47.773644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:47.773644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:47.773644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:47.773644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:47.773644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:47.773644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:47.775802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:47.775802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:47.775802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:47.775802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:47.775802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:47.775802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:47.775802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:47.775802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:47.775802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:47.775802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:47.775802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:47.775802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:47.775802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:47.775802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:47.775802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:47.775802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:47.778230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:47.778230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:47.778230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:47.778230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:47.778230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:47.778230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:47.778230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:47.778230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:47.778230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:47.778230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:47.778230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:20:47.778230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:47.778230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 448/884] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Sep 1 16:20:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:47.779576 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6317f-6c85-4225-8b36-acc899e78dea None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:47.779576 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6317f-6c85-4225-8b36-acc899e78dea None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:47.779576 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6317f-6c85-4225-8b36-acc899e78dea None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:47.782510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 437/885] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:20:47.786915 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c09d-0024-4eb3-b927-dc1d23bd2b02 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:47.787323 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c09d-0024-4eb3-b927-dc1d23bd2b02 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:47.787563 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c09d-0024-4eb3-b927-dc1d23bd2b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:47.792159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6317f-6c85-4225-8b36-acc899e78dea None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:47.810802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8468c09d-0024-4eb3-b927-dc1d23bd2b02 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:47.812150 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8468c09d-0024-4eb3-b927-dc1d23bd2b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:47.931488 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 449/886] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:47 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:20:48.015826 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:48.031842 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6317f-6c85-4225-8b36-acc899e78dea None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:48.102561 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fddc3-28a8-4ac3-b7ed-2261195e66ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:48.103644 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fddc3-28a8-4ac3-b7ed-2261195e66ad None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:48.104178 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fddc3-28a8-4ac3-b7ed-2261195e66ad None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:48.104694 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fddc3-28a8-4ac3-b7ed-2261195e66ad None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:48.105892 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1fddc3-28a8-4ac3-b7ed-2261195e66ad None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:48.106423 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1fddc3-28a8-4ac3-b7ed-2261195e66ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:48.109243 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1fddc3-28a8-4ac3-b7ed-2261195e66ad None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:48.130364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 438/887] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Sep 1 16:20:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:48.134849 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468c09d-0024-4eb3-b927-dc1d23bd2b02 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:48.297522 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468c09d-0024-4eb3-b927-dc1d23bd2b02 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:48.327034 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:48.342238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37509a50-5474-489b-81c0-5a002fcc8a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:48.343397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37509a50-5474-489b-81c0-5a002fcc8a0f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:48.343893 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37509a50-5474-489b-81c0-5a002fcc8a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:48.344363 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37509a50-5474-489b-81c0-5a002fcc8a0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:48.358012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37509a50-5474-489b-81c0-5a002fcc8a0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:48.359862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37509a50-5474-489b-81c0-5a002fcc8a0f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:48.364506 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fddc3-28a8-4ac3-b7ed-2261195e66ad None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:48.379986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-37509a50-5474-489b-81c0-5a002fcc8a0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:48.379986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:48.379986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:48.379986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:48.379986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:48.379986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:48.379986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:48.379986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:48.379986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:48.379986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:48.379986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:48.379986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:48.379986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:48.379986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:48.379986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:48.379986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:48.381075 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:48.381075 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:48.381075 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:48.381075 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:48.381075 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:48.381075 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:48.381075 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:48.381075 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:48.381075 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:48.381075 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:48.381075 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:48.381075 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:48.381075 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:48.381075 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:48.381075 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:48.381075 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:48.381075 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:48.381963 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:48.381963 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:48.381963 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:48.384347 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 450/888] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:48.394563 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37509a50-5474-489b-81c0-5a002fcc8a0f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:48.516613 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37509a50-5474-489b-81c0-5a002fcc8a0f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:48.559546 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ca330-44d9-47e8-baf4-14b45120847f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:48.560069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ca330-44d9-47e8-baf4-14b45120847f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:48.560345 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ca330-44d9-47e8-baf4-14b45120847f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:48.560658 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ca330-44d9-47e8-baf4-14b45120847f None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:48.561300 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ca330-44d9-47e8-baf4-14b45120847f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:48.561599 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ca330-44d9-47e8-baf4-14b45120847f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:48.563235 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ca330-44d9-47e8-baf4-14b45120847f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:48.576166 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fddc3-28a8-4ac3-b7ed-2261195e66ad None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:48.582408 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 451/889] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:48.591329 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ca330-44d9-47e8-baf4-14b45120847f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:48.631121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1559ba1-1528-49c4-b6e8-6c55b6428d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:48.631770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1559ba1-1528-49c4-b6e8-6c55b6428d11 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:48.632057 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1559ba1-1528-49c4-b6e8-6c55b6428d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:48.632328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1559ba1-1528-49c4-b6e8-6c55b6428d11 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:48.632956 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1559ba1-1528-49c4-b6e8-6c55b6428d11 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:48.634373 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1559ba1-1528-49c4-b6e8-6c55b6428d11 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:48.646401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-a1559ba1-1528-49c4-b6e8-6c55b6428d11 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:20:48.646401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:48.646401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:48.646401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:48.646401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:48.646401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:48.646401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:48.646401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:48.646401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:20:48.646401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:48.646401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:48.646401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:48.646401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:48.646401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:48.646401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:48.646401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:48.646401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:48.656708 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:48.656708 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:48.656708 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:48.656708 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:48.656708 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:48.656708 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:48.656708 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:48.656708 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:48.656708 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:48.656708 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:48.656708 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:48.656708 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:48.656708 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:48.656708 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:48.656708 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:48.656708 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:48.658387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:48.658387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:48.658387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:48.658387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:48.658387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:48.658387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:48.658387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:48.658387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:48.658387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:48.658387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:48.658387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:48.658387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:48.658387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:20:48.658387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:48.658387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 439/890] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 1 16:20:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:48.662576 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:48.663112 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1559ba1-1528-49c4-b6e8-6c55b6428d11 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:48.692837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:48.799962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ca330-44d9-47e8-baf4-14b45120847f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:48.807174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1559ba1-1528-49c4-b6e8-6c55b6428d11 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:48.861595 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41020914-dd5d-4641-9dd2-4ecb3b7a1d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:48.862278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41020914-dd5d-4641-9dd2-4ecb3b7a1d2c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:48.862560 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41020914-dd5d-4641-9dd2-4ecb3b7a1d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:48.862836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41020914-dd5d-4641-9dd2-4ecb3b7a1d2c None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:48.863497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41020914-dd5d-4641-9dd2-4ecb3b7a1d2c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:48.863809 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41020914-dd5d-4641-9dd2-4ecb3b7a1d2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:48.865810 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41020914-dd5d-4641-9dd2-4ecb3b7a1d2c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:48.872672 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 440/891] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 1 16:20:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:48.882236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bcb67c-dd39-48e8-b9e9-c9d30abd5736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:48.882641 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41020914-dd5d-4641-9dd2-4ecb3b7a1d2c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:48.883543 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bcb67c-dd39-48e8-b9e9-c9d30abd5736 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:48.884040 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bcb67c-dd39-48e8-b9e9-c9d30abd5736 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:48.884696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bcb67c-dd39-48e8-b9e9-c9d30abd5736 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:48.895953 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bcb67c-dd39-48e8-b9e9-c9d30abd5736 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:48.897987 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bcb67c-dd39-48e8-b9e9-c9d30abd5736 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:48.920866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-65bcb67c-dd39-48e8-b9e9-c9d30abd5736 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:20:48.920866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:48.920866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:48.920866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:48.920866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:48.920866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:48.920866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:48.920866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:48.920866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:48.920866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:48.920866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:48.920866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:48.920866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:48.920866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:48.920866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:48.920866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:48.921891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:48.921891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:48.921891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:48.921891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:48.921891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:48.921891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:48.921891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:48.921891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:48.921891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:48.921891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:48.921891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:48.921891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:48.921891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:48.921891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:48.921891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:48.921891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:48.921891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:48.921891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:48.922848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:48.922848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:48.922848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:48.922848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:48.922848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:48.922848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:48.922848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:48.922848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:48.922848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:20:48.922848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:48.930675 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 452/892] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Sep 1 16:20:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:48.933541 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bcb67c-dd39-48e8-b9e9-c9d30abd5736 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:49.029874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:49.070535 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41020914-dd5d-4641-9dd2-4ecb3b7a1d2c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:49.106321 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:49.122965 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bcb67c-dd39-48e8-b9e9-c9d30abd5736 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:49.130755 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624b8e6-0470-42af-a6ce-d0539508760c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:49.131382 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624b8e6-0470-42af-a6ce-d0539508760c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:49.131658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624b8e6-0470-42af-a6ce-d0539508760c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:49.131928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624b8e6-0470-42af-a6ce-d0539508760c None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:49.132579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624b8e6-0470-42af-a6ce-d0539508760c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:49.132919 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624b8e6-0470-42af-a6ce-d0539508760c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:49.134330 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624b8e6-0470-42af-a6ce-d0539508760c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:49.141661 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 441/893] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 1 16:20:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:49.151562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624b8e6-0470-42af-a6ce-d0539508760c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:49.188345 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de239043-7ed2-438b-93d7-f9a255355a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:49.189163 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de239043-7ed2-438b-93d7-f9a255355a9c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:49.189334 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de239043-7ed2-438b-93d7-f9a255355a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:49.189701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de239043-7ed2-438b-93d7-f9a255355a9c None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:49.191111 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de239043-7ed2-438b-93d7-f9a255355a9c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:49.191421 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de239043-7ed2-438b-93d7-f9a255355a9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:49.193119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de239043-7ed2-438b-93d7-f9a255355a9c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:49.224657 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 453/894] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Sep 1 16:20:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:49.228365 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de239043-7ed2-438b-93d7-f9a255355a9c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:49.362728 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624b8e6-0470-42af-a6ce-d0539508760c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:49.440007 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fcf68-1fba-4683-b3f4-b0946a2e94f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:49.441412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fcf68-1fba-4683-b3f4-b0946a2e94f3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:49.441891 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fcf68-1fba-4683-b3f4-b0946a2e94f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:49.442425 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fcf68-1fba-4683-b3f4-b0946a2e94f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:49.444214 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fcf68-1fba-4683-b3f4-b0946a2e94f3 None admin] RBAC: Adding query filter params (interface=public, service_id=562f8b0850084682ab12fdcbd00822de, region_id=RegionOne) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:49.444819 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fcf68-1fba-4683-b3f4-b0946a2e94f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:49.449323 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fcf68-1fba-4683-b3f4-b0946a2e94f3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:49.452800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de239043-7ed2-438b-93d7-f9a255355a9c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:49.464688 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 442/895] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Sep 1 16:20:49 2022] GET /identity/v3/endpoints?service_id=562f8b0850084682ab12fdcbd00822de&interface=public®ion_id=RegionOne => generated 194 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:49.474866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fcf68-1fba-4683-b3f4-b0946a2e94f3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:49.512689 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:49.535231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf790f9-ce5c-4809-b405-46ff03b6c0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:49.536392 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf790f9-ce5c-4809-b405-46ff03b6c0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:49.537008 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf790f9-ce5c-4809-b405-46ff03b6c0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:49.537576 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf790f9-ce5c-4809-b405-46ff03b6c0d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:49.586219 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:49.688261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fcf68-1fba-4683-b3f4-b0946a2e94f3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:49.701441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf790f9-ce5c-4809-b405-46ff03b6c0d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:49.704350 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf790f9-ce5c-4809-b405-46ff03b6c0d6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:49.732382 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe819af-a51d-4f98-b8d4-c150c20a822a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:49.733051 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe819af-a51d-4f98-b8d4-c150c20a822a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:49.733325 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe819af-a51d-4f98-b8d4-c150c20a822a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:49.733591 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe819af-a51d-4f98-b8d4-c150c20a822a None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:49.734230 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe819af-a51d-4f98-b8d4-c150c20a822a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:49.735909 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe819af-a51d-4f98-b8d4-c150c20a822a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:49.748692 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 443/896] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Sep 1 16:20:49 2022] GET /identity/v3/services => generated 1268 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:20:49.748692 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b22092-f448-487d-b7a3-813b55400ae4 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:49.748692 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b22092-f448-487d-b7a3-813b55400ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:49.748692 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b22092-f448-487d-b7a3-813b55400ae4 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:49.752975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 444/897] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:49.753277 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799b824-619c-41ef-a68d-084cacbd02fd None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:49.753445 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799b824-619c-41ef-a68d-084cacbd02fd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:49.753695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799b824-619c-41ef-a68d-084cacbd02fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:49.774654 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6799b824-619c-41ef-a68d-084cacbd02fd None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:49.775933 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6799b824-619c-41ef-a68d-084cacbd02fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:49.884936 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 445/898] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:49.943557 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 454/899] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:49 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 712 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 16:20:49.950412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799b824-619c-41ef-a68d-084cacbd02fd None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:49.967686 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:50.164731 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799b824-619c-41ef-a68d-084cacbd02fd None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:50.173396 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf790f9-ce5c-4809-b405-46ff03b6c0d6 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:50.227104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230b4de-6e3b-4d83-a831-aa7a29eb36c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:50.227854 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230b4de-6e3b-4d83-a831-aa7a29eb36c7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:50.228194 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230b4de-6e3b-4d83-a831-aa7a29eb36c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:50.228677 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230b4de-6e3b-4d83-a831-aa7a29eb36c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:50.240006 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:50.244489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230b4de-6e3b-4d83-a831-aa7a29eb36c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:50.246993 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230b4de-6e3b-4d83-a831-aa7a29eb36c7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:50.267845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-8230b4de-6e3b-4d83-a831-aa7a29eb36c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:50.267845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:50.267845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:50.267845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:50.267845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:50.267845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:50.267845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:50.267845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:50.267845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:50.267845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:50.267845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:50.267845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:50.267845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:50.267845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:50.267845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:50.267845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:50.270858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:50.270858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:50.270858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:50.270858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:50.270858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:50.270858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:50.270858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:50.270858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:50.270858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:50.270858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:50.270858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:50.270858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:50.270858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:50.270858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:50.270858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:50.270858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:50.270858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:50.274140 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:50.274140 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:50.274140 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:50.277089 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 446/900] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:50.279272 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fddff-b41e-456b-b8a0-5b59ae5568f0 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:50.280249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fddff-b41e-456b-b8a0-5b59ae5568f0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:50.280249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fddff-b41e-456b-b8a0-5b59ae5568f0 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:50.282871 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 447/901] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:50.292718 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fddff-b41e-456b-b8a0-5b59ae5568f0 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:50.305257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf790f9-ce5c-4809-b405-46ff03b6c0d6 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:50.358204 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4caae-c7b9-4385-ad0b-d6ebd6107fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:50.359175 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4caae-c7b9-4385-ad0b-d6ebd6107fe4 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:50.359643 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4caae-c7b9-4385-ad0b-d6ebd6107fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:50.360119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4caae-c7b9-4385-ad0b-d6ebd6107fe4 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:50.361055 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4caae-c7b9-4385-ad0b-d6ebd6107fe4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:50.362826 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4caae-c7b9-4385-ad0b-d6ebd6107fe4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:50.384966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 455/902] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 1 16:20:50 2022] POST /identity/v3/services => generated 241 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:20:50.386599 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:50.387411 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb7ff6-4856-4ceb-8c73-02be7fa50bc8 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:50.387879 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb7ff6-4856-4ceb-8c73-02be7fa50bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:50.388291 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb7ff6-4856-4ceb-8c73-02be7fa50bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:50.416098 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-95fb7ff6-4856-4ceb-8c73-02be7fa50bc8 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:50.418699 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-95fb7ff6-4856-4ceb-8c73-02be7fa50bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:50.517583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fddff-b41e-456b-b8a0-5b59ae5568f0 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:50.581133 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 456/903] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:50.603888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fa83f-e028-40bf-81fb-7eade1543862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:50.606348 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fa83f-e028-40bf-81fb-7eade1543862 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:50.606348 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fa83f-e028-40bf-81fb-7eade1543862 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:50.606679 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fa83f-e028-40bf-81fb-7eade1543862 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:50.607888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089fa83f-e028-40bf-81fb-7eade1543862 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:50.608417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089fa83f-e028-40bf-81fb-7eade1543862 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:50.611225 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089fa83f-e028-40bf-81fb-7eade1543862 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:50.636061 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 448/904] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:50.645071 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb7ff6-4856-4ceb-8c73-02be7fa50bc8 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:50.737422 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:50.844717 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb7ff6-4856-4ceb-8c73-02be7fa50bc8 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:50.915027 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fa296-987a-4474-b950-a4ed44dd8d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:50.916065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fa296-987a-4474-b950-a4ed44dd8d4d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:50.916482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fa296-987a-4474-b950-a4ed44dd8d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:50.916999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fa296-987a-4474-b950-a4ed44dd8d4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:50.929570 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8fa296-987a-4474-b950-a4ed44dd8d4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:50.932210 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8fa296-987a-4474-b950-a4ed44dd8d4d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:50.954817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-1a8fa296-987a-4474-b950-a4ed44dd8d4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:50.954817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:50.954817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:50.954817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:50.954817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:50.954817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:50.954817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:50.954817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:50.954817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:50.954817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:50.954817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:50.954817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:50.954817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:50.954817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:50.954817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:50.955775 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:50.955775 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:50.955775 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:50.955775 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:50.955775 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:50.955775 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:50.955775 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:50.955775 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:50.955775 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:50.955775 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:50.955775 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:50.955775 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:50.955775 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:50.955775 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:50.955775 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:50.955775 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:50.955775 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:50.956697 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:50.956697 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:50.956697 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:50.956697 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:50.956697 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:50.956697 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:50.956697 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:50.956697 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:50.960896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 457/905] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:50.965091 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fa83f-e028-40bf-81fb-7eade1543862 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:51.071103 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fa296-987a-4474-b950-a4ed44dd8d4d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:51.175553 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fa83f-e028-40bf-81fb-7eade1543862 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:51.206742 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:51.261088 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82318f-ef33-4890-8c37-ecabe6fb1951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:51.263031 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82318f-ef33-4890-8c37-ecabe6fb1951 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:51.263908 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82318f-ef33-4890-8c37-ecabe6fb1951 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:51.265232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82318f-ef33-4890-8c37-ecabe6fb1951 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:51.266578 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82318f-ef33-4890-8c37-ecabe6fb1951 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:51.267113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82318f-ef33-4890-8c37-ecabe6fb1951 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:51.269976 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82318f-ef33-4890-8c37-ecabe6fb1951 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:51.300677 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 449/906] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:51.304753 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82318f-ef33-4890-8c37-ecabe6fb1951 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:51.315402 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fa296-987a-4474-b950-a4ed44dd8d4d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:51.319240 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:51.389788 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7ae4c-1dec-4542-83bf-5730b6003924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:51.391788 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7ae4c-1dec-4542-83bf-5730b6003924 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:51.393094 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7ae4c-1dec-4542-83bf-5730b6003924 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:51.393814 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7ae4c-1dec-4542-83bf-5730b6003924 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:51.395127 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7ae4c-1dec-4542-83bf-5730b6003924 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:51.398208 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7ae4c-1dec-4542-83bf-5730b6003924 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:51.417648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-6ab7ae4c-1dec-4542-83bf-5730b6003924 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:20:51.417648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:51.417648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:51.417648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:51.417648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:51.417648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:51.417648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:51.417648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:51.417648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:20:51.417648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:51.417648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:51.417648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:51.417648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:51.417648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:51.417648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:51.417648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:51.419722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:51.419722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:51.419722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:51.419722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:51.419722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:51.419722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:51.419722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:51.419722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:51.419722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:51.419722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:51.419722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:51.419722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:51.419722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:51.419722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:51.419722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:51.419722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:51.419722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:51.421546 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:51.421546 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:51.421546 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:51.421546 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:51.421546 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:51.421546 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:51.421546 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:51.421546 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:51.421546 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:51.421546 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:51.421546 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:51.421546 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:51.421546 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:20:51.421546 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:51.426365 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 458/907] 10.222.0.52 () {56 vars in 1132 bytes} [Thu Sep 1 16:20:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:51.437114 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7ae4c-1dec-4542-83bf-5730b6003924 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:51.543070 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82318f-ef33-4890-8c37-ecabe6fb1951 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:51.623239 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea595e-0655-4b5c-9631-ed5e54d6924a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:51.624858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea595e-0655-4b5c-9631-ed5e54d6924a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:51.625701 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea595e-0655-4b5c-9631-ed5e54d6924a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:51.626448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea595e-0655-4b5c-9631-ed5e54d6924a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:51.628529 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea595e-0655-4b5c-9631-ed5e54d6924a None admin] RBAC: Adding query filter params (role.id=dd6eda7c9f7d4778ab381591e492859d, scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f, user.id=3c001a902faf4b3c8d8f23f2e017c706) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:51.629563 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea595e-0655-4b5c-9631-ed5e54d6924a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:51.632949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea595e-0655-4b5c-9631-ed5e54d6924a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:51.653383 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 450/908] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:51 2022] GET /identity/v3/role_assignments?user.id=3c001a902faf4b3c8d8f23f2e017c706&scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f&role.id=dd6eda7c9f7d4778ab381591e492859d => generated 259 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:51.669539 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7ae4c-1dec-4542-83bf-5730b6003924 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:51.749238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025225e3-a4d9-4807-a63e-7715fe011b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:51.750329 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025225e3-a4d9-4807-a63e-7715fe011b8a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:51.750832 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025225e3-a4d9-4807-a63e-7715fe011b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:51.751327 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025225e3-a4d9-4807-a63e-7715fe011b8a None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:51.752589 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025225e3-a4d9-4807-a63e-7715fe011b8a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:51.753174 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025225e3-a4d9-4807-a63e-7715fe011b8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:51.756013 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025225e3-a4d9-4807-a63e-7715fe011b8a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:51.768239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 459/909] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Sep 1 16:20:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:51.778799 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea595e-0655-4b5c-9631-ed5e54d6924a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:51.865795 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:51.990917 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea595e-0655-4b5c-9631-ed5e54d6924a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:52.035234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb48ef4-6681-4df5-8fcf-8d72b1b2ae8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:52.036269 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb48ef4-6681-4df5-8fcf-8d72b1b2ae8d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:52.036815 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb48ef4-6681-4df5-8fcf-8d72b1b2ae8d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:52.037298 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb48ef4-6681-4df5-8fcf-8d72b1b2ae8d None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:52.038203 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb48ef4-6681-4df5-8fcf-8d72b1b2ae8d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:52.038724 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb48ef4-6681-4df5-8fcf-8d72b1b2ae8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:52.040393 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb48ef4-6681-4df5-8fcf-8d72b1b2ae8d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:52.053788 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 451/910] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Sep 1 16:20:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:52.072742 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025225e3-a4d9-4807-a63e-7715fe011b8a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:52.139914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:52.264876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025225e3-a4d9-4807-a63e-7715fe011b8a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:52.306580 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75110178-366f-467d-9bca-8f9512aaed3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:52.308161 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75110178-366f-467d-9bca-8f9512aaed3f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:52.308697 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75110178-366f-467d-9bca-8f9512aaed3f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:52.309222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75110178-366f-467d-9bca-8f9512aaed3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:52.310190 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75110178-366f-467d-9bca-8f9512aaed3f None admin] RBAC: Adding query filter params (interface=public, service_id=927cfc2a940445f3ab66cc7cd0cc74aa, region_id=RegionOne) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:52.310708 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75110178-366f-467d-9bca-8f9512aaed3f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:52.312328 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75110178-366f-467d-9bca-8f9512aaed3f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:52.319219 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 460/911] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Sep 1 16:20:52 2022] GET /identity/v3/endpoints?service_id=927cfc2a940445f3ab66cc7cd0cc74aa&interface=public®ion_id=RegionOne => generated 194 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:52.328933 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb48ef4-6681-4df5-8fcf-8d72b1b2ae8d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:52.495834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb48ef4-6681-4df5-8fcf-8d72b1b2ae8d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:52.497829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:52.568731 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a1139-645b-450a-ab45-ed20a33dd6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:52.570086 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a1139-645b-450a-ab45-ed20a33dd6f7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:52.570776 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a1139-645b-450a-ab45-ed20a33dd6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:52.571492 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a1139-645b-450a-ab45-ed20a33dd6f7 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:52.572938 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a1139-645b-450a-ab45-ed20a33dd6f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:52.576351 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a1139-645b-450a-ab45-ed20a33dd6f7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:52.589353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 452/912] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Sep 1 16:20:52 2022] GET /identity/v3/services => generated 1497 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:20:52.596677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf06f4a-434e-42f0-baec-c03f80299952 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:52.596677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf06f4a-434e-42f0-baec-c03f80299952 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:52.596677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf06f4a-434e-42f0-baec-c03f80299952 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:52.600680 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 461/913] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:52.603913 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23faf109-e824-4bd1-81fe-d54253beddf7 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:52.604181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23faf109-e824-4bd1-81fe-d54253beddf7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:52.604676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23faf109-e824-4bd1-81fe-d54253beddf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:52.629694 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-23faf109-e824-4bd1-81fe-d54253beddf7 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:52.632262 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-23faf109-e824-4bd1-81fe-d54253beddf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:52.776853 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 453/914] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:53.051421 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac918e-f5bd-4cf5-934a-af9ce1f6fe3d None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:53.051966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac918e-f5bd-4cf5-934a-af9ce1f6fe3d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:53.052450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac918e-f5bd-4cf5-934a-af9ce1f6fe3d None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:53.056379 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 462/915] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:53.062132 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23faf109-e824-4bd1-81fe-d54253beddf7 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:53.064114 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ca106-a38f-411c-ab21-4531f8bd1f78 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:53.064590 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ca106-a38f-411c-ab21-4531f8bd1f78 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:53.065109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ca106-a38f-411c-ab21-4531f8bd1f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:53.095428 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-037ca106-a38f-411c-ab21-4531f8bd1f78 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:53.097525 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-037ca106-a38f-411c-ab21-4531f8bd1f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:53.180102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:53.189388 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23faf109-e824-4bd1-81fe-d54253beddf7 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:53.231830 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b82e3-02d8-4601-802e-4669af9e7f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:53.232698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b82e3-02d8-4601-802e-4669af9e7f8f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:53.232853 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 463/916] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:20:53.232991 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b82e3-02d8-4601-802e-4669af9e7f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:53.233262 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b82e3-02d8-4601-802e-4669af9e7f8f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:53.233851 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b82e3-02d8-4601-802e-4669af9e7f8f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:53.235270 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b82e3-02d8-4601-802e-4669af9e7f8f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:53.246073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-281b82e3-02d8-4601-802e-4669af9e7f8f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:20:53.246073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:53.246073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:53.246073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:53.246073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:53.246073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:53.246073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:53.246073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:53.246073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:20:53.246073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:53.246073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:53.246073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:53.246073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:53.246073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:53.246073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:53.246073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:53.246073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:53.248190 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:53.248190 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:53.248190 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:53.248190 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:53.248190 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:53.248190 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:53.248190 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:53.248190 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:53.248190 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:53.248190 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:53.248190 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:53.248190 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:53.248190 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:53.248190 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:53.248190 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:53.248190 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:53.249787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:53.249787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:53.249787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:53.249787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:53.249787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:53.249787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:53.249787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:53.249787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:53.249787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:53.249787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:53.249787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:53.249787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:53.249787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:20:53.249787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:53.249787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 454/917] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Sep 1 16:20:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:53.256679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ca106-a38f-411c-ab21-4531f8bd1f78 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:53.284551 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:53.411587 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ca106-a38f-411c-ab21-4531f8bd1f78 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:53.455397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d116c-ea6a-4230-a5d8-015a03c0720b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:53.456019 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d116c-ea6a-4230-a5d8-015a03c0720b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:53.456293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d116c-ea6a-4230-a5d8-015a03c0720b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:53.456560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d116c-ea6a-4230-a5d8-015a03c0720b None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:53.457250 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d116c-ea6a-4230-a5d8-015a03c0720b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:53.457554 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d116c-ea6a-4230-a5d8-015a03c0720b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:53.459181 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d116c-ea6a-4230-a5d8-015a03c0720b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:53.465368 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 464/918] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Sep 1 16:20:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:53.471156 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b82e3-02d8-4601-802e-4669af9e7f8f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:53.596455 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b82e3-02d8-4601-802e-4669af9e7f8f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:53.640157 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b7772-6ef0-41de-b401-f3c518a5a6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:53.641205 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b7772-6ef0-41de-b401-f3c518a5a6e9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:53.641658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b7772-6ef0-41de-b401-f3c518a5a6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:53.642087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b7772-6ef0-41de-b401-f3c518a5a6e9 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:53.642908 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b7772-6ef0-41de-b401-f3c518a5a6e9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:53.643369 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b7772-6ef0-41de-b401-f3c518a5a6e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:53.645012 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b7772-6ef0-41de-b401-f3c518a5a6e9 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:53.651645 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 455/919] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Sep 1 16:20:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:53.657943 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d116c-ea6a-4230-a5d8-015a03c0720b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:53.684005 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b7772-6ef0-41de-b401-f3c518a5a6e9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:53.741392 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:53.770079 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:53.785476 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d116c-ea6a-4230-a5d8-015a03c0720b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:53.826951 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff72a9-3407-47b8-9a43-cb6e4fca02d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:53.827581 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff72a9-3407-47b8-9a43-cb6e4fca02d3 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:53.827854 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff72a9-3407-47b8-9a43-cb6e4fca02d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:53.828122 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff72a9-3407-47b8-9a43-cb6e4fca02d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:53.828909 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff72a9-3407-47b8-9a43-cb6e4fca02d3 None admin] RBAC: Adding query filter params (interface=public, service_id=09898bcd68bf4aba93d6d234e9fc3698, region_id=RegionOne) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:53.829214 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff72a9-3407-47b8-9a43-cb6e4fca02d3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:53.830641 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff72a9-3407-47b8-9a43-cb6e4fca02d3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:53.837011 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 465/920] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Sep 1 16:20:53 2022] GET /identity/v3/endpoints?service_id=09898bcd68bf4aba93d6d234e9fc3698&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:53.843475 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff72a9-3407-47b8-9a43-cb6e4fca02d3 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:53.897978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b7772-6ef0-41de-b401-f3c518a5a6e9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:53.956271 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bac6f9-c684-457f-bf12-71f5b0321140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:53.957314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bac6f9-c684-457f-bf12-71f5b0321140 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:53.957797 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bac6f9-c684-457f-bf12-71f5b0321140 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:53.958276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bac6f9-c684-457f-bf12-71f5b0321140 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:53.959423 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bac6f9-c684-457f-bf12-71f5b0321140 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:53.962247 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bac6f9-c684-457f-bf12-71f5b0321140 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:53.980055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-24bac6f9-c684-457f-bf12-71f5b0321140 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:20:53.980055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:53.980055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:53.980055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:53.980055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:53.980055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:53.980055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:53.980055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:53.980055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:20:53.980055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:53.980055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:53.980055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:53.980055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:53.980055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:53.980055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:53.980055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:53.980055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:53.981163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:53.981163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:53.981163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:53.981163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:53.981163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:53.981163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:53.981163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:53.981163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:53.981163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:53.981163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:53.981163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:53.981163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:53.981163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:53.981163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:53.981163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:53.981163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:53.981976 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:53.981976 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:53.981976 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:53.981976 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:53.981976 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:53.981976 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:53.981976 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:53.981976 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:53.981976 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:53.981976 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:53.981976 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:53.981976 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:53.981976 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:20:53.981976 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:53.988805 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 456/921] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 1 16:20:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:53.991317 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218aa9e-d442-4799-9f17-1b5cf9f96c36 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:53.991988 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218aa9e-d442-4799-9f17-1b5cf9f96c36 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:53.992285 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218aa9e-d442-4799-9f17-1b5cf9f96c36 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:53.996058 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 457/922] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:53.997450 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218aa9e-d442-4799-9f17-1b5cf9f96c36 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:54.011934 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff72a9-3407-47b8-9a43-cb6e4fca02d3 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:54.059656 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48329ed5-c9ce-4e1b-bdce-9c1189bfa7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:54.061201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48329ed5-c9ce-4e1b-bdce-9c1189bfa7cf None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:54.061721 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48329ed5-c9ce-4e1b-bdce-9c1189bfa7cf None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:54.062244 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48329ed5-c9ce-4e1b-bdce-9c1189bfa7cf None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:54.063253 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48329ed5-c9ce-4e1b-bdce-9c1189bfa7cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:54.065066 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48329ed5-c9ce-4e1b-bdce-9c1189bfa7cf None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:54.072587 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 466/923] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Sep 1 16:20:53 2022] GET /identity/v3/services => generated 1497 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:20:54.074917 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602d717-0a61-4eca-9b71-808b252fc9b5 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:54.075405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602d717-0a61-4eca-9b71-808b252fc9b5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:54.075878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602d717-0a61-4eca-9b71-808b252fc9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:54.104904 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-7602d717-0a61-4eca-9b71-808b252fc9b5 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:54.106691 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7602d717-0a61-4eca-9b71-808b252fc9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:54.121010 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:54.165807 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:54.195361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218aa9e-d442-4799-9f17-1b5cf9f96c36 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:54.201636 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 467/924] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:54.267800 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045df16-dac7-4606-ab77-13fd35a69828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:54.268797 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045df16-dac7-4606-ab77-13fd35a69828 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:54.269265 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045df16-dac7-4606-ab77-13fd35a69828 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:54.269756 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045df16-dac7-4606-ab77-13fd35a69828 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:54.270987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045df16-dac7-4606-ab77-13fd35a69828 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:54.271505 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045df16-dac7-4606-ab77-13fd35a69828 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:54.274213 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045df16-dac7-4606-ab77-13fd35a69828 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:54.284804 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 458/925] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 1 16:20:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:54.292532 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602d717-0a61-4eca-9b71-808b252fc9b5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:54.418588 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602d717-0a61-4eca-9b71-808b252fc9b5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:54.462215 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b1792-65cb-49f8-89db-265dc435707c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:54.463409 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b1792-65cb-49f8-89db-265dc435707c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:54.464003 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b1792-65cb-49f8-89db-265dc435707c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:54.464482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b1792-65cb-49f8-89db-265dc435707c None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:54.465563 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b1792-65cb-49f8-89db-265dc435707c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:54.466090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b1792-65cb-49f8-89db-265dc435707c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:54.467758 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b1792-65cb-49f8-89db-265dc435707c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:54.474282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 468/926] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 1 16:20:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:54.481753 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045df16-dac7-4606-ab77-13fd35a69828 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:54.584202 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b1792-65cb-49f8-89db-265dc435707c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:54.612236 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045df16-dac7-4606-ab77-13fd35a69828 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:54.621301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:54.659670 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027f5f1-b703-4f3d-bfa8-16da7256cf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:54.661390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027f5f1-b703-4f3d-bfa8-16da7256cf1e None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:54.661948 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027f5f1-b703-4f3d-bfa8-16da7256cf1e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:54.662459 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027f5f1-b703-4f3d-bfa8-16da7256cf1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:54.663466 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027f5f1-b703-4f3d-bfa8-16da7256cf1e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:54.665821 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027f5f1-b703-4f3d-bfa8-16da7256cf1e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:54.704908 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 459/927] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:20:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:20:54.800459 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b1792-65cb-49f8-89db-265dc435707c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:54.880432 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f382da9-517a-4943-b03e-ed04f3624419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:54.881372 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f382da9-517a-4943-b03e-ed04f3624419 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:54.882008 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f382da9-517a-4943-b03e-ed04f3624419 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:54.882457 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f382da9-517a-4943-b03e-ed04f3624419 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:54.904147 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f382da9-517a-4943-b03e-ed04f3624419 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:54.913534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-6f382da9-517a-4943-b03e-ed04f3624419 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:20:54.913534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:54.913534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:54.913534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:54.913534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:54.913534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:54.913534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:54.913534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:54.913534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:54.913534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:54.913534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:54.913534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:54.913534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:54.913534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:54.913534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:54.913534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:54.915397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:54.915397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:54.915397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:54.915397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:54.915397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:54.915397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:54.915397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:54.915397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:54.915397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:54.915397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:54.915397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:54.915397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:54.915397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:54.915397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:54.915397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:54.915397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:54.917616 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:54.917616 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:54.917616 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:54.917616 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:54.917616 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:54.917616 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:54.917616 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:54.917616 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:54.917616 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:54.917616 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:54.917616 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:20:54.917616 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:54.917616 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 469/928] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Sep 1 16:20:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:54.926701 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027f5f1-b703-4f3d-bfa8-16da7256cf1e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:54.950505 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:55.139151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027f5f1-b703-4f3d-bfa8-16da7256cf1e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:55.209424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0991e-b1da-4669-a3ec-5273d310c86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:55.210419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0991e-b1da-4669-a3ec-5273d310c86d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:55.210888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0991e-b1da-4669-a3ec-5273d310c86d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:55.211353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0991e-b1da-4669-a3ec-5273d310c86d None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:55.212607 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0991e-b1da-4669-a3ec-5273d310c86d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:55.213171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0991e-b1da-4669-a3ec-5273d310c86d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:55.216387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0991e-b1da-4669-a3ec-5273d310c86d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:55.234347 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 460/929] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Sep 1 16:20:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:55.244320 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f382da9-517a-4943-b03e-ed04f3624419 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:55.387517 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:55.458983 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f382da9-517a-4943-b03e-ed04f3624419 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:55.529042 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ea44e-0c12-4071-8a97-786c382d4e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:55.530140 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ea44e-0c12-4071-8a97-786c382d4e0f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:55.530627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ea44e-0c12-4071-8a97-786c382d4e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:55.531117 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ea44e-0c12-4071-8a97-786c382d4e0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:55.553298 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ea44e-0c12-4071-8a97-786c382d4e0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:55.556049 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ea44e-0c12-4071-8a97-786c382d4e0f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:55.585739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-0e4ea44e-0c12-4071-8a97-786c382d4e0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:55.585739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:55.585739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:55.585739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:55.585739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:55.585739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:55.585739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:55.585739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:55.585739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:55.585739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:55.585739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:55.585739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:55.585739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:55.585739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:55.585739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:55.585739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:55.587641 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:55.587641 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:55.587641 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:55.587641 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:55.587641 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:55.587641 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:55.587641 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:55.587641 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:55.587641 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:55.587641 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:55.587641 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:55.587641 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:55.587641 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:55.587641 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:55.587641 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:55.587641 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:55.587641 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:55.589458 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:55.589458 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:55.589458 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:55.589458 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 470/930] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:55.598321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0991e-b1da-4669-a3ec-5273d310c86d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:55.751342 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:55.820076 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0991e-b1da-4669-a3ec-5273d310c86d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:55.891727 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00578c5-5fe2-444f-8e11-1467cbb39577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:55.892716 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00578c5-5fe2-444f-8e11-1467cbb39577 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:55.893162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00578c5-5fe2-444f-8e11-1467cbb39577 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:55.893596 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00578c5-5fe2-444f-8e11-1467cbb39577 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:55.894715 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00578c5-5fe2-444f-8e11-1467cbb39577 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:55.895187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00578c5-5fe2-444f-8e11-1467cbb39577 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:55.897642 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00578c5-5fe2-444f-8e11-1467cbb39577 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:55.921899 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 461/931] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:55.931771 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ea44e-0c12-4071-8a97-786c382d4e0f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:56.022774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57555c7-9667-4cbd-ba09-c6c246b7ae48 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:56.023677 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57555c7-9667-4cbd-ba09-c6c246b7ae48 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:56.024397 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57555c7-9667-4cbd-ba09-c6c246b7ae48 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:56.035199 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 462/932] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:20:56.038006 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469450d-805b-4be4-b885-cc688761c334 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:56.038908 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469450d-805b-4be4-b885-cc688761c334 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:56.039733 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469450d-805b-4be4-b885-cc688761c334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:56.091580 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9469450d-805b-4be4-b885-cc688761c334 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:56.094391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9469450d-805b-4be4-b885-cc688761c334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:56.132764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ea44e-0c12-4071-8a97-786c382d4e0f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:56.163880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:56.207613 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78b10d-2a01-415a-8736-7d7b1d8a5c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:56.208728 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78b10d-2a01-415a-8736-7d7b1d8a5c8c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:56.209224 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78b10d-2a01-415a-8736-7d7b1d8a5c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:56.209712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78b10d-2a01-415a-8736-7d7b1d8a5c8c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:56.224890 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78b10d-2a01-415a-8736-7d7b1d8a5c8c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:56.226674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78b10d-2a01-415a-8736-7d7b1d8a5c8c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:56.252673 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 463/933] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:20:56.253494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-4d78b10d-2a01-415a-8736-7d7b1d8a5c8c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:20:56.253494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:56.253494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:56.253494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:56.253494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:56.253494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:56.253494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:56.253494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:56.253494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:56.253494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:56.253494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:56.253494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:56.253494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:56.253494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:56.253494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:56.253494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:56.255176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:56.255176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:56.255176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:56.255176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:56.255176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:56.255176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:56.255176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:56.255176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:56.255176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:56.255176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:56.255176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:56.255176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:56.255176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:56.255176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:56.255176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:56.255176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:56.255176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:56.255176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:56.257049 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:56.257049 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:56.257049 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:56.257049 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:56.257049 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:56.257049 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:56.257049 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:56.257049 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:56.257049 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:20:56.257049 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:56.257049 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 471/934] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Sep 1 16:20:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:56.269241 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469450d-805b-4be4-b885-cc688761c334 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:56.399056 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:56.487406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469450d-805b-4be4-b885-cc688761c334 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:56.562603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbe682-0aff-4b1c-ad94-b8a4dede472e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:56.564122 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbe682-0aff-4b1c-ad94-b8a4dede472e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:56.564947 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbe682-0aff-4b1c-ad94-b8a4dede472e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:56.565680 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbe682-0aff-4b1c-ad94-b8a4dede472e None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:56.567630 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbe682-0aff-4b1c-ad94-b8a4dede472e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:56.568406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbe682-0aff-4b1c-ad94-b8a4dede472e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:56.571289 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbe682-0aff-4b1c-ad94-b8a4dede472e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:56.607555 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 464/935] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Sep 1 16:20:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:56.616444 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78b10d-2a01-415a-8736-7d7b1d8a5c8c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:56.755910 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbe682-0aff-4b1c-ad94-b8a4dede472e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:56.824274 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78b10d-2a01-415a-8736-7d7b1d8a5c8c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:56.891855 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3c68a-7b98-4c32-9be8-b7eb21c74c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:56.892933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3c68a-7b98-4c32-9be8-b7eb21c74c95 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:56.893470 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3c68a-7b98-4c32-9be8-b7eb21c74c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:56.893938 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3c68a-7b98-4c32-9be8-b7eb21c74c95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:56.917157 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa3c68a-7b98-4c32-9be8-b7eb21c74c95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:56.920296 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa3c68a-7b98-4c32-9be8-b7eb21c74c95 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:56.949823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-2aa3c68a-7b98-4c32-9be8-b7eb21c74c95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:56.949823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:56.949823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:56.949823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:56.949823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:56.949823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:56.949823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:56.949823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:56.949823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:56.949823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:56.949823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:56.949823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:56.949823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:56.949823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:56.949823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:56.949823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:56.951653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:56.951653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:56.951653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:56.951653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:56.951653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:56.951653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:56.951653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:56.951653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:56.951653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:56.951653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:56.951653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:56.951653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:56.951653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:56.951653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:56.951653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:56.951653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:56.951653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:56.953435 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:56.953435 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:56.953435 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:56.961278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbe682-0aff-4b1c-ad94-b8a4dede472e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:56.961534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 472/936] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:56.967596 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3c68a-7b98-4c32-9be8-b7eb21c74c95 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:57.003510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:57.030622 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:57.046413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9076e8-b68c-43c3-93a6-2fa960176d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:57.051142 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9076e8-b68c-43c3-93a6-2fa960176d7a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:57.051142 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9076e8-b68c-43c3-93a6-2fa960176d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:57.051142 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9076e8-b68c-43c3-93a6-2fa960176d7a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:57.051142 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9076e8-b68c-43c3-93a6-2fa960176d7a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:57.051789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9076e8-b68c-43c3-93a6-2fa960176d7a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:57.070121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-cc9076e8-b68c-43c3-93a6-2fa960176d7a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:20:57.070121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:57.070121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:57.070121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:57.070121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:57.070121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:57.070121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:57.070121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:57.070121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:20:57.070121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:57.070121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:57.070121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:57.070121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:57.070121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:57.070121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:57.070121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:57.071543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:57.071543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:57.071543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:57.071543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:57.071543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:57.071543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:57.071543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:57.071543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:57.071543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:57.071543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:57.071543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:57.071543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:57.071543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:57.071543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:57.071543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:57.071543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:57.071543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:57.073880 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:57.073880 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:57.073880 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:57.073880 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:57.073880 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:57.073880 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:57.073880 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:57.073880 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:57.073880 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:57.073880 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:57.073880 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:57.073880 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:57.073880 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:20:57.073880 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:57.084655 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 465/937] 10.222.0.52 () {56 vars in 1132 bytes} [Thu Sep 1 16:20:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:57.087909 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9076e8-b68c-43c3-93a6-2fa960176d7a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:57.177211 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3c68a-7b98-4c32-9be8-b7eb21c74c95 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:57.204006 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9076e8-b68c-43c3-93a6-2fa960176d7a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:57.220688 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21274e2a-88a8-442c-89ef-5b9640ff17b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:57.221323 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21274e2a-88a8-442c-89ef-5b9640ff17b7 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:57.221605 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21274e2a-88a8-442c-89ef-5b9640ff17b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:57.221877 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21274e2a-88a8-442c-89ef-5b9640ff17b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:57.222541 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21274e2a-88a8-442c-89ef-5b9640ff17b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:57.222845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21274e2a-88a8-442c-89ef-5b9640ff17b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:57.224666 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21274e2a-88a8-442c-89ef-5b9640ff17b7 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:57.239930 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 473/938] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:57.241210 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447bed5-de0b-4518-a962-14cf3813f248 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:57.241492 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447bed5-de0b-4518-a962-14cf3813f248 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:57.241777 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447bed5-de0b-4518-a962-14cf3813f248 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:57.248399 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 474/939] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:57.248986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0d627-ed5d-4049-bdf3-93cc022483db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:57.249368 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447bed5-de0b-4518-a962-14cf3813f248 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:57.249613 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0d627-ed5d-4049-bdf3-93cc022483db None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:57.250102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0d627-ed5d-4049-bdf3-93cc022483db None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:57.250205 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0d627-ed5d-4049-bdf3-93cc022483db None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:57.250798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0d627-ed5d-4049-bdf3-93cc022483db None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:57.251106 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0d627-ed5d-4049-bdf3-93cc022483db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:57.252544 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0d627-ed5d-4049-bdf3-93cc022483db None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:57.258880 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 466/940] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Sep 1 16:20:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:57.260224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23933f6-530e-4458-bdd2-e96428d9f71e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:57.260514 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23933f6-530e-4458-bdd2-e96428d9f71e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:57.260826 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23933f6-530e-4458-bdd2-e96428d9f71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:57.280502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d23933f6-530e-4458-bdd2-e96428d9f71e None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:57.281838 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d23933f6-530e-4458-bdd2-e96428d9f71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:57.332386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:57.362008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 467/941] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:57.363008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23933f6-530e-4458-bdd2-e96428d9f71e None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:57.378194 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:57.392998 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447bed5-de0b-4518-a962-14cf3813f248 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:57.437087 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f5fae-aa7c-44eb-9ba5-2a2c78b8063f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:57.437954 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f5fae-aa7c-44eb-9ba5-2a2c78b8063f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:57.438465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f5fae-aa7c-44eb-9ba5-2a2c78b8063f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:57.438822 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f5fae-aa7c-44eb-9ba5-2a2c78b8063f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:57.448270 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f5fae-aa7c-44eb-9ba5-2a2c78b8063f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:57.449879 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f5fae-aa7c-44eb-9ba5-2a2c78b8063f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:57.464462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-ca5f5fae-aa7c-44eb-9ba5-2a2c78b8063f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:57.464462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:57.464462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:57.464462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:57.464462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:57.464462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:57.464462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:57.464462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:57.464462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:57.464462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:57.464462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:57.464462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:57.464462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:57.464462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:57.464462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:57.465627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:57.465627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:57.465627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:57.465627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:57.465627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:57.465627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:57.465627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:57.465627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:57.465627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:57.465627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:57.465627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:57.465627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:57.465627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:57.465627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:57.465627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:57.465627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:57.465627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:57.466511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:57.466511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:57.466511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:57.466511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:57.466511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:57.466511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:57.466511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:57.466511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:20:57.466511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 475/942] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:57.473855 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f5fae-aa7c-44eb-9ba5-2a2c78b8063f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:57.513573 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23933f6-530e-4458-bdd2-e96428d9f71e None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:57.556363 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb235de-5409-4634-91a7-b4ed81ef00a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:57.556558 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb235de-5409-4634-91a7-b4ed81ef00a3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:57.556854 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb235de-5409-4634-91a7-b4ed81ef00a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:57.557758 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb235de-5409-4634-91a7-b4ed81ef00a3 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:57.558414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb235de-5409-4634-91a7-b4ed81ef00a3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:57.558714 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb235de-5409-4634-91a7-b4ed81ef00a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:57.560294 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb235de-5409-4634-91a7-b4ed81ef00a3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:57.571768 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 468/943] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Sep 1 16:20:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:57.572877 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb235de-5409-4634-91a7-b4ed81ef00a3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:57.595538 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f5fae-aa7c-44eb-9ba5-2a2c78b8063f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:57.625757 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:57.636586 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0125a03-5ae6-45dd-ab1b-aacfdfcbf08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:57.637939 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0125a03-5ae6-45dd-ab1b-aacfdfcbf08d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:57.638408 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0125a03-5ae6-45dd-ab1b-aacfdfcbf08d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:57.638882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0125a03-5ae6-45dd-ab1b-aacfdfcbf08d None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:57.639875 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0125a03-5ae6-45dd-ab1b-aacfdfcbf08d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:57.640377 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0125a03-5ae6-45dd-ab1b-aacfdfcbf08d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:57.642181 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0125a03-5ae6-45dd-ab1b-aacfdfcbf08d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:57.657306 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 476/944] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:57.665101 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0125a03-5ae6-45dd-ab1b-aacfdfcbf08d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:57.685103 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:57.711257 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb235de-5409-4634-91a7-b4ed81ef00a3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:57.753128 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0b889-cfe4-4f72-921e-54fe30dc64a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:57.753758 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0b889-cfe4-4f72-921e-54fe30dc64a8 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:57.754039 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0b889-cfe4-4f72-921e-54fe30dc64a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:57.754326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0b889-cfe4-4f72-921e-54fe30dc64a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:57.755033 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0b889-cfe4-4f72-921e-54fe30dc64a8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:57.756454 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0b889-cfe4-4f72-921e-54fe30dc64a8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:57.788658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 469/945] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:20:57 2022] POST /identity/v3/endpoints => generated 347 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:20:57.788658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0b889-cfe4-4f72-921e-54fe30dc64a8 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:57.844262 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0125a03-5ae6-45dd-ab1b-aacfdfcbf08d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:57.926542 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:57.939087 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dc123-67af-4e93-8df3-1aeaac4bf949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:57.940663 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dc123-67af-4e93-8df3-1aeaac4bf949 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:57.941303 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dc123-67af-4e93-8df3-1aeaac4bf949 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:57.942082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dc123-67af-4e93-8df3-1aeaac4bf949 None admin] PATH_INFO: `/v3/projects/43f5c22e38824a8b8dff2f9b4bc1df3f/users/3c001a902faf4b3c8d8f23f2e017c706/roles/dd6eda7c9f7d4778ab381591e492859d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:57.944865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0b889-cfe4-4f72-921e-54fe30dc64a8 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:57.948388 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dc123-67af-4e93-8df3-1aeaac4bf949 None admin] RBAC: Authorizing `identity:create_grant(project_id=43f5c22e38824a8b8dff2f9b4bc1df3f, user_id=3c001a902faf4b3c8d8f23f2e017c706, role_id=dd6eda7c9f7d4778ab381591e492859d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:57.951404 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dc123-67af-4e93-8df3-1aeaac4bf949 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:57.982130 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 477/946] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 1 16:20:57 2022] PUT /identity/v3/projects/43f5c22e38824a8b8dff2f9b4bc1df3f/users/3c001a902faf4b3c8d8f23f2e017c706/roles/dd6eda7c9f7d4778ab381591e492859d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:20:57.992549 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141ac9d-7dd1-4217-b114-00f04bb12252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:57.993247 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141ac9d-7dd1-4217-b114-00f04bb12252 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:57.993525 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141ac9d-7dd1-4217-b114-00f04bb12252 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:57.993892 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141ac9d-7dd1-4217-b114-00f04bb12252 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:57.994574 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141ac9d-7dd1-4217-b114-00f04bb12252 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:57.996562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141ac9d-7dd1-4217-b114-00f04bb12252 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:58.007411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-9141ac9d-7dd1-4217-b114-00f04bb12252 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:20:58.007411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:58.007411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:58.007411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:58.007411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:58.007411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:58.007411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:58.007411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:58.007411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:20:58.007411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:58.007411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:58.007411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:58.007411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:58.007411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:58.007411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:58.007411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:58.007411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:58.009310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:58.009310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:58.009310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:58.009310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:58.009310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:58.009310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:58.009310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:58.009310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:58.009310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:58.009310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:58.009310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:58.009310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:58.009310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:58.009310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:58.009310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:58.009310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:58.010975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:58.010975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:58.010975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:58.010975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:58.010975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:58.010975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:58.010975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:58.010975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:58.010975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:58.010975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:58.010975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:58.010975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:58.010975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:20:58.010975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:58.014533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 470/947] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Sep 1 16:20:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:58.015668 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dc123-67af-4e93-8df3-1aeaac4bf949 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:58.052461 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf79ede-bf87-4a10-a05a-e2323011b397 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:58.052766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf79ede-bf87-4a10-a05a-e2323011b397 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:58.053076 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf79ede-bf87-4a10-a05a-e2323011b397 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:58.054695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 471/948] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:58.061744 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d534ce1-9676-4084-b0c6-d1bc053e5005 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:58.062144 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d534ce1-9676-4084-b0c6-d1bc053e5005 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:58.062364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d534ce1-9676-4084-b0c6-d1bc053e5005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:58.089409 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7d534ce1-9676-4084-b0c6-d1bc053e5005 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:58.090477 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7d534ce1-9676-4084-b0c6-d1bc053e5005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:58.131722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:58.196679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dc123-67af-4e93-8df3-1aeaac4bf949 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:58.213928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 472/949] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:58.258367 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e0a0e-a814-43f9-aafc-786a81b56252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:58.259015 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e0a0e-a814-43f9-aafc-786a81b56252 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:58.259296 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e0a0e-a814-43f9-aafc-786a81b56252 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:58.259569 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e0a0e-a814-43f9-aafc-786a81b56252 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:58.260269 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e0a0e-a814-43f9-aafc-786a81b56252 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:58.260579 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e0a0e-a814-43f9-aafc-786a81b56252 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:58.262060 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e0a0e-a814-43f9-aafc-786a81b56252 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:58.271805 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 478/950] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Sep 1 16:20:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:58.281525 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d534ce1-9676-4084-b0c6-d1bc053e5005 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:58.387362 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:58.407394 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d534ce1-9676-4084-b0c6-d1bc053e5005 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:58.448753 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c997a23-dcef-4cff-b3a8-7b81b9e1fca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:58.449392 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c997a23-dcef-4cff-b3a8-7b81b9e1fca1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:58.449671 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c997a23-dcef-4cff-b3a8-7b81b9e1fca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:58.449941 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c997a23-dcef-4cff-b3a8-7b81b9e1fca1 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:58.450600 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c997a23-dcef-4cff-b3a8-7b81b9e1fca1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:58.450902 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c997a23-dcef-4cff-b3a8-7b81b9e1fca1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:58.452336 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c997a23-dcef-4cff-b3a8-7b81b9e1fca1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:58.458624 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 473/951] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Sep 1 16:20:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:58.469261 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e0a0e-a814-43f9-aafc-786a81b56252 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:58.601326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c997a23-dcef-4cff-b3a8-7b81b9e1fca1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:58.682379 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e0a0e-a814-43f9-aafc-786a81b56252 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:58.719974 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c997a23-dcef-4cff-b3a8-7b81b9e1fca1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:58.738654 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:58.751931 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50099d2e-a69b-45d3-8191-9f5a90a3fcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:58.753378 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50099d2e-a69b-45d3-8191-9f5a90a3fcb8 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:58.754185 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50099d2e-a69b-45d3-8191-9f5a90a3fcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:58.754977 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50099d2e-a69b-45d3-8191-9f5a90a3fcb8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:58.756545 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50099d2e-a69b-45d3-8191-9f5a90a3fcb8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:58.759491 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50099d2e-a69b-45d3-8191-9f5a90a3fcb8 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:58.762685 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0b928-4a6a-4e75-98e8-5134575eee83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:58.763315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0b928-4a6a-4e75-98e8-5134575eee83 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:58.763594 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0b928-4a6a-4e75-98e8-5134575eee83 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:58.763863 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0b928-4a6a-4e75-98e8-5134575eee83 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:58.764549 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0b928-4a6a-4e75-98e8-5134575eee83 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:58.766188 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0b928-4a6a-4e75-98e8-5134575eee83 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:58.769374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: WARNING keystone.server.flask.common [None req-c4f0b928-4a6a-4e75-98e8-5134575eee83 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 16:20:58.793929 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.sql.core [None req-c4f0b928-4a6a-4e75-98e8-5134575eee83 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 16:20:58.793929 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 16:20:58.793929 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [parameters: {'id': 'e68bed3407224c9cb847c54390968b6b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 16:20:58.793929 dv-cinder-852209-10-smb devstack@keystone.service[81459]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81459) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 16:20:58.801759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-c4f0b928-4a6a-4e75-98e8-5134575eee83 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e68bed3407224c9cb847c54390968b6b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e68bed3407224c9cb847c54390968b6b. Sep 01 16:20:58.801759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:58.801759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 16:20:58.801759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 16:20:58.801759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 16:20:58.801759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 16:20:58.801759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 16:20:58.801759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 16:20:58.801759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 16:20:58.801759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application conn.query(q) Sep 01 16:20:58.801759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 16:20:58.801759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 16:20:58.801759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 16:20:58.803244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application result.read() Sep 01 16:20:58.803244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 16:20:58.803244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 16:20:58.803244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 16:20:58.803244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 16:20:58.803244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 16:20:58.803244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 16:20:58.803244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 16:20:58.803244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 16:20:58.803244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 16:20:58.803244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:58.803244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 16:20:58.803244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:58.803244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:58.803244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 16:20:58.803244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 16:20:58.803244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 01 16:20:58.803244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 01 16:20:58.805138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 16:20:58.805138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application next(self.gen) Sep 01 16:20:58.805138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 16:20:58.805138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application yield resource Sep 01 16:20:58.805138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 16:20:58.805138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application next(self.gen) Sep 01 16:20:58.805138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 16:20:58.805138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 16:20:58.805138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 16:20:58.805138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 16:20:58.805138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 16:20:58.805138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise self.value Sep 01 16:20:58.805138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 16:20:58.805138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 16:20:58.805138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 16:20:58.805138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application session.commit() Sep 01 16:20:58.805138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 16:20:58.806046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 16:20:58.806046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 16:20:58.806046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 16:20:58.806046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 16:20:58.806046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self.session.flush() Sep 01 16:20:58.806046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 16:20:58.806046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 16:20:58.806046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 16:20:58.806046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 16:20:58.806046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 16:20:58.806046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application compat.raise_( Sep 01 16:20:58.806046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 16:20:58.806046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception Sep 01 16:20:58.806046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 16:20:58.806046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 16:20:58.806046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 16:20:58.806046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 16:20:58.807442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 16:20:58.807442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 16:20:58.807442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 16:20:58.807442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 16:20:58.807442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 16:20:58.807442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 16:20:58.807442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 16:20:58.807442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 16:20:58.807442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 16:20:58.807442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 16:20:58.807442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 16:20:58.807442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 16:20:58.807442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 16:20:58.807442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 16:20:58.807442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 16:20:58.808548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 16:20:58.808548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 16:20:58.808548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception Sep 01 16:20:58.808548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 16:20:58.808548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 16:20:58.808548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 16:20:58.808548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 16:20:58.808548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 16:20:58.808548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 16:20:58.808548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 16:20:58.808548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application conn.query(q) Sep 01 16:20:58.808548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 16:20:58.808548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 16:20:58.808548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 16:20:58.808548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application result.read() Sep 01 16:20:58.808548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 16:20:58.808548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 16:20:58.812176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 16:20:58.812176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 16:20:58.812176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 16:20:58.812176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 16:20:58.812176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 16:20:58.812176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 16:20:58.812176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 16:20:58.812176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 16:20:58.812176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [parameters: {'id': 'e68bed3407224c9cb847c54390968b6b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 16:20:58.812176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 16:20:58.812176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:58.812176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:58.812176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:58.812176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:58.812176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 01 16:20:58.815316 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 01 16:20:58.815316 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 16:20:58.815316 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 16:20:58.815316 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 01 16:20:58.815316 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:58.815316 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:58.815316 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:58.815316 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:58.815316 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:58.815316 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:58.815316 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:58.815316 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:58.815316 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:58.815316 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:58.815316 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:58.815316 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:58.815316 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:58.819968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:58.819968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 01 16:20:58.819968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 01 16:20:58.819968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:58.819968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:58.819968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 01 16:20:58.819968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 01 16:20:58.819968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e68bed3407224c9cb847c54390968b6b. Sep 01 16:20:58.819968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:58.819968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 474/952] 10.222.0.52 () {60 vars in 1140 bytes} [Thu Sep 1 16:20:58 2022] POST /identity/v3/projects => generated 262 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:58.819968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0b928-4a6a-4e75-98e8-5134575eee83 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:58.822410 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 479/953] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:20:58 2022] POST /identity/v3/endpoints => generated 349 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:20:58.828759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:58.941445 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0b928-4a6a-4e75-98e8-5134575eee83 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:58.997097 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b748585-49d3-48d5-bfa6-97af96ec327f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:58.998009 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b748585-49d3-48d5-bfa6-97af96ec327f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:58.998287 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b748585-49d3-48d5-bfa6-97af96ec327f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:58.998556 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b748585-49d3-48d5-bfa6-97af96ec327f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:59.007548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b748585-49d3-48d5-bfa6-97af96ec327f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:59.009374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b748585-49d3-48d5-bfa6-97af96ec327f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:59.022196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-7b748585-49d3-48d5-bfa6-97af96ec327f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:59.022196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:59.022196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:59.022196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:59.022196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:59.022196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:59.022196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:59.022196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:59.022196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:59.022196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:59.022196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:59.022196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:59.022196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:59.022196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:59.022196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:59.025504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:59.025504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:59.025504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:59.025504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:59.025504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:59.025504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:59.025504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:59.025504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:59.025504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:59.025504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:59.025504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:59.025504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:59.025504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:59.025504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:59.025504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:59.025504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:59.025504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:59.033062 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:59.033062 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:59.033062 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:59.033062 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:59.033062 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:59.033062 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:59.033062 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:59.033062 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:20:59.033062 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 475/954] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:59.035244 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50099d2e-a69b-45d3-8191-9f5a90a3fcb8 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:59.148507 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50099d2e-a69b-45d3-8191-9f5a90a3fcb8 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:59.190741 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04d9ec-60bf-4658-96d2-6c20d5b439d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:59.191368 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04d9ec-60bf-4658-96d2-6c20d5b439d9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:59.191790 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04d9ec-60bf-4658-96d2-6c20d5b439d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:59.192055 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04d9ec-60bf-4658-96d2-6c20d5b439d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:59.192761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04d9ec-60bf-4658-96d2-6c20d5b439d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:59.193012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04d9ec-60bf-4658-96d2-6c20d5b439d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:59.194447 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04d9ec-60bf-4658-96d2-6c20d5b439d9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:59.215292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 480/955] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Sep 1 16:20:59 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:00.135371 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e23c1-8ba9-42da-9e76-c50c439b418f None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:00.135925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e23c1-8ba9-42da-9e76-c50c439b418f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:00.135925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e23c1-8ba9-42da-9e76-c50c439b418f None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:00.137641 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 476/956] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:00.143528 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b16954-12de-4ded-af18-98575fb090c2 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:00.144493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b16954-12de-4ded-af18-98575fb090c2 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:00.145027 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b16954-12de-4ded-af18-98575fb090c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:00.165992 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a2b16954-12de-4ded-af18-98575fb090c2 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:00.168274 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a2b16954-12de-4ded-af18-98575fb090c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:00.221437 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:00.254883 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 481/957] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:00.533972 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e23c1-8ba9-42da-9e76-c50c439b418f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:00.612055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:00.700326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e23c1-8ba9-42da-9e76-c50c439b418f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:00.759683 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e40a93-8e38-41c0-b4d3-825e2e2d9e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:00.760951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e40a93-8e38-41c0-b4d3-825e2e2d9e89 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:00.761265 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e40a93-8e38-41c0-b4d3-825e2e2d9e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:00.761543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e40a93-8e38-41c0-b4d3-825e2e2d9e89 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:00.774613 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e40a93-8e38-41c0-b4d3-825e2e2d9e89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:21:00.780095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-d4e40a93-8e38-41c0-b4d3-825e2e2d9e89 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:21:00.780095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:00.780095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:00.780095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:00.780095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:00.780095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:00.780095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:00.780095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:00.780095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:00.780095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:00.780095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:00.780095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:00.780095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:21:00.780095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:21:00.780095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:21:00.780095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:21:00.781113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:21:00.781113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:21:00.781113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:21:00.781113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:21:00.781113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:00.781113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:00.781113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:00.781113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:00.781113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:00.781113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:00.781113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:00.781113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:00.781113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:00.781113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:00.781113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:00.781113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:00.781978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:00.781978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:00.781978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:00.781978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:00.781978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:21:00.781978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:21:00.781978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:21:00.781978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:21:00.781978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:21:00.781978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:21:00.781978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:21:00.781978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:00.781978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 477/958] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Sep 1 16:21:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:00.789422 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b16954-12de-4ded-af18-98575fb090c2 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:00.908847 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b16954-12de-4ded-af18-98575fb090c2 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:00.952333 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d29ce4-703e-4fb8-9c78-aee6a967fb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:00.952980 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d29ce4-703e-4fb8-9c78-aee6a967fb22 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:00.953255 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d29ce4-703e-4fb8-9c78-aee6a967fb22 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:00.953525 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d29ce4-703e-4fb8-9c78-aee6a967fb22 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:00.954201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d29ce4-703e-4fb8-9c78-aee6a967fb22 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:00.954500 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d29ce4-703e-4fb8-9c78-aee6a967fb22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:00.955889 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d29ce4-703e-4fb8-9c78-aee6a967fb22 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:00.965505 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 482/959] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Sep 1 16:21:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:00.971420 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e40a93-8e38-41c0-b4d3-825e2e2d9e89 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:01.101613 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e40a93-8e38-41c0-b4d3-825e2e2d9e89 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:01.118377 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ec254-e821-493a-8752-0bbe779ccbca None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:01.118873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ec254-e821-493a-8752-0bbe779ccbca None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:01.119400 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ec254-e821-493a-8752-0bbe779ccbca None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:01.128118 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:01.129165 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 483/960] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:01.131584 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67ae76-c977-462d-afa5-304f8fddc99a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:01.132126 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67ae76-c977-462d-afa5-304f8fddc99a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:01.132800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67ae76-c977-462d-afa5-304f8fddc99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:01.142319 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71123b3-f130-4460-b46a-d7d6b312183a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:01.143149 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71123b3-f130-4460-b46a-d7d6b312183a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:01.143296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71123b3-f130-4460-b46a-d7d6b312183a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:01.143658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71123b3-f130-4460-b46a-d7d6b312183a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:01.156202 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71123b3-f130-4460-b46a-d7d6b312183a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:01.157732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71123b3-f130-4460-b46a-d7d6b312183a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:01.168100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5b67ae76-c977-462d-afa5-304f8fddc99a None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:01.170268 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5b67ae76-c977-462d-afa5-304f8fddc99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:01.176125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-f71123b3-f130-4460-b46a-d7d6b312183a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:21:01.176125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:01.176125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:01.176125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:01.176125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:01.176125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:01.176125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:01.176125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:01.176125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:01.176125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:01.176125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:01.176125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:01.176125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:21:01.176125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:21:01.176125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:21:01.176125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:21:01.178485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:01.178485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:01.178485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:01.178485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:01.178485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:01.178485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:01.178485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:01.178485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:01.178485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:01.178485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:01.178485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:01.178485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:01.178485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:01.178485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:01.178485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:01.178485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:01.178485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:21:01.180587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:21:01.180587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:21:01.180587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:01.180587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 478/961] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:21:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:01.180587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c040f-76de-402d-8c45-a26b422ab979 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:01.180587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c040f-76de-402d-8c45-a26b422ab979 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:01.180587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c040f-76de-402d-8c45-a26b422ab979 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:01.182524 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 479/962] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:01.190060 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c040f-76de-402d-8c45-a26b422ab979 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:01.218167 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:01.271221 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 484/963] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:01.272827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc26e4b-f0bf-4ae3-859a-4c9160a76ae5 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:01.273111 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc26e4b-f0bf-4ae3-859a-4c9160a76ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:01.273385 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc26e4b-f0bf-4ae3-859a-4c9160a76ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:01.296199 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ecc26e4b-f0bf-4ae3-859a-4c9160a76ae5 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:01.297465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ecc26e4b-f0bf-4ae3-859a-4c9160a76ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:01.321012 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c040f-76de-402d-8c45-a26b422ab979 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:01.388293 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa176788-a36c-4ce7-bac3-bd581dd98438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:01.389985 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa176788-a36c-4ce7-bac3-bd581dd98438 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:01.390805 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa176788-a36c-4ce7-bac3-bd581dd98438 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:01.391601 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa176788-a36c-4ce7-bac3-bd581dd98438 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:01.393466 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa176788-a36c-4ce7-bac3-bd581dd98438 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:01.394318 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa176788-a36c-4ce7-bac3-bd581dd98438 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:01.397341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa176788-a36c-4ce7-bac3-bd581dd98438 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:01.405590 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 485/964] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:01.427950 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 480/965] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:01.439125 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc26e4b-f0bf-4ae3-859a-4c9160a76ae5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:01.560537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa176788-a36c-4ce7-bac3-bd581dd98438 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:01.596948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:01.602937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc26e4b-f0bf-4ae3-859a-4c9160a76ae5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:01.606765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:01.644542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2c494-f39d-4438-bd12-00f89c836d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:01.645636 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2c494-f39d-4438-bd12-00f89c836d83 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:01.646134 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2c494-f39d-4438-bd12-00f89c836d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:01.646620 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2c494-f39d-4438-bd12-00f89c836d83 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:01.655362 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2c494-f39d-4438-bd12-00f89c836d83 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:01.657332 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2c494-f39d-4438-bd12-00f89c836d83 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:01.670840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-73e2c494-f39d-4438-bd12-00f89c836d83 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:21:01.670840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:01.670840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:01.670840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:01.670840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:01.670840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:01.670840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:01.670840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:01.670840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:01.670840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:01.670840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:01.670840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:01.670840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:21:01.670840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:21:01.670840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:21:01.670840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:21:01.671882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:01.671882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:01.671882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:21:01.671882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:21:01.671882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:21:01.671882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:21:01.671882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:01.671882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:01.671882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:01.671882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:01.671882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:01.671882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:01.671882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:01.671882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:01.671882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:01.671882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:01.671882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:01.671882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:01.673279 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:01.673279 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:01.673279 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:21:01.673279 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:21:01.673279 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:21:01.673279 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:21:01.673279 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:21:01.673279 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:21:01.673279 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:21:01.673279 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:21:01.675607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 486/966] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Sep 1 16:21:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:01.686157 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2c494-f39d-4438-bd12-00f89c836d83 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:01.696167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa176788-a36c-4ce7-bac3-bd581dd98438 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:01.749666 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10407fd6-ef36-44dd-b513-fd46e6dcb325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:01.750444 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10407fd6-ef36-44dd-b513-fd46e6dcb325 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:01.750620 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10407fd6-ef36-44dd-b513-fd46e6dcb325 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:01.750993 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10407fd6-ef36-44dd-b513-fd46e6dcb325 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:01.751490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10407fd6-ef36-44dd-b513-fd46e6dcb325 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:01.753176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10407fd6-ef36-44dd-b513-fd46e6dcb325 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:01.763135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-10407fd6-ef36-44dd-b513-fd46e6dcb325 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:21:01.763135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:01.763135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:21:01.763135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:21:01.763135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:21:01.763135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:21:01.763135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:21:01.763135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:21:01.763135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:21:01.763135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:01.763135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:21:01.763135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:01.763135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:01.763135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:01.763135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:01.763135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:01.763135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:01.765184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:01.765184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:01.765184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:01.765184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:01.765184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:01.765184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:01.765184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:21:01.765184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:21:01.765184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:21:01.765184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:21:01.765184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:01.765184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:01.765184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:01.765184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:01.765184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:01.765184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:01.767102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:01.767102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:01.767102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:01.767102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:01.767102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:01.767102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:01.767102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:01.767102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:01.767102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:01.767102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:01.767102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:21:01.767102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:21:01.767102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:21:01.767102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:01.767102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 481/967] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:21:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:21:01.768726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64462ea8-461f-423b-b137-cb4c733c5722 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:01.768726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64462ea8-461f-423b-b137-cb4c733c5722 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:01.768726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64462ea8-461f-423b-b137-cb4c733c5722 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:01.770818 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 482/968] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:01.772610 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64462ea8-461f-423b-b137-cb4c733c5722 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:01.838531 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2c494-f39d-4438-bd12-00f89c836d83 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:01.876312 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c41678-fb2e-454c-8b65-5e6612962aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:01.877012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c41678-fb2e-454c-8b65-5e6612962aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:01.877472 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c41678-fb2e-454c-8b65-5e6612962aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:01.877834 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c41678-fb2e-454c-8b65-5e6612962aa9 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:01.878825 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c41678-fb2e-454c-8b65-5e6612962aa9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:01.879243 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c41678-fb2e-454c-8b65-5e6612962aa9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:01.881123 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c41678-fb2e-454c-8b65-5e6612962aa9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:01.896641 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:01.903453 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64462ea8-461f-423b-b137-cb4c733c5722 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:01.905419 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 487/969] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Sep 1 16:21:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:01.906781 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c41678-fb2e-454c-8b65-5e6612962aa9 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:01.927103 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:01.951028 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d994879-dadb-4a36-9900-6338e2e9d3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:01.951645 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d994879-dadb-4a36-9900-6338e2e9d3df None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:01.951923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d994879-dadb-4a36-9900-6338e2e9d3df None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:01.952196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d994879-dadb-4a36-9900-6338e2e9d3df None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:01.952888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d994879-dadb-4a36-9900-6338e2e9d3df None admin] RBAC: Adding query filter params (name=compute) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:01.953192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d994879-dadb-4a36-9900-6338e2e9d3df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:01.954607 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d994879-dadb-4a36-9900-6338e2e9d3df None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:01.960010 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 483/970] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Sep 1 16:21:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:01.961291 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94804b11-9cbd-40cc-919b-86beb4ff1439 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:01.961574 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94804b11-9cbd-40cc-919b-86beb4ff1439 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:01.961846 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94804b11-9cbd-40cc-919b-86beb4ff1439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:01.982003 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-94804b11-9cbd-40cc-919b-86beb4ff1439 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:01.983579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-94804b11-9cbd-40cc-919b-86beb4ff1439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:02.042571 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c41678-fb2e-454c-8b65-5e6612962aa9 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:02.070555 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 484/971] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:02.072336 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94804b11-9cbd-40cc-919b-86beb4ff1439 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:02.102097 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9d39b-efa5-4999-8118-03599b44a6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:02.103137 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9d39b-efa5-4999-8118-03599b44a6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:02.104192 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9d39b-efa5-4999-8118-03599b44a6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:02.104744 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9d39b-efa5-4999-8118-03599b44a6f4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:02.105555 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9d39b-efa5-4999-8118-03599b44a6f4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:02.107326 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9d39b-efa5-4999-8118-03599b44a6f4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:02.117427 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-87a9d39b-efa5-4999-8118-03599b44a6f4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:21:02.117427 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:02.117427 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:21:02.117427 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:21:02.117427 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:21:02.117427 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:21:02.117427 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:21:02.117427 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:21:02.117427 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:21:02.117427 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:21:02.117427 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:21:02.117427 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:21:02.117427 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:02.117427 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:02.117427 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:02.117427 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:02.117427 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:02.119354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:02.119354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:02.119354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:02.119354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:02.119354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:02.119354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:02.119354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:21:02.119354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:21:02.119354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:21:02.119354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:21:02.119354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:02.119354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:02.119354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:02.119354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:02.119354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:02.119354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:02.121002 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:02.121002 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:02.121002 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:02.121002 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:02.121002 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:02.121002 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:02.121002 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:02.121002 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:02.121002 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:02.121002 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:02.121002 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:21:02.121002 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:21:02.121002 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:21:02.121002 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:21:02.124245 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 488/972] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Sep 1 16:21:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:02.125080 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9d39b-efa5-4999-8118-03599b44a6f4 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:02.219462 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:02.235379 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94804b11-9cbd-40cc-919b-86beb4ff1439 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:02.265279 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:02.288291 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73c19f-6a12-4ae6-b4e6-ba0016a68377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:02.289037 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73c19f-6a12-4ae6-b4e6-ba0016a68377 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:02.289307 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73c19f-6a12-4ae6-b4e6-ba0016a68377 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:02.289571 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73c19f-6a12-4ae6-b4e6-ba0016a68377 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:02.308838 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9d39b-efa5-4999-8118-03599b44a6f4 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:02.353252 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8b74d-9f15-474d-9c9c-9f712ee3634c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:02.355220 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8b74d-9f15-474d-9c9c-9f712ee3634c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:02.355687 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8b74d-9f15-474d-9c9c-9f712ee3634c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:02.356164 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8b74d-9f15-474d-9c9c-9f712ee3634c None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:02.357466 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8b74d-9f15-474d-9c9c-9f712ee3634c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:02.357991 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8b74d-9f15-474d-9c9c-9f712ee3634c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:02.359620 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8b74d-9f15-474d-9c9c-9f712ee3634c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:02.365809 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 489/973] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Sep 1 16:21:02 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:02.366974 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8b74d-9f15-474d-9c9c-9f712ee3634c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:02.400206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73c19f-6a12-4ae6-b4e6-ba0016a68377 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:02.402979 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73c19f-6a12-4ae6-b4e6-ba0016a68377 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:02.537328 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8b74d-9f15-474d-9c9c-9f712ee3634c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:02.580209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4f317-f74e-41f2-8ad5-4300ce64f477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:02.580868 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4f317-f74e-41f2-8ad5-4300ce64f477 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:02.581144 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4f317-f74e-41f2-8ad5-4300ce64f477 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:02.581419 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4f317-f74e-41f2-8ad5-4300ce64f477 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:02.582084 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4f317-f74e-41f2-8ad5-4300ce64f477 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:02.582379 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4f317-f74e-41f2-8ad5-4300ce64f477 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:02.583896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4f317-f74e-41f2-8ad5-4300ce64f477 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:02.588527 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:02.590942 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 490/974] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Sep 1 16:21:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:02.591975 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4f317-f74e-41f2-8ad5-4300ce64f477 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:02.608381 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:02.613949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 485/975] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:21:02 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:21:02.615585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73c19f-6a12-4ae6-b4e6-ba0016a68377 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:02.735996 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4f317-f74e-41f2-8ad5-4300ce64f477 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:02.780668 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73c19f-6a12-4ae6-b4e6-ba0016a68377 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:02.784273 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1405029-7fe3-4798-96db-3c8af3667969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:02.785356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1405029-7fe3-4798-96db-3c8af3667969 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:02.785845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1405029-7fe3-4798-96db-3c8af3667969 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:02.786330 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1405029-7fe3-4798-96db-3c8af3667969 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:02.787574 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1405029-7fe3-4798-96db-3c8af3667969 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:02.790317 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1405029-7fe3-4798-96db-3c8af3667969 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:02.795522 dv-cinder-852209-10-smb devstack@keystone.service[81460]: WARNING keystone.server.flask.common [None req-d1405029-7fe3-4798-96db-3c8af3667969 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 16:21:02.816534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.sql.core [None req-d1405029-7fe3-4798-96db-3c8af3667969 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 16:21:02.816534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 16:21:02.816534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [parameters: {'user_id': 'f1dfca48862c4061ab581d1ca3d7249b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 16:21:02.816534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81460) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 16:21:02.831888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db64cdf-fd9e-43a8-99be-b4c5c82dce82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:02.832956 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db64cdf-fd9e-43a8-99be-b4c5c82dce82 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:02.833431 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db64cdf-fd9e-43a8-99be-b4c5c82dce82 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:02.833712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-d1405029-7fe3-4798-96db-3c8af3667969 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 16:21:02.833712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:02.833712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 16:21:02.833712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 16:21:02.833712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 16:21:02.833712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 16:21:02.833712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 16:21:02.833712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 16:21:02.833712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 16:21:02.833712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application conn.query(q) Sep 01 16:21:02.833712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 16:21:02.833712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 16:21:02.833712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 16:21:02.833712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application result.read() Sep 01 16:21:02.833712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 16:21:02.835338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 16:21:02.835338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 16:21:02.835338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 16:21:02.835338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 16:21:02.835338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 16:21:02.835338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 16:21:02.835338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 16:21:02.835338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 16:21:02.835338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:21:02.835338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 16:21:02.835338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:21:02.835338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:02.835338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 16:21:02.835338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 16:21:02.835338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 01 16:21:02.835338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 01 16:21:02.835338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 16:21:02.835338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application next(self.gen) Sep 01 16:21:02.837257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 16:21:02.837257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application yield resource Sep 01 16:21:02.837257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 16:21:02.837257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application next(self.gen) Sep 01 16:21:02.837257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 16:21:02.837257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 16:21:02.837257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 16:21:02.837257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 16:21:02.837257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 16:21:02.837257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise self.value Sep 01 16:21:02.837257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 16:21:02.837257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 16:21:02.837257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 16:21:02.837257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application session.commit() Sep 01 16:21:02.837257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 16:21:02.837257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 16:21:02.837257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 16:21:02.840961 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 16:21:02.840961 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 16:21:02.840961 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self.session.flush() Sep 01 16:21:02.840961 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 16:21:02.840961 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 16:21:02.840961 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 16:21:02.840961 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 16:21:02.840961 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 16:21:02.840961 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application compat.raise_( Sep 01 16:21:02.840961 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 16:21:02.840961 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception Sep 01 16:21:02.840961 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 16:21:02.840961 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 16:21:02.840961 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 16:21:02.840961 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 16:21:02.840961 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 16:21:02.840961 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 16:21:02.845585 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 16:21:02.845585 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 16:21:02.845585 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 01 16:21:02.845585 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 01 16:21:02.845585 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 16:21:02.845585 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 16:21:02.845585 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 16:21:02.845585 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 16:21:02.845585 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 16:21:02.845585 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 16:21:02.845585 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 16:21:02.845585 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 16:21:02.845585 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 16:21:02.845585 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 16:21:02.845585 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 16:21:02.845585 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception Sep 01 16:21:02.851164 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 16:21:02.851164 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 16:21:02.851164 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 16:21:02.851164 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 16:21:02.851164 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 16:21:02.851164 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 16:21:02.851164 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 16:21:02.851164 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application conn.query(q) Sep 01 16:21:02.851164 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 16:21:02.851164 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 16:21:02.851164 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 16:21:02.851164 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application result.read() Sep 01 16:21:02.851164 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 16:21:02.851164 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 16:21:02.851164 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 16:21:02.851164 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 16:21:02.867564 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 16:21:02.867564 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 16:21:02.867564 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 16:21:02.867564 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 16:21:02.867564 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 16:21:02.867564 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 16:21:02.867564 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f1dfca48862c4061ab581d1ca3d7249b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 16:21:02.867564 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 16:21:02.867564 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:21:02.867564 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:21:02.867564 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:21:02.867564 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:02.867564 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:02.867564 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:02.867564 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:02.870976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:02.870976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:02.870976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:02.870976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:02.870976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:02.870976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:02.870976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:02.870976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 01 16:21:02.870976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 01 16:21:02.870976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:02.870976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:02.870976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:21:02.870976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:21:02.870976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:21:02.870976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:21:02.870976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 01 16:21:02.870976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 01 16:21:02.874713 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 01 16:21:02.874713 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 01 16:21:02.874713 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 16:21:02.874713 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 16:21:02.874713 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 16:21:02.874713 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:21:02.875954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db64cdf-fd9e-43a8-99be-b4c5c82dce82 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:02.875954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db64cdf-fd9e-43a8-99be-b4c5c82dce82 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:02.875954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db64cdf-fd9e-43a8-99be-b4c5c82dce82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:02.875954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db64cdf-fd9e-43a8-99be-b4c5c82dce82 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:02.876899 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 491/976] 10.222.0.52 () {60 vars in 1131 bytes} [Thu Sep 1 16:21:02 2022] POST /identity/v3/users => generated 160 bytes in 249 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:02.876899 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1405029-7fe3-4798-96db-3c8af3667969 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:02.877411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 486/977] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Sep 1 16:21:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:02.877411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db64cdf-fd9e-43a8-99be-b4c5c82dce82 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:02.953836 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:02.957413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:02.999000 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1405029-7fe3-4798-96db-3c8af3667969 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:03.010948 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db64cdf-fd9e-43a8-99be-b4c5c82dce82 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:03.042693 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbb12b-bdc7-4c09-b7cb-6a1afb7023ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:03.043688 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbb12b-bdc7-4c09-b7cb-6a1afb7023ad None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:03.044195 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbb12b-bdc7-4c09-b7cb-6a1afb7023ad None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:03.044709 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbb12b-bdc7-4c09-b7cb-6a1afb7023ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:03.062874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a12037-e2a3-42c4-ad5f-cef8cd1011ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:03.063664 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a12037-e2a3-42c4-ad5f-cef8cd1011ac None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:03.064041 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a12037-e2a3-42c4-ad5f-cef8cd1011ac None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:03.064417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a12037-e2a3-42c4-ad5f-cef8cd1011ac None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:03.070273 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbb12b-bdc7-4c09-b7cb-6a1afb7023ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:03.073005 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbb12b-bdc7-4c09-b7cb-6a1afb7023ad None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:03.073717 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a12037-e2a3-42c4-ad5f-cef8cd1011ac None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:03.075272 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a12037-e2a3-42c4-ad5f-cef8cd1011ac None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:03.092676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-50a12037-e2a3-42c4-ad5f-cef8cd1011ac None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:21:03.092676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:03.092676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:03.092676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:03.092676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:03.092676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:03.092676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:03.092676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:03.092676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:03.092676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:03.092676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:03.092676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:03.092676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:21:03.092676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:21:03.092676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:21:03.092676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:21:03.094784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:03.094784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:03.094784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:21:03.094784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:21:03.094784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:21:03.094784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:21:03.094784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:03.094784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:03.094784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:03.094784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:03.094784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:03.094784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:03.094784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:03.094784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:03.094784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:03.094784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:03.094784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:03.094784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:03.096910 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:03.096910 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:03.096910 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:21:03.096910 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:21:03.096910 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:21:03.096910 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:21:03.096910 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:21:03.096910 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:21:03.096910 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:21:03.096910 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:03.096910 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 487/978] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:21:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:03.096910 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a12037-e2a3-42c4-ad5f-cef8cd1011ac None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:03.108829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-58bbb12b-bdc7-4c09-b7cb-6a1afb7023ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:21:03.108829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:03.108829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:03.108829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:03.108829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:03.108829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:03.108829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:03.108829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:03.108829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:03.108829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:03.108829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:03.108829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:03.108829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:21:03.108829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:21:03.108829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:21:03.108829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:21:03.110045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:03.110045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:03.110045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:03.110045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:03.110045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:03.110045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:03.110045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:03.110045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:03.110045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:03.110045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:03.110045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:03.110045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:03.110045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:03.110045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:03.110045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:03.110045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:03.110045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:21:03.111143 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:21:03.111143 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:21:03.111143 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:21:03.111439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 492/979] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:21:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:03.120362 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbb12b-bdc7-4c09-b7cb-6a1afb7023ad None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:03.247042 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a12037-e2a3-42c4-ad5f-cef8cd1011ac None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:03.262496 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbb12b-bdc7-4c09-b7cb-6a1afb7023ad None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:03.277007 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:03.292578 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:03.308153 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23243ef2-11c2-4d2d-b09a-1fe268326cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:03.308827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23243ef2-11c2-4d2d-b09a-1fe268326cfd None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:03.309174 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23243ef2-11c2-4d2d-b09a-1fe268326cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:03.309511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23243ef2-11c2-4d2d-b09a-1fe268326cfd None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:03.310300 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23243ef2-11c2-4d2d-b09a-1fe268326cfd None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:03.310666 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23243ef2-11c2-4d2d-b09a-1fe268326cfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:03.312191 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23243ef2-11c2-4d2d-b09a-1fe268326cfd None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:03.315066 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09df32-c7a1-4c41-8a89-5531aa97d0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:03.316111 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09df32-c7a1-4c41-8a89-5531aa97d0ae None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:03.316600 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09df32-c7a1-4c41-8a89-5531aa97d0ae None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:03.317138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09df32-c7a1-4c41-8a89-5531aa97d0ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:03.318454 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09df32-c7a1-4c41-8a89-5531aa97d0ae None admin] RBAC: Adding query filter params (interface=admin, service_id=09898bcd68bf4aba93d6d234e9fc3698, region_id=RegionOne) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:03.319010 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09df32-c7a1-4c41-8a89-5531aa97d0ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:03.321691 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09df32-c7a1-4c41-8a89-5531aa97d0ae None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:03.337487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 488/980] 10.222.0.52 () {56 vars in 1249 bytes} [Thu Sep 1 16:21:03 2022] GET /identity/v3/endpoints?service_id=09898bcd68bf4aba93d6d234e9fc3698&interface=admin®ion_id=RegionOne => generated 193 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:03.337487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09df32-c7a1-4c41-8a89-5531aa97d0ae None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:03.364662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 493/981] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 1 16:21:03 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:03.364662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23243ef2-11c2-4d2d-b09a-1fe268326cfd None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:03.515248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09df32-c7a1-4c41-8a89-5531aa97d0ae None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:03.559527 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ca7df-d511-4fc8-b624-90d5404fd24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:03.560202 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ca7df-d511-4fc8-b624-90d5404fd24a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:03.560547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ca7df-d511-4fc8-b624-90d5404fd24a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:03.560918 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ca7df-d511-4fc8-b624-90d5404fd24a None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:03.561663 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ca7df-d511-4fc8-b624-90d5404fd24a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:03.562035 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ca7df-d511-4fc8-b624-90d5404fd24a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:03.563665 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ca7df-d511-4fc8-b624-90d5404fd24a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:03.576447 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23243ef2-11c2-4d2d-b09a-1fe268326cfd None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:03.577822 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 489/982] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:03.583641 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ca7df-d511-4fc8-b624-90d5404fd24a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:03.640567 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:03.656108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6f9c4-8468-464d-bf29-8a926c2bfa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:03.657237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6f9c4-8468-464d-bf29-8a926c2bfa4f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:03.657722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6f9c4-8468-464d-bf29-8a926c2bfa4f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:03.658205 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6f9c4-8468-464d-bf29-8a926c2bfa4f None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:03.659760 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6f9c4-8468-464d-bf29-8a926c2bfa4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:03.662366 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6f9c4-8468-464d-bf29-8a926c2bfa4f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:03.673611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 494/983] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Sep 1 16:21:03 2022] GET /identity/v3/services => generated 1497 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:21:03.732976 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ca7df-d511-4fc8-b624-90d5404fd24a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:03.787880 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4307d-892d-4ceb-9b29-21b24bfb4d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:03.788868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4307d-892d-4ceb-9b29-21b24bfb4d6f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:03.789358 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4307d-892d-4ceb-9b29-21b24bfb4d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:03.789865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4307d-892d-4ceb-9b29-21b24bfb4d6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:03.800136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4307d-892d-4ceb-9b29-21b24bfb4d6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:03.801673 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4307d-892d-4ceb-9b29-21b24bfb4d6f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:03.815559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-76b4307d-892d-4ceb-9b29-21b24bfb4d6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:21:03.815559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:03.815559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:03.815559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:03.815559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:03.815559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:03.815559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:03.815559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:03.815559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:03.815559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:03.815559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:03.815559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:03.815559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:21:03.815559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:21:03.815559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:21:03.817435 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:21:03.817435 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:03.817435 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:03.817435 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:03.817435 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:03.817435 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:03.817435 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:03.817435 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:03.817435 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:03.817435 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:03.817435 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:03.817435 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:03.817435 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:03.817435 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:03.817435 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:03.817435 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:03.817435 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:03.819296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:21:03.819296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:21:03.819296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:21:03.819296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:21:03.819296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:21:03.819296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:21:03.819296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:21:03.819296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:03.819296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 490/984] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:21:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:21:03.827528 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6f9c4-8468-464d-bf29-8a926c2bfa4f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:03.902371 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:03.982152 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6f9c4-8468-464d-bf29-8a926c2bfa4f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:04.024151 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a7f27-db1a-4c46-853c-3b3981482b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:04.024803 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a7f27-db1a-4c46-853c-3b3981482b1d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:04.025085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a7f27-db1a-4c46-853c-3b3981482b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:04.025930 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a7f27-db1a-4c46-853c-3b3981482b1d None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:04.026629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a7f27-db1a-4c46-853c-3b3981482b1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:04.026935 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a7f27-db1a-4c46-853c-3b3981482b1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:04.028386 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a7f27-db1a-4c46-853c-3b3981482b1d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:04.043354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 495/985] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:21:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:04.051417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4307d-892d-4ceb-9b29-21b24bfb4d6f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:04.173264 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:04.178052 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4307d-892d-4ceb-9b29-21b24bfb4d6f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:04.221139 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04d45a-fc54-4c4f-adea-4aa02d280dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:04.221940 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04d45a-fc54-4c4f-adea-4aa02d280dab None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:04.222283 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04d45a-fc54-4c4f-adea-4aa02d280dab None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:04.222622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04d45a-fc54-4c4f-adea-4aa02d280dab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:04.223447 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a04d45a-fc54-4c4f-adea-4aa02d280dab None admin] RBAC: Adding query filter params (role.id=dd6eda7c9f7d4778ab381591e492859d, scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f, user.id=3c001a902faf4b3c8d8f23f2e017c706) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:04.223834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a04d45a-fc54-4c4f-adea-4aa02d280dab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:04.225412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a04d45a-fc54-4c4f-adea-4aa02d280dab None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:04.233568 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 491/986] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:21:04 2022] GET /identity/v3/role_assignments?user.id=3c001a902faf4b3c8d8f23f2e017c706&scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f&role.id=dd6eda7c9f7d4778ab381591e492859d => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:04.733118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4abc6-15f2-4aac-8fc2-2f860f2efc43 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:04.733668 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4abc6-15f2-4aac-8fc2-2f860f2efc43 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:04.734109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4abc6-15f2-4aac-8fc2-2f860f2efc43 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:04.736898 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 496/987] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:04.742953 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2f8fd-e58f-4129-b311-939f64347387 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:04.743738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2f8fd-e58f-4129-b311-939f64347387 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:04.743738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2f8fd-e58f-4129-b311-939f64347387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:04.772960 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-48f2f8fd-e58f-4129-b311-939f64347387 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:04.775237 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-48f2f8fd-e58f-4129-b311-939f64347387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:04.916689 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 492/988] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:21:05.354217 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4abc6-15f2-4aac-8fc2-2f860f2efc43 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:05.525931 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4abc6-15f2-4aac-8fc2-2f860f2efc43 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:05.530660 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:05.596143 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178ba67-b3e2-4712-b436-f2b0a0112099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:05.597237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178ba67-b3e2-4712-b436-f2b0a0112099 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:05.597816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178ba67-b3e2-4712-b436-f2b0a0112099 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:05.598310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178ba67-b3e2-4712-b436-f2b0a0112099 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:05.599566 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178ba67-b3e2-4712-b436-f2b0a0112099 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:05.602309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178ba67-b3e2-4712-b436-f2b0a0112099 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:05.627710 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 497/989] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 1 16:21:05 2022] POST /identity/v3/services => generated 242 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:21:06.058312 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d80c56-d57f-4575-9a1b-2fae06bece03 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:06.058837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d80c56-d57f-4575-9a1b-2fae06bece03 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:06.059280 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d80c56-d57f-4575-9a1b-2fae06bece03 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:06.062089 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 493/990] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:06.068299 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368d998-e6af-4fb6-a77e-e9df5dcd5e46 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:06.069151 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368d998-e6af-4fb6-a77e-e9df5dcd5e46 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:06.069151 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368d998-e6af-4fb6-a77e-e9df5dcd5e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:06.097302 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-0368d998-e6af-4fb6-a77e-e9df5dcd5e46 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:06.099799 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0368d998-e6af-4fb6-a77e-e9df5dcd5e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:06.231307 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 498/991] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:06 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:21:06.508448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d80c56-d57f-4575-9a1b-2fae06bece03 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:06.663595 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:06.679210 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d80c56-d57f-4575-9a1b-2fae06bece03 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:06.745939 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5619611-873a-46cf-9e61-dbef66c78cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:06.746997 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5619611-873a-46cf-9e61-dbef66c78cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:06.747733 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5619611-873a-46cf-9e61-dbef66c78cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:06.748207 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5619611-873a-46cf-9e61-dbef66c78cc6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:06.749335 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5619611-873a-46cf-9e61-dbef66c78cc6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:06.752019 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5619611-873a-46cf-9e61-dbef66c78cc6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:06.770765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-e5619611-873a-46cf-9e61-dbef66c78cc6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:21:06.770765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:06.770765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:21:06.770765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:21:06.770765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:21:06.770765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:21:06.770765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:21:06.770765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:21:06.770765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:21:06.770765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:06.770765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:21:06.770765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:06.770765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:06.770765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:06.770765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:06.770765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:06.770765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:06.772174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:06.772174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:06.772174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:06.772174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:06.772174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:06.772174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:06.772174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:21:06.772174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:21:06.772174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:21:06.772174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:21:06.772174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:06.772174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:06.772174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:06.772174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:06.772174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:06.772174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:06.778449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:06.778449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:06.778449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:06.778449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:06.778449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:06.778449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:06.778449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:06.778449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:06.778449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:06.778449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:06.778449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:21:06.778449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:21:06.778449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:21:06.778449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:06.778449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 494/992] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Sep 1 16:21:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:06.782452 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368d998-e6af-4fb6-a77e-e9df5dcd5e46 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:06.921370 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbd0ea-d319-4611-a654-69d1fee2ce43 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:06.921765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbd0ea-d319-4611-a654-69d1fee2ce43 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:06.922369 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbd0ea-d319-4611-a654-69d1fee2ce43 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:06.923899 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 495/993] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:06.930714 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf721a-3431-4897-956f-7411466fce40 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:06.930996 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf721a-3431-4897-956f-7411466fce40 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:06.931832 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf721a-3431-4897-956f-7411466fce40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:06.953204 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a9cf721a-3431-4897-956f-7411466fce40 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:06.954431 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a9cf721a-3431-4897-956f-7411466fce40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:06.967722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:06.990259 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368d998-e6af-4fb6-a77e-e9df5dcd5e46 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:07.048364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 496/994] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:06 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:21:07.057716 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8685aeb-df3d-4805-b91a-1216961dc93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:07.058361 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8685aeb-df3d-4805-b91a-1216961dc93d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:07.058645 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8685aeb-df3d-4805-b91a-1216961dc93d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:07.058929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8685aeb-df3d-4805-b91a-1216961dc93d None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:07.059589 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8685aeb-df3d-4805-b91a-1216961dc93d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:07.059892 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8685aeb-df3d-4805-b91a-1216961dc93d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:07.061347 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8685aeb-df3d-4805-b91a-1216961dc93d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:07.067363 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 499/995] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Sep 1 16:21:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:07.074034 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf721a-3431-4897-956f-7411466fce40 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:07.193553 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:07.215858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf721a-3431-4897-956f-7411466fce40 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:07.268245 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a66b1-45f3-483c-b3e7-e160301e14c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:07.268897 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a66b1-45f3-483c-b3e7-e160301e14c5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:07.269172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a66b1-45f3-483c-b3e7-e160301e14c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:07.269443 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a66b1-45f3-483c-b3e7-e160301e14c5 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:07.270088 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a66b1-45f3-483c-b3e7-e160301e14c5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:07.270384 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a66b1-45f3-483c-b3e7-e160301e14c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:07.271783 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a66b1-45f3-483c-b3e7-e160301e14c5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:07.278573 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 497/996] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Sep 1 16:21:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:07.284527 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8685aeb-df3d-4805-b91a-1216961dc93d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:07.326118 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a66b1-45f3-483c-b3e7-e160301e14c5 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:07.448393 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8685aeb-df3d-4805-b91a-1216961dc93d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:07.481022 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a66b1-45f3-483c-b3e7-e160301e14c5 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:07.498216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b281d36-4d7d-40e5-9fee-dc6e1e8a1468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:07.498961 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b281d36-4d7d-40e5-9fee-dc6e1e8a1468 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:07.499237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b281d36-4d7d-40e5-9fee-dc6e1e8a1468 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:07.499499 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b281d36-4d7d-40e5-9fee-dc6e1e8a1468 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:07.500197 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b281d36-4d7d-40e5-9fee-dc6e1e8a1468 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:07.501654 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b281d36-4d7d-40e5-9fee-dc6e1e8a1468 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:07.536665 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 500/997] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:21:07 2022] POST /identity/v3/endpoints => generated 325 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:21:07.564058 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c03c4-d91d-4587-bc7a-80320d1e8aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:07.565228 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c03c4-d91d-4587-bc7a-80320d1e8aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:07.565728 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c03c4-d91d-4587-bc7a-80320d1e8aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:07.566210 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c03c4-d91d-4587-bc7a-80320d1e8aa3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:07.567354 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c03c4-d91d-4587-bc7a-80320d1e8aa3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:07.570104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c03c4-d91d-4587-bc7a-80320d1e8aa3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:07.589387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-b72c03c4-d91d-4587-bc7a-80320d1e8aa3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:21:07.589387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:07.589387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:21:07.589387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:21:07.589387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:21:07.589387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:21:07.589387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:21:07.589387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:21:07.589387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:21:07.589387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:07.589387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:21:07.589387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:07.589387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:07.589387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:07.589387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:07.589387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:07.589387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:07.590433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:07.590433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:07.590433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:07.590433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:07.590433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:07.590433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:07.590433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:21:07.590433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:21:07.590433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:21:07.590433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:21:07.590433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:07.590433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:07.590433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:07.590433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:07.590433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:07.590433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:07.591308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:07.591308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:07.591308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:07.591308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:07.591308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:07.591308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:07.591308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:07.591308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:07.591308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:07.591308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:07.591308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:21:07.591308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:21:07.591308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:21:07.591308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:07.592110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 498/998] 10.222.0.52 () {56 vars in 1105 bytes} [Thu Sep 1 16:21:07 2022] GET /identity/v3/services/image => generated 86 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:07.602333 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b281d36-4d7d-40e5-9fee-dc6e1e8a1468 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:07.637199 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:07.675096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205324b-599f-42f7-a939-01d4eba4a4ec None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:07.675693 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205324b-599f-42f7-a939-01d4eba4a4ec None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:07.676202 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205324b-599f-42f7-a939-01d4eba4a4ec None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:07.679112 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 499/999] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:21:07.688726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcf686-513f-4984-83f0-84fda124a040 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:07.689464 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcf686-513f-4984-83f0-84fda124a040 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:07.689957 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcf686-513f-4984-83f0-84fda124a040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:07.724391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-39bcf686-513f-4984-83f0-84fda124a040 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:07.726466 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-39bcf686-513f-4984-83f0-84fda124a040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:07.737946 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:07.793258 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b281d36-4d7d-40e5-9fee-dc6e1e8a1468 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:07.843249 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa63a1b-0cf6-4ce9-9a54-e3cc135de441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:07.844168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa63a1b-0cf6-4ce9-9a54-e3cc135de441 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:07.844594 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa63a1b-0cf6-4ce9-9a54-e3cc135de441 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:07.845117 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa63a1b-0cf6-4ce9-9a54-e3cc135de441 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:07.846288 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa63a1b-0cf6-4ce9-9a54-e3cc135de441 None admin] RBAC: Adding query filter params (name=image) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:07.846998 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa63a1b-0cf6-4ce9-9a54-e3cc135de441 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:07.848931 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa63a1b-0cf6-4ce9-9a54-e3cc135de441 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:07.860393 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 501/1000] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:21:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:07.867729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa63a1b-0cf6-4ce9-9a54-e3cc135de441 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:07.877597 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 500/1001] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:07 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:08.026913 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:08.077567 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa63a1b-0cf6-4ce9-9a54-e3cc135de441 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:08.123227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d234ed1-0e20-4c5b-bb7c-c26d5ae61d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:08.123971 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d234ed1-0e20-4c5b-bb7c-c26d5ae61d9d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:08.124438 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d234ed1-0e20-4c5b-bb7c-c26d5ae61d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:08.124882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d234ed1-0e20-4c5b-bb7c-c26d5ae61d9d None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:08.125685 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d234ed1-0e20-4c5b-bb7c-c26d5ae61d9d None admin] RBAC: Adding query filter params (type=image) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:08.126137 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d234ed1-0e20-4c5b-bb7c-c26d5ae61d9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:08.127780 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d234ed1-0e20-4c5b-bb7c-c26d5ae61d9d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:08.133919 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 502/1002] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:21:07 2022] GET /identity/v3/services?type=image => generated 122 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:08.176050 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcf686-513f-4984-83f0-84fda124a040 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:08.395320 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcf686-513f-4984-83f0-84fda124a040 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:08.468528 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a0711-55f9-4299-b165-e3d597402b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:08.469709 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a0711-55f9-4299-b165-e3d597402b98 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:08.470222 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a0711-55f9-4299-b165-e3d597402b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:08.470730 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a0711-55f9-4299-b165-e3d597402b98 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:08.471826 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a0711-55f9-4299-b165-e3d597402b98 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:08.474536 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a0711-55f9-4299-b165-e3d597402b98 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:08.490229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-b42a0711-55f9-4299-b165-e3d597402b98 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:21:08.490229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:08.490229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:21:08.490229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:21:08.490229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:21:08.490229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:21:08.490229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:21:08.490229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:21:08.490229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:21:08.490229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:08.490229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:21:08.490229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:08.490229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:08.490229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:08.490229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:08.490229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:08.490229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:08.492270 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:08.492270 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:08.492270 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:08.492270 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:08.492270 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:08.492270 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:08.492270 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:21:08.492270 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:21:08.492270 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:21:08.492270 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:21:08.492270 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:08.492270 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:08.492270 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:08.492270 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:08.492270 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:08.492270 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:08.495301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:08.495301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:08.495301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:08.495301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:08.495301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:08.495301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:08.495301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:08.495301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:08.495301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:08.495301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:08.495301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:21:08.495301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:21:08.495301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:21:08.495301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:08.495301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 501/1003] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:21:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:21:08.500211 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d234ed1-0e20-4c5b-bb7c-c26d5ae61d9d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:08.697135 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d234ed1-0e20-4c5b-bb7c-c26d5ae61d9d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:08.741168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21e651-7672-428c-b5f0-86138a6a0f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:08.741886 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21e651-7672-428c-b5f0-86138a6a0f92 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:08.742096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21e651-7672-428c-b5f0-86138a6a0f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:08.742387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21e651-7672-428c-b5f0-86138a6a0f92 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:08.743005 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21e651-7672-428c-b5f0-86138a6a0f92 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:08.743326 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21e651-7672-428c-b5f0-86138a6a0f92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:08.745375 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21e651-7672-428c-b5f0-86138a6a0f92 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:08.751989 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 503/1004] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Sep 1 16:21:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:08.757754 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a0711-55f9-4299-b165-e3d597402b98 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:08.769016 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:08.957190 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a0711-55f9-4299-b165-e3d597402b98 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:09.027053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c239a37-e7dc-4712-95cb-e67386bc41fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:09.028078 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c239a37-e7dc-4712-95cb-e67386bc41fb None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:09.028569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c239a37-e7dc-4712-95cb-e67386bc41fb None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:09.029086 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c239a37-e7dc-4712-95cb-e67386bc41fb None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:09.030282 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c239a37-e7dc-4712-95cb-e67386bc41fb None admin] RBAC: Adding query filter params (type=compute) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:09.030833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c239a37-e7dc-4712-95cb-e67386bc41fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:09.033527 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c239a37-e7dc-4712-95cb-e67386bc41fb None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:09.043587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 502/1005] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Sep 1 16:21:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:09.054146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21e651-7672-428c-b5f0-86138a6a0f92 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:09.072528 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:09.211872 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21e651-7672-428c-b5f0-86138a6a0f92 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:09.282284 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b7c5f-3b99-4da1-b3e5-035160faef85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:09.283339 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b7c5f-3b99-4da1-b3e5-035160faef85 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:09.283822 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b7c5f-3b99-4da1-b3e5-035160faef85 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:09.284293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b7c5f-3b99-4da1-b3e5-035160faef85 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:09.285700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b7c5f-3b99-4da1-b3e5-035160faef85 None admin] RBAC: Adding query filter params (interface=public, service_id=0079d766a9f643ad9b84a25f05d7ce34, region_id=RegionOne) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:09.286245 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b7c5f-3b99-4da1-b3e5-035160faef85 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:09.288953 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b7c5f-3b99-4da1-b3e5-035160faef85 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:09.307490 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 504/1006] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Sep 1 16:21:09 2022] GET /identity/v3/endpoints?service_id=0079d766a9f643ad9b84a25f05d7ce34&interface=public®ion_id=RegionOne => generated 194 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:09.309452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c239a37-e7dc-4712-95cb-e67386bc41fb None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:09.399189 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:09.443711 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c239a37-e7dc-4712-95cb-e67386bc41fb None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:09.486236 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f89f9-480c-427b-829c-aee99420a1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:09.486755 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f89f9-480c-427b-829c-aee99420a1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:09.487034 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f89f9-480c-427b-829c-aee99420a1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:09.487309 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f89f9-480c-427b-829c-aee99420a1d8 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:09.487932 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f89f9-480c-427b-829c-aee99420a1d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:09.489390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f89f9-480c-427b-829c-aee99420a1d8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:09.497779 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 503/1007] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Sep 1 16:21:09 2022] GET /identity/v3/services => generated 1727 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:21:09.913497 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ce61b-1785-4ebe-9537-308a4dd7fad7 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:09.914243 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ce61b-1785-4ebe-9537-308a4dd7fad7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:09.914243 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ce61b-1785-4ebe-9537-308a4dd7fad7 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:09.915663 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 505/1008] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:21:09.922727 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435dcb1-2072-437f-935e-13015634a073 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:09.923343 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435dcb1-2072-437f-935e-13015634a073 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:09.923953 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435dcb1-2072-437f-935e-13015634a073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:09.956479 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e435dcb1-2072-437f-935e-13015634a073 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:09.958648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e435dcb1-2072-437f-935e-13015634a073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:10.102621 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 504/1009] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:09 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:21:10.440872 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ce61b-1785-4ebe-9537-308a4dd7fad7 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:10.483603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c575de1-9328-461a-9625-97ad63ad4079 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:10.484141 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c575de1-9328-461a-9625-97ad63ad4079 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:10.484141 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c575de1-9328-461a-9625-97ad63ad4079 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:10.485593 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 505/1010] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:10.491232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae9722-16be-4e38-b0d6-29b44d5b6126 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:10.491637 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae9722-16be-4e38-b0d6-29b44d5b6126 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:10.491785 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae9722-16be-4e38-b0d6-29b44d5b6126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:10.512804 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1dae9722-16be-4e38-b0d6-29b44d5b6126 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:10.514085 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1dae9722-16be-4e38-b0d6-29b44d5b6126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:10.546682 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:10.587849 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ce61b-1785-4ebe-9537-308a4dd7fad7 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:10.604960 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:10.618661 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 506/1011] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:10 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:21:10.641083 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19a475-d239-4e2d-b528-8b9daa077fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:10.641746 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19a475-d239-4e2d-b528-8b9daa077fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:10.642021 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19a475-d239-4e2d-b528-8b9daa077fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:10.642293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19a475-d239-4e2d-b528-8b9daa077fa5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:10.643571 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19a475-d239-4e2d-b528-8b9daa077fa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:10.645235 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19a475-d239-4e2d-b528-8b9daa077fa5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:10.648681 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 506/1012] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:21:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:10.654078 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae9722-16be-4e38-b0d6-29b44d5b6126 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:10.771520 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae9722-16be-4e38-b0d6-29b44d5b6126 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:10.810839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12120c-4df4-4f4b-9b75-56f1a3aad888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:10.811588 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12120c-4df4-4f4b-9b75-56f1a3aad888 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:10.811988 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12120c-4df4-4f4b-9b75-56f1a3aad888 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:10.812266 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12120c-4df4-4f4b-9b75-56f1a3aad888 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:10.812989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da12120c-4df4-4f4b-9b75-56f1a3aad888 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:10.814469 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da12120c-4df4-4f4b-9b75-56f1a3aad888 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:10.852656 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 507/1013] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 1 16:21:10 2022] POST /identity/v3/projects => generated 311 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:21:11.068803 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19a475-d239-4e2d-b528-8b9daa077fa5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:11.207795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19a475-d239-4e2d-b528-8b9daa077fa5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:11.250622 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ce561-9cab-414f-97e7-96ce090080f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:11.251245 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ce561-9cab-414f-97e7-96ce090080f5 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:11.251528 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ce561-9cab-414f-97e7-96ce090080f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:11.251799 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ce561-9cab-414f-97e7-96ce090080f5 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:11.252469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ce561-9cab-414f-97e7-96ce090080f5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:11.253910 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ce561-9cab-414f-97e7-96ce090080f5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:11.266695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:11.280104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 507/1014] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 1 16:21:11 2022] POST /identity/v3/services => generated 242 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:21:11.941427 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324694f0-e6dd-46d2-9b38-bd1a6726d4a5 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:11.942281 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324694f0-e6dd-46d2-9b38-bd1a6726d4a5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:11.942424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324694f0-e6dd-46d2-9b38-bd1a6726d4a5 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:11.945227 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 508/1015] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:11.954579 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd302af-4d15-46a4-9d06-908bcf2596fb None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:11.955078 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd302af-4d15-46a4-9d06-908bcf2596fb None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:11.955579 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd302af-4d15-46a4-9d06-908bcf2596fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:11.988214 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-7dd302af-4d15-46a4-9d06-908bcf2596fb None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:11.990366 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7dd302af-4d15-46a4-9d06-908bcf2596fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:12.147719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 508/1016] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:11 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:12.588519 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324694f0-e6dd-46d2-9b38-bd1a6726d4a5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:12.672365 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:12.777757 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324694f0-e6dd-46d2-9b38-bd1a6726d4a5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:12.843870 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5703081-22f9-41d2-8c00-6e1118cadcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:12.844963 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5703081-22f9-41d2-8c00-6e1118cadcdd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:12.845461 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5703081-22f9-41d2-8c00-6e1118cadcdd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:12.845967 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5703081-22f9-41d2-8c00-6e1118cadcdd None admin] PATH_INFO: `/v3/services/compute` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:12.847032 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5703081-22f9-41d2-8c00-6e1118cadcdd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:12.849665 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5703081-22f9-41d2-8c00-6e1118cadcdd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:12.866024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-b5703081-22f9-41d2-8c00-6e1118cadcdd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:21:12.866024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:12.866024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:21:12.866024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:21:12.866024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:21:12.866024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:21:12.866024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:21:12.866024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:21:12.866024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:21:12.866024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:12.866024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:21:12.866024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:12.866024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:12.866024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:12.866024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:12.866024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:12.866024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:12.867108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:12.867108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:12.867108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:12.867108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:12.867108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:12.867108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:12.867108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:21:12.867108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:21:12.867108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:21:12.867108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:21:12.867108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:12.867108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:12.867108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:12.867108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:12.867108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:12.867108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:12.867958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:12.867958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:12.867958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:12.867958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:12.867958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:12.867958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:12.867958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:12.867958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:12.867958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:12.867958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:12.867958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:21:12.867958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:21:12.867958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:21:12.867958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:12.867958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 509/1017] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:21:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:12.878961 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd302af-4d15-46a4-9d06-908bcf2596fb None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:12.978796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc009e-7d20-48d8-aee4-93fbacfa1ce2 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:12.979337 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc009e-7d20-48d8-aee4-93fbacfa1ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:12.979761 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc009e-7d20-48d8-aee4-93fbacfa1ce2 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:12.982528 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 510/1018] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:12.990564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fec768-2d4c-4787-a82e-91986b669cc1 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:12.991065 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fec768-2d4c-4787-a82e-91986b669cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:12.991523 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fec768-2d4c-4787-a82e-91986b669cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:13.023028 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-30fec768-2d4c-4787-a82e-91986b669cc1 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:13.024289 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-30fec768-2d4c-4787-a82e-91986b669cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:13.046161 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd302af-4d15-46a4-9d06-908bcf2596fb None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:13.078754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:13.103597 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172832d0-b279-4aa3-8994-33c3c5e886ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:13.104501 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172832d0-b279-4aa3-8994-33c3c5e886ed None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:13.105015 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172832d0-b279-4aa3-8994-33c3c5e886ed None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:13.105469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172832d0-b279-4aa3-8994-33c3c5e886ed None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:13.106597 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172832d0-b279-4aa3-8994-33c3c5e886ed None admin] RBAC: Adding query filter params (name=compute) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:13.107065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172832d0-b279-4aa3-8994-33c3c5e886ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:13.109530 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172832d0-b279-4aa3-8994-33c3c5e886ed None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:13.119562 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 509/1019] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Sep 1 16:21:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:13.125473 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172832d0-b279-4aa3-8994-33c3c5e886ed None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:13.126079 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 511/1020] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:12 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:13.259838 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172832d0-b279-4aa3-8994-33c3c5e886ed None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:13.301978 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab3a0b-929a-45cb-a93e-bab059d841fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:13.302607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab3a0b-929a-45cb-a93e-bab059d841fc None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:13.302887 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab3a0b-929a-45cb-a93e-bab059d841fc None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:13.303166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab3a0b-929a-45cb-a93e-bab059d841fc None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:13.303811 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab3a0b-929a-45cb-a93e-bab059d841fc None admin] RBAC: Adding query filter params (type=compute) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:13.304113 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab3a0b-929a-45cb-a93e-bab059d841fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:13.305639 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab3a0b-929a-45cb-a93e-bab059d841fc None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:13.312782 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 510/1021] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Sep 1 16:21:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:13.319162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fec768-2d4c-4787-a82e-91986b669cc1 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:13.411167 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab3a0b-929a-45cb-a93e-bab059d841fc None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:13.411820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:13.484059 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:13.507630 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fec768-2d4c-4787-a82e-91986b669cc1 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:13.557690 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab3a0b-929a-45cb-a93e-bab059d841fc None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:13.560011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f73305-735e-469b-8491-4508f0306800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:13.561305 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f73305-735e-469b-8491-4508f0306800 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:13.561763 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f73305-735e-469b-8491-4508f0306800 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:13.562119 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f73305-735e-469b-8491-4508f0306800 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:13.563089 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f73305-735e-469b-8491-4508f0306800 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:13.564692 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f73305-735e-469b-8491-4508f0306800 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:13.603714 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 512/1022] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:21:13 2022] POST /identity/v3/endpoints => generated 334 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:21:13.611039 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c3bc2-4701-4de5-aa47-37bd11638ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:13.612017 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c3bc2-4701-4de5-aa47-37bd11638ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:13.612308 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c3bc2-4701-4de5-aa47-37bd11638ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:13.612561 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c3bc2-4701-4de5-aa47-37bd11638ec0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:13.614120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c3bc2-4701-4de5-aa47-37bd11638ec0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:13.615768 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c3bc2-4701-4de5-aa47-37bd11638ec0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:13.620681 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 511/1023] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:21:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:13.624359 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f73305-735e-469b-8491-4508f0306800 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:13.745843 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:13.757759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f73305-735e-469b-8491-4508f0306800 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:13.804530 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859293b-29cb-4b88-a876-6ea2e3a91645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:13.805193 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859293b-29cb-4b88-a876-6ea2e3a91645 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:13.805557 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859293b-29cb-4b88-a876-6ea2e3a91645 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:13.805870 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859293b-29cb-4b88-a876-6ea2e3a91645 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:13.806570 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859293b-29cb-4b88-a876-6ea2e3a91645 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:13.808064 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859293b-29cb-4b88-a876-6ea2e3a91645 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:13.844861 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 513/1024] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 1 16:21:13 2022] POST /identity/v3/users => generated 285 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:21:13.853576 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0c799-245b-431f-aa80-d705530dd3c3 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:13.854050 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0c799-245b-431f-aa80-d705530dd3c3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:13.854530 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0c799-245b-431f-aa80-d705530dd3c3 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:13.857510 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 512/1025] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:13.864007 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e196e-dd92-4598-b635-9e874b1de826 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:13.864296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e196e-dd92-4598-b635-9e874b1de826 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:13.864713 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e196e-dd92-4598-b635-9e874b1de826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:13.886460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-055e196e-dd92-4598-b635-9e874b1de826 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:13.887730 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-055e196e-dd92-4598-b635-9e874b1de826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:14.010517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 514/1026] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:21:14.523204 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0c799-245b-431f-aa80-d705530dd3c3 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:14.723609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0c799-245b-431f-aa80-d705530dd3c3 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:14.757995 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:14.794459 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d507e4-2b5a-4db3-89ad-874719c12cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:14.795194 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d507e4-2b5a-4db3-89ad-874719c12cdb None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:14.795696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d507e4-2b5a-4db3-89ad-874719c12cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:14.796189 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d507e4-2b5a-4db3-89ad-874719c12cdb None admin] PATH_INFO: `/v3/services/image` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:14.797305 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d507e4-2b5a-4db3-89ad-874719c12cdb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:14.800011 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d507e4-2b5a-4db3-89ad-874719c12cdb None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:14.818635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-03d507e4-2b5a-4db3-89ad-874719c12cdb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:21:14.818635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:14.818635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:21:14.818635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:21:14.818635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:21:14.818635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:21:14.818635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:21:14.818635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:21:14.818635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:21:14.818635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:21:14.818635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:21:14.818635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:21:14.818635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:14.818635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:14.818635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:14.818635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:14.818635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:14.820534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:14.820534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:14.820534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:14.820534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:14.820534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:14.820534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:14.820534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:21:14.820534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:21:14.820534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:21:14.820534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:21:14.820534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:14.820534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:14.820534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:14.820534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:14.820534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:14.820534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:14.826618 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:14.826618 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:14.826618 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:14.826618 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:14.826618 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:14.826618 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:14.826618 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:14.826618 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:14.826618 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:14.826618 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:14.826618 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:21:14.826618 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:21:14.826618 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:21:14.826618 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:21:14.826618 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 513/1027] 10.222.0.52 () {56 vars in 1105 bytes} [Thu Sep 1 16:21:14 2022] GET /identity/v3/services/image => generated 86 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:14.831663 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e196e-dd92-4598-b635-9e874b1de826 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:15.005765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:15.051557 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e196e-dd92-4598-b635-9e874b1de826 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:15.122377 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8ae50-f1e4-43a8-af31-1358d30dd60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:15.123749 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8ae50-f1e4-43a8-af31-1358d30dd60a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:15.124295 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8ae50-f1e4-43a8-af31-1358d30dd60a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:15.124845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8ae50-f1e4-43a8-af31-1358d30dd60a None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:15.126090 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8ae50-f1e4-43a8-af31-1358d30dd60a None admin] RBAC: Adding query filter params (name=image) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:15.126942 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8ae50-f1e4-43a8-af31-1358d30dd60a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:15.129958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8ae50-f1e4-43a8-af31-1358d30dd60a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:15.146159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 515/1028] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:21:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:15.148468 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d507e4-2b5a-4db3-89ad-874719c12cdb None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:15.324249 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d507e4-2b5a-4db3-89ad-874719c12cdb None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:15.370813 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691de915-d0c4-42a2-868b-e61bca86246f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:15.371441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691de915-d0c4-42a2-868b-e61bca86246f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:15.372008 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691de915-d0c4-42a2-868b-e61bca86246f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:15.372277 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691de915-d0c4-42a2-868b-e61bca86246f None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:15.372944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691de915-d0c4-42a2-868b-e61bca86246f None admin] RBAC: Adding query filter params (type=image) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:15.373248 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691de915-d0c4-42a2-868b-e61bca86246f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:15.374678 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691de915-d0c4-42a2-868b-e61bca86246f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:15.386671 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 514/1029] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:21:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:15.391413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8ae50-f1e4-43a8-af31-1358d30dd60a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:15.517616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8ae50-f1e4-43a8-af31-1358d30dd60a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:15.561973 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fe27e-ed4f-439c-a005-c4eedc70a98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:15.562598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fe27e-ed4f-439c-a005-c4eedc70a98c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:15.562940 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fe27e-ed4f-439c-a005-c4eedc70a98c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:15.563193 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fe27e-ed4f-439c-a005-c4eedc70a98c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:15.563925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134fe27e-ed4f-439c-a005-c4eedc70a98c None admin] RBAC: Adding query filter params (interface=public, service_id=d92e62bff0d24b8487ca7f138a9507bd, region_id=RegionOne) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:15.564343 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134fe27e-ed4f-439c-a005-c4eedc70a98c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:15.565855 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134fe27e-ed4f-439c-a005-c4eedc70a98c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:15.573110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 516/1030] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Sep 1 16:21:15 2022] GET /identity/v3/endpoints?service_id=d92e62bff0d24b8487ca7f138a9507bd&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:15.578975 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691de915-d0c4-42a2-868b-e61bca86246f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:15.648493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:15.764336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691de915-d0c4-42a2-868b-e61bca86246f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:15.832791 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7a8e1-b96c-4f9a-82b4-9a2283b5f486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:15.833805 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7a8e1-b96c-4f9a-82b4-9a2283b5f486 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:15.834294 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7a8e1-b96c-4f9a-82b4-9a2283b5f486 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:15.834798 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7a8e1-b96c-4f9a-82b4-9a2283b5f486 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:15.836196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7a8e1-b96c-4f9a-82b4-9a2283b5f486 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:15.840109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7a8e1-b96c-4f9a-82b4-9a2283b5f486 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:15.864672 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 515/1031] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Sep 1 16:21:15 2022] GET /identity/v3/services => generated 1957 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:21:16.506414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06175298-4271-48a0-8483-b1eae2b6fb0f None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:16.507276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06175298-4271-48a0-8483-b1eae2b6fb0f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:16.507276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06175298-4271-48a0-8483-b1eae2b6fb0f None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:16.509178 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 517/1032] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:21:16.514836 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c11115-e505-48d7-a9d7-e3abca9bc63c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:16.515214 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c11115-e505-48d7-a9d7-e3abca9bc63c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:16.515403 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c11115-e505-48d7-a9d7-e3abca9bc63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:16.535852 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-67c11115-e505-48d7-a9d7-e3abca9bc63c None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:16.537139 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-67c11115-e505-48d7-a9d7-e3abca9bc63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:16.643782 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 516/1033] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:21:16.724734 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc66b6-12ab-4813-9004-8c34006a5a8c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:16.725164 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc66b6-12ab-4813-9004-8c34006a5a8c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:16.725623 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc66b6-12ab-4813-9004-8c34006a5a8c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:16.729102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 518/1034] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:16.737962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6b58a-b5bc-4fa7-9a8f-5e2f75d040ea None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:16.738444 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6b58a-b5bc-4fa7-9a8f-5e2f75d040ea None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:16.738932 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6b58a-b5bc-4fa7-9a8f-5e2f75d040ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:16.772955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1ee6b58a-b5bc-4fa7-9a8f-5e2f75d040ea None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:16.775043 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1ee6b58a-b5bc-4fa7-9a8f-5e2f75d040ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:16.838189 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:16.928409 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 517/1035] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:21:16.930059 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc66b6-12ab-4813-9004-8c34006a5a8c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:16.955419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:17.142057 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc66b6-12ab-4813-9004-8c34006a5a8c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:17.203799 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6b58a-b5bc-4fa7-9a8f-5e2f75d040ea None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:17.214806 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db42843-aea5-4a0e-bc83-438559b8b115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:17.216457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db42843-aea5-4a0e-bc83-438559b8b115 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:17.217439 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db42843-aea5-4a0e-bc83-438559b8b115 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:17.218135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db42843-aea5-4a0e-bc83-438559b8b115 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:17.238308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db42843-aea5-4a0e-bc83-438559b8b115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:21:17.249326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-9db42843-aea5-4a0e-bc83-438559b8b115 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:21:17.249326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:17.249326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:17.249326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:17.249326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:17.249326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:17.249326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:17.249326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:17.249326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:17.249326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:17.249326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:17.249326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:17.249326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:21:17.249326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:21:17.249326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:21:17.249326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:21:17.250651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:21:17.250651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:21:17.250651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:21:17.250651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:21:17.250651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:17.250651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:17.250651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:17.250651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:17.250651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:17.250651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:17.250651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:17.250651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:17.250651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:17.250651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:17.250651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:17.250651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:17.252160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:17.252160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:17.252160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:17.252160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:17.252160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:21:17.252160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:21:17.252160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:21:17.252160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:21:17.252160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:21:17.252160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:21:17.252160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:21:17.252160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:17.252160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 519/1036] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:21:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:17.260721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db42843-aea5-4a0e-bc83-438559b8b115 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:17.358897 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:17.372472 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6b58a-b5bc-4fa7-9a8f-5e2f75d040ea None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:17.419948 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db42843-aea5-4a0e-bc83-438559b8b115 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:17.431474 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f4776-72f1-4e32-aaaa-22919a3d37ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:17.433114 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f4776-72f1-4e32-aaaa-22919a3d37ac None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:17.433549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f4776-72f1-4e32-aaaa-22919a3d37ac None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:17.434016 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f4776-72f1-4e32-aaaa-22919a3d37ac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:17.452387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f4776-72f1-4e32-aaaa-22919a3d37ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:21:17.457342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-1a0f4776-72f1-4e32-aaaa-22919a3d37ac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:21:17.457342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:17.457342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:17.457342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:17.457342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:17.457342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:17.457342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:17.457342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:17.457342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:17.457342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:17.457342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:17.457342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:17.457342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:21:17.457342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:21:17.457342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:21:17.457342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:21:17.459293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:21:17.459293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:21:17.459293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:21:17.459293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:21:17.459293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:17.459293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:17.459293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:17.459293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:17.459293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:17.459293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:17.459293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:17.459293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:17.459293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:17.459293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:17.459293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:17.459293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:17.461051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:17.461051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:17.461051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:17.461051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:17.461051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:21:17.461051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:21:17.461051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:21:17.461051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:21:17.461051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:21:17.461051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:21:17.461051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:21:17.461051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:21:17.461051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 518/1037] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Sep 1 16:21:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:21:17.465882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f4776-72f1-4e32-aaaa-22919a3d37ac None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:17.478311 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bad954-7eb0-4cd3-8c0b-3304e922a3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:17.478934 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bad954-7eb0-4cd3-8c0b-3304e922a3de None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:17.479191 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bad954-7eb0-4cd3-8c0b-3304e922a3de None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:17.479459 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bad954-7eb0-4cd3-8c0b-3304e922a3de None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:17.480125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bad954-7eb0-4cd3-8c0b-3304e922a3de None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:17.480420 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bad954-7eb0-4cd3-8c0b-3304e922a3de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:17.481879 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bad954-7eb0-4cd3-8c0b-3304e922a3de None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:17.497058 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 520/1038] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:21:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:17.502479 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bad954-7eb0-4cd3-8c0b-3304e922a3de None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:17.523557 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:17.643936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f4776-72f1-4e32-aaaa-22919a3d37ac None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:17.680696 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bad954-7eb0-4cd3-8c0b-3304e922a3de None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:17.692031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7760c02-1559-4fb2-bf97-a164b1b96356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:17.693027 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7760c02-1559-4fb2-bf97-a164b1b96356 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:17.693027 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7760c02-1559-4fb2-bf97-a164b1b96356 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:17.693286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7760c02-1559-4fb2-bf97-a164b1b96356 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:17.694071 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7760c02-1559-4fb2-bf97-a164b1b96356 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:17.694239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7760c02-1559-4fb2-bf97-a164b1b96356 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:17.696574 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7760c02-1559-4fb2-bf97-a164b1b96356 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:17.715827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 519/1039] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Sep 1 16:21:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:17.717831 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7760c02-1559-4fb2-bf97-a164b1b96356 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:17.741314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:17.749951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f05caa-abd4-4815-a617-ee256813f9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:17.751041 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f05caa-abd4-4815-a617-ee256813f9b0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:17.751527 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f05caa-abd4-4815-a617-ee256813f9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:17.752012 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f05caa-abd4-4815-a617-ee256813f9b0 None admin] PATH_INFO: `/v3/users/5f3db4a8937446e0ac01a47493e79bab` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:17.779113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f05caa-abd4-4815-a617-ee256813f9b0 None admin] RBAC: Authorizing `identity:get_user(user_id=5f3db4a8937446e0ac01a47493e79bab)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:17.781959 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f05caa-abd4-4815-a617-ee256813f9b0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:17.790784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 521/1040] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:21:17 2022] GET /identity/v3/users/5f3db4a8937446e0ac01a47493e79bab => generated 285 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:17.792981 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f05caa-abd4-4815-a617-ee256813f9b0 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:17.892314 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:17.909855 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7760c02-1559-4fb2-bf97-a164b1b96356 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:17.953789 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806cc2f-2db6-4bc8-a022-30b9d3977596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:17.954444 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806cc2f-2db6-4bc8-a022-30b9d3977596 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:17.954709 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806cc2f-2db6-4bc8-a022-30b9d3977596 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:17.954978 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806cc2f-2db6-4bc8-a022-30b9d3977596 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:17.968128 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5806cc2f-2db6-4bc8-a022-30b9d3977596 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:17.969685 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5806cc2f-2db6-4bc8-a022-30b9d3977596 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:17.987900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-5806cc2f-2db6-4bc8-a022-30b9d3977596 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:21:17.987900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:17.987900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:17.987900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:17.987900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:17.987900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:17.987900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:17.987900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:17.987900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:17.987900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:17.987900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:17.987900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:17.987900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:21:17.987900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:21:17.987900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:21:17.987900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:21:17.989808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:17.989808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:17.989808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:17.989808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:17.989808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:17.989808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:17.989808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:17.989808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:17.989808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:17.989808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:17.989808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:17.989808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:17.989808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:17.989808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:17.989808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:17.989808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:17.989808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:21:17.992145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:21:17.992145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:21:17.992145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:21:17.995399 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 520/1041] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:21:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:21:17.996046 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806cc2f-2db6-4bc8-a022-30b9d3977596 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:18.002328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f05caa-abd4-4815-a617-ee256813f9b0 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:18.075685 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801176c-5db7-4ace-86fc-92710a3c786d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:18.076737 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801176c-5db7-4ace-86fc-92710a3c786d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:18.077223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801176c-5db7-4ace-86fc-92710a3c786d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:18.077882 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801176c-5db7-4ace-86fc-92710a3c786d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:18.130508 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806cc2f-2db6-4bc8-a022-30b9d3977596 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:18.167931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:18.174548 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19787a75-3303-4c50-aff8-996c378d2dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:18.175175 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19787a75-3303-4c50-aff8-996c378d2dca None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:18.175453 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19787a75-3303-4c50-aff8-996c378d2dca None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:18.175725 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19787a75-3303-4c50-aff8-996c378d2dca None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:18.176387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19787a75-3303-4c50-aff8-996c378d2dca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:18.176724 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19787a75-3303-4c50-aff8-996c378d2dca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:18.178125 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19787a75-3303-4c50-aff8-996c378d2dca None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:18.182018 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801176c-5db7-4ace-86fc-92710a3c786d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:18.183508 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801176c-5db7-4ace-86fc-92710a3c786d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:18.192604 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 521/1042] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:18.193951 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82436d06-0957-4830-b575-a1865401d0e4 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:18.194298 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82436d06-0957-4830-b575-a1865401d0e4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:18.194559 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82436d06-0957-4830-b575-a1865401d0e4 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:18.195910 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 522/1043] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:18.201316 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82436d06-0957-4830-b575-a1865401d0e4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:18.204488 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:18.326078 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 522/1044] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:21:17 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:21:18.328280 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ceb56-bc45-4f17-a976-c7d0decce713 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:18.328835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ceb56-bc45-4f17-a976-c7d0decce713 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:18.329205 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ceb56-bc45-4f17-a976-c7d0decce713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:18.349826 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82436d06-0957-4830-b575-a1865401d0e4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:18.357784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c41ceb56-bc45-4f17-a976-c7d0decce713 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:18.360128 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c41ceb56-bc45-4f17-a976-c7d0decce713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:18.405730 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237b3da-1a3c-49fe-950c-36e27e1ba832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:18.406376 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237b3da-1a3c-49fe-950c-36e27e1ba832 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:18.406670 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237b3da-1a3c-49fe-950c-36e27e1ba832 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:18.406907 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237b3da-1a3c-49fe-950c-36e27e1ba832 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:18.415680 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237b3da-1a3c-49fe-950c-36e27e1ba832 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:18.417198 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237b3da-1a3c-49fe-950c-36e27e1ba832 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:18.431200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-b237b3da-1a3c-49fe-950c-36e27e1ba832 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:21:18.431200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:18.431200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:18.431200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:18.431200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:18.431200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:18.431200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:18.431200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:18.431200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:18.431200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:18.431200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:18.431200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:18.431200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:21:18.431200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:21:18.431200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:21:18.431200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:21:18.433201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:18.433201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:18.433201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:21:18.433201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:21:18.433201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:21:18.433201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:21:18.433201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:18.433201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:18.433201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:18.433201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:18.433201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:18.433201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:18.433201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:18.433201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:18.433201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:18.433201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:18.433201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:18.433201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:18.435043 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:18.435043 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:18.435043 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:21:18.435043 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:21:18.435043 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:21:18.435043 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:21:18.435043 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:21:18.435043 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:21:18.435043 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:21:18.435043 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:21:18.435043 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 523/1045] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Sep 1 16:21:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:18.435043 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237b3da-1a3c-49fe-950c-36e27e1ba832 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:18.472836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 523/1046] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:18.474624 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ceb56-bc45-4f17-a976-c7d0decce713 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:18.522588 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:18.523635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:18.602310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237b3da-1a3c-49fe-950c-36e27e1ba832 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:18.659892 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34509350-c90d-4ce4-b704-06a493dd6103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:18.660920 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34509350-c90d-4ce4-b704-06a493dd6103 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:18.661096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34509350-c90d-4ce4-b704-06a493dd6103 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:18.661543 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34509350-c90d-4ce4-b704-06a493dd6103 None admin] PATH_INFO: `/v3/projects/30d8b4c5971e4749af20c3d4bee02af4` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:18.662622 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34509350-c90d-4ce4-b704-06a493dd6103 None admin] RBAC: Authorizing `identity:get_project(project_id=30d8b4c5971e4749af20c3d4bee02af4)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:18.663778 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ceb56-bc45-4f17-a976-c7d0decce713 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:18.664106 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34509350-c90d-4ce4-b704-06a493dd6103 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:18.666299 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 524/1047] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:21:18 2022] GET /identity/v3/projects/30d8b4c5971e4749af20c3d4bee02af4 => generated 311 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:18.672699 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34509350-c90d-4ce4-b704-06a493dd6103 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:18.730926 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc9d83-ad80-427f-9cf1-5dd4b557657e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:18.730926 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc9d83-ad80-427f-9cf1-5dd4b557657e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:18.730926 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc9d83-ad80-427f-9cf1-5dd4b557657e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:18.731950 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc9d83-ad80-427f-9cf1-5dd4b557657e None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:18.731950 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc9d83-ad80-427f-9cf1-5dd4b557657e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:18.732176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc9d83-ad80-427f-9cf1-5dd4b557657e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:18.733730 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc9d83-ad80-427f-9cf1-5dd4b557657e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:18.759367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 524/1048] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Sep 1 16:21:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:18.767321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc9d83-ad80-427f-9cf1-5dd4b557657e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:18.826147 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34509350-c90d-4ce4-b704-06a493dd6103 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:18.869645 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:18.881056 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfee754-09dc-48c2-a94a-395bbfe83595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:18.882053 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfee754-09dc-48c2-a94a-395bbfe83595 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:18.882458 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfee754-09dc-48c2-a94a-395bbfe83595 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:18.882853 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfee754-09dc-48c2-a94a-395bbfe83595 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:18.884606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfee754-09dc-48c2-a94a-395bbfe83595 None admin] RBAC: Adding query filter params (role.id=a8896546a02c42489ef73c7ad7c43542, scope.project.id=30d8b4c5971e4749af20c3d4bee02af4, user.id=5f3db4a8937446e0ac01a47493e79bab) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:18.885101 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfee754-09dc-48c2-a94a-395bbfe83595 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:18.887443 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfee754-09dc-48c2-a94a-395bbfe83595 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:18.908658 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 525/1049] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:21:18 2022] GET /identity/v3/role_assignments?user.id=5f3db4a8937446e0ac01a47493e79bab&scope.project.id=30d8b4c5971e4749af20c3d4bee02af4&role.id=a8896546a02c42489ef73c7ad7c43542 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:18.912672 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:18.923521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfee754-09dc-48c2-a94a-395bbfe83595 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:18.949132 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc9d83-ad80-427f-9cf1-5dd4b557657e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:18.999913 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc79f4-5036-45cb-ad55-cde25fd6318e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:19.000520 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc79f4-5036-45cb-ad55-cde25fd6318e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:19.000836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc79f4-5036-45cb-ad55-cde25fd6318e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:19.001115 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc79f4-5036-45cb-ad55-cde25fd6318e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:19.111948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfee754-09dc-48c2-a94a-395bbfe83595 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:19.124220 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc79f4-5036-45cb-ad55-cde25fd6318e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:19.125914 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc79f4-5036-45cb-ad55-cde25fd6318e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:19.181712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f5e78-a492-4447-873a-fe604b8bb1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:19.182785 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f5e78-a492-4447-873a-fe604b8bb1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:19.183256 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f5e78-a492-4447-873a-fe604b8bb1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:19.183711 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f5e78-a492-4447-873a-fe604b8bb1f9 None admin] PATH_INFO: `/v3/services/image` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:19.184807 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f5e78-a492-4447-873a-fe604b8bb1f9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:19.187370 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f5e78-a492-4447-873a-fe604b8bb1f9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:19.205933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-366f5e78-a492-4447-873a-fe604b8bb1f9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:21:19.205933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:19.205933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:21:19.205933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:21:19.205933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:21:19.205933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:21:19.205933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:21:19.205933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:21:19.205933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:21:19.205933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:21:19.205933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:21:19.205933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:21:19.205933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:19.205933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:19.205933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:19.205933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:19.205933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:19.206997 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:19.206997 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:19.206997 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:19.206997 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:19.206997 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:19.206997 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:19.206997 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:21:19.206997 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:21:19.206997 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:21:19.206997 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:21:19.206997 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:19.206997 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:19.206997 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:19.206997 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:19.206997 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:19.206997 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:19.207862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:19.207862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:19.207862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:19.207862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:19.207862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:19.207862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:19.207862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:19.207862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:19.207862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:19.207862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:19.207862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:21:19.207862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:21:19.207862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:21:19.207862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:21:19.213151 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 526/1050] 10.222.0.52 () {56 vars in 1105 bytes} [Thu Sep 1 16:21:18 2022] GET /identity/v3/services/image => generated 86 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:19.218222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f5e78-a492-4447-873a-fe604b8bb1f9 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:19.274217 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:19.322711 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 525/1051] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:21:18 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 16:21:19.325977 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:19.330066 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc79f4-5036-45cb-ad55-cde25fd6318e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:19.401732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f5e78-a492-4447-873a-fe604b8bb1f9 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:19.462317 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec0b12-6d95-4fc0-bcd5-47fc1aeec572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:19.463161 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec0b12-6d95-4fc0-bcd5-47fc1aeec572 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:19.463600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec0b12-6d95-4fc0-bcd5-47fc1aeec572 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:19.464000 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec0b12-6d95-4fc0-bcd5-47fc1aeec572 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:19.464841 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec0b12-6d95-4fc0-bcd5-47fc1aeec572 None admin] RBAC: Adding query filter params (name=image) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:19.465342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec0b12-6d95-4fc0-bcd5-47fc1aeec572 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:19.467021 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec0b12-6d95-4fc0-bcd5-47fc1aeec572 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:19.473318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 527/1052] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:21:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:19.482149 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec0b12-6d95-4fc0-bcd5-47fc1aeec572 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:19.501182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc79f4-5036-45cb-ad55-cde25fd6318e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:19.545671 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89159d5a-a1af-4c98-ac3c-ed94923b32c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:19.546380 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89159d5a-a1af-4c98-ac3c-ed94923b32c6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:19.546764 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89159d5a-a1af-4c98-ac3c-ed94923b32c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:19.547140 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89159d5a-a1af-4c98-ac3c-ed94923b32c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:19.560150 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89159d5a-a1af-4c98-ac3c-ed94923b32c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:19.561856 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89159d5a-a1af-4c98-ac3c-ed94923b32c6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:19.586008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-89159d5a-a1af-4c98-ac3c-ed94923b32c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:21:19.586008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:19.586008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:19.586008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:19.586008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:19.586008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:19.586008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:19.586008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:19.586008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:19.586008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:19.586008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:19.586008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:19.586008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:21:19.586008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:21:19.586008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:21:19.586008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:21:19.589198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:19.589198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:19.589198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:19.589198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:19.589198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:19.589198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:19.589198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:19.589198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:19.589198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:19.589198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:19.589198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:19.589198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:19.589198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:19.589198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:19.589198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:19.589198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:19.589198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:21:19.590835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:21:19.590835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:21:19.590835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:19.592732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 526/1053] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:21:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:19.593581 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89159d5a-a1af-4c98-ac3c-ed94923b32c6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:19.635168 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:19.673615 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec0b12-6d95-4fc0-bcd5-47fc1aeec572 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:19.708813 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:19.730036 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3a06d-070d-4491-9434-8b2d8e1ad1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:19.730935 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3a06d-070d-4491-9434-8b2d8e1ad1fb None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:19.731210 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3a06d-070d-4491-9434-8b2d8e1ad1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:19.731484 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3a06d-070d-4491-9434-8b2d8e1ad1fb None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:19.732127 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3a06d-070d-4491-9434-8b2d8e1ad1fb None admin] RBAC: Adding query filter params (type=image) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:19.732425 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3a06d-070d-4491-9434-8b2d8e1ad1fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:19.733445 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89159d5a-a1af-4c98-ac3c-ed94923b32c6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:19.734130 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3a06d-070d-4491-9434-8b2d8e1ad1fb None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:19.741227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 528/1054] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:21:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:19.747954 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3a06d-070d-4491-9434-8b2d8e1ad1fb None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:19.782390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee43e0-27b0-4294-a22f-a0aae513f348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:19.783083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee43e0-27b0-4294-a22f-a0aae513f348 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:19.783375 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee43e0-27b0-4294-a22f-a0aae513f348 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:19.783660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee43e0-27b0-4294-a22f-a0aae513f348 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:19.784370 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee43e0-27b0-4294-a22f-a0aae513f348 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:19.784700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee43e0-27b0-4294-a22f-a0aae513f348 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:19.786138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee43e0-27b0-4294-a22f-a0aae513f348 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:19.809910 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 527/1055] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:19.812802 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee43e0-27b0-4294-a22f-a0aae513f348 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:19.941089 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3a06d-070d-4491-9434-8b2d8e1ad1fb None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:19.945674 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:19.958944 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee43e0-27b0-4294-a22f-a0aae513f348 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:20.002540 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea24a8-8ac2-4c02-b900-e6e47dd98e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:20.003303 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea24a8-8ac2-4c02-b900-e6e47dd98e2e None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:20.003691 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea24a8-8ac2-4c02-b900-e6e47dd98e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:20.004264 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea24a8-8ac2-4c02-b900-e6e47dd98e2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:20.004927 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc6113-8c37-4410-9a03-4efa0d0fde4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:20.005630 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc6113-8c37-4410-9a03-4efa0d0fde4e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:20.005907 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc6113-8c37-4410-9a03-4efa0d0fde4e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:20.006170 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea24a8-8ac2-4c02-b900-e6e47dd98e2e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:20.006318 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc6113-8c37-4410-9a03-4efa0d0fde4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:20.007812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea24a8-8ac2-4c02-b900-e6e47dd98e2e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:20.014427 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc6113-8c37-4410-9a03-4efa0d0fde4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:20.015934 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc6113-8c37-4410-9a03-4efa0d0fde4e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:20.035457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-66bc6113-8c37-4410-9a03-4efa0d0fde4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:21:20.035457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:20.035457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:20.035457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:20.035457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:20.035457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:20.035457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:20.035457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:20.035457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:20.035457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:20.035457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:20.035457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:20.035457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:21:20.035457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:21:20.035457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:21:20.036483 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:21:20.036483 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:20.036483 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:20.036483 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:20.036483 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:20.036483 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:20.036483 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:20.036483 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:20.036483 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:20.036483 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:20.036483 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:20.036483 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:20.036483 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:20.036483 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:20.036483 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:20.036483 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:20.036483 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:20.037529 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:21:20.037529 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:21:20.037529 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:21:20.037529 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:21:20.037529 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:21:20.037529 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:21:20.037529 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:21:20.037529 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:20.038118 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 528/1056] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:21:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:21:20.048368 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc6113-8c37-4410-9a03-4efa0d0fde4e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:20.055694 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 529/1057] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:21:19 2022] POST /identity/v3/endpoints => generated 327 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:21:20.263230 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc6113-8c37-4410-9a03-4efa0d0fde4e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:20.347690 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96c92b-a2dd-4d31-a504-aabacf65b0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:20.348832 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96c92b-a2dd-4d31-a504-aabacf65b0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:20.349320 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96c92b-a2dd-4d31-a504-aabacf65b0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:20.349876 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96c92b-a2dd-4d31-a504-aabacf65b0c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:20.351107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96c92b-a2dd-4d31-a504-aabacf65b0c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:20.351618 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96c92b-a2dd-4d31-a504-aabacf65b0c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:20.354611 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96c92b-a2dd-4d31-a504-aabacf65b0c8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:20.386573 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 529/1058] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:21:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:20.391322 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea24a8-8ac2-4c02-b900-e6e47dd98e2e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:20.475304 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:20.601689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea24a8-8ac2-4c02-b900-e6e47dd98e2e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:20.673302 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f8b91-74b2-4047-a86b-fe26b92b93c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:20.674338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f8b91-74b2-4047-a86b-fe26b92b93c5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:20.675269 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f8b91-74b2-4047-a86b-fe26b92b93c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:20.675269 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f8b91-74b2-4047-a86b-fe26b92b93c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:20.676655 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f8b91-74b2-4047-a86b-fe26b92b93c5 None admin] RBAC: Adding query filter params (role.id=dd6eda7c9f7d4778ab381591e492859d, scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f, user.id=55f389ab3ea046008b44f129113de995) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:20.677194 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f8b91-74b2-4047-a86b-fe26b92b93c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:20.679437 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f8b91-74b2-4047-a86b-fe26b92b93c5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:20.697212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 530/1059] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:21:20 2022] GET /identity/v3/role_assignments?user.id=55f389ab3ea046008b44f129113de995&scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f&role.id=dd6eda7c9f7d4778ab381591e492859d => generated 259 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:21.019576 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1705031-2ba8-4404-aa51-a8d3300a3fb5 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:21.020157 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1705031-2ba8-4404-aa51-a8d3300a3fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:21.020157 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1705031-2ba8-4404-aa51-a8d3300a3fb5 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:21.021840 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 530/1060] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:21:21.028473 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f766f-7ace-4bd4-a038-e9466290a508 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:21.028794 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f766f-7ace-4bd4-a038-e9466290a508 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:21.029050 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f766f-7ace-4bd4-a038-e9466290a508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:21.053749 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4f5f766f-7ace-4bd4-a038-e9466290a508 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:21.053749 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4f5f766f-7ace-4bd4-a038-e9466290a508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:21.136663 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 531/1061] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:21.419358 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1705031-2ba8-4404-aa51-a8d3300a3fb5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:21.433224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:21.543724 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1705031-2ba8-4404-aa51-a8d3300a3fb5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:21.583338 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021a3e0-68fc-44c5-80e5-a736902c03de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:21.583985 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021a3e0-68fc-44c5-80e5-a736902c03de None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:21.584263 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021a3e0-68fc-44c5-80e5-a736902c03de None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:21.584533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021a3e0-68fc-44c5-80e5-a736902c03de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:21.597473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021a3e0-68fc-44c5-80e5-a736902c03de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:21:21.602767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-7021a3e0-68fc-44c5-80e5-a736902c03de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:21:21.602767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:21.602767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:21.602767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:21.602767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:21.602767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:21.602767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:21.602767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:21.602767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:21.602767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:21.602767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:21.602767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:21.602767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:21:21.602767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:21:21.602767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:21:21.602767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:21:21.603839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:21:21.603839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:21:21.603839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:21:21.603839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:21:21.603839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:21.603839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:21.603839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:21.603839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:21.603839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:21.603839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:21.603839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:21.603839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:21.603839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:21.603839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:21.603839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:21.603839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:21.605341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:21.605341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:21.605341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:21.605341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:21.605341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:21:21.605341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:21:21.605341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:21:21.605341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:21:21.605341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:21:21.605341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:21:21.605341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:21:21.605341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:21.609046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 531/1062] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:21:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:21.610389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f766f-7ace-4bd4-a038-e9466290a508 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:21.651684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:21.730281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f766f-7ace-4bd4-a038-e9466290a508 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:21.772272 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff21ca3-96f4-4f8f-b060-c89bc8a811ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:21.772937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff21ca3-96f4-4f8f-b060-c89bc8a811ab None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:21.773215 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff21ca3-96f4-4f8f-b060-c89bc8a811ab None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:21.773482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff21ca3-96f4-4f8f-b060-c89bc8a811ab None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:21.774831 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff21ca3-96f4-4f8f-b060-c89bc8a811ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:21.775131 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff21ca3-96f4-4f8f-b060-c89bc8a811ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:21.776555 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff21ca3-96f4-4f8f-b060-c89bc8a811ab None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:21.791874 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 532/1063] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:21:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:21.793821 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021a3e0-68fc-44c5-80e5-a736902c03de None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:21.917689 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:21.994957 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021a3e0-68fc-44c5-80e5-a736902c03de None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:22.068714 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6143c6-8991-4d40-b2dd-9713d124bf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:22.069742 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6143c6-8991-4d40-b2dd-9713d124bf47 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:22.069899 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6143c6-8991-4d40-b2dd-9713d124bf47 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:22.070256 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6143c6-8991-4d40-b2dd-9713d124bf47 None admin] PATH_INFO: `/v3/users/5f3db4a8937446e0ac01a47493e79bab` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:22.072471 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6143c6-8991-4d40-b2dd-9713d124bf47 None admin] RBAC: Authorizing `identity:get_user(user_id=5f3db4a8937446e0ac01a47493e79bab)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:22.074452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6143c6-8991-4d40-b2dd-9713d124bf47 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:22.077657 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 532/1064] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:21:21 2022] GET /identity/v3/users/5f3db4a8937446e0ac01a47493e79bab => generated 285 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:22.086306 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff21ca3-96f4-4f8f-b060-c89bc8a811ab None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:22.266449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6b044-a802-4a63-bbf2-11ebac9beff3 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:22.266696 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6b044-a802-4a63-bbf2-11ebac9beff3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:22.267024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6b044-a802-4a63-bbf2-11ebac9beff3 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:22.268267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 533/1065] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:21:22.274080 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17d76e-8344-4895-afd1-e44abba5b4db None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:22.274341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17d76e-8344-4895-afd1-e44abba5b4db None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:22.274624 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17d76e-8344-4895-afd1-e44abba5b4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:22.282090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:22.291058 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff21ca3-96f4-4f8f-b060-c89bc8a811ab None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:22.294884 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2e17d76e-8344-4895-afd1-e44abba5b4db None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:22.296124 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2e17d76e-8344-4895-afd1-e44abba5b4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:22.344459 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b90d56-97c5-4056-acce-3dcd1eed0629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:22.345134 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b90d56-97c5-4056-acce-3dcd1eed0629 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:22.345436 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b90d56-97c5-4056-acce-3dcd1eed0629 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:22.345803 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b90d56-97c5-4056-acce-3dcd1eed0629 None admin] PATH_INFO: `/v3/projects/30d8b4c5971e4749af20c3d4bee02af4` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:22.348210 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b90d56-97c5-4056-acce-3dcd1eed0629 None admin] RBAC: Authorizing `identity:get_project(project_id=30d8b4c5971e4749af20c3d4bee02af4)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:22.349811 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b90d56-97c5-4056-acce-3dcd1eed0629 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:22.352597 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 533/1066] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:21:22 2022] GET /identity/v3/projects/30d8b4c5971e4749af20c3d4bee02af4 => generated 311 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:22.359478 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b90d56-97c5-4056-acce-3dcd1eed0629 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:22.389263 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 534/1067] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:21:22.553183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b90d56-97c5-4056-acce-3dcd1eed0629 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:22.599864 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf683f0-f05b-4f28-a782-8260ffa5e4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:22.600539 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf683f0-f05b-4f28-a782-8260ffa5e4c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:22.600889 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf683f0-f05b-4f28-a782-8260ffa5e4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:22.601124 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf683f0-f05b-4f28-a782-8260ffa5e4c1 None admin] PATH_INFO: `/v3/projects/30d8b4c5971e4749af20c3d4bee02af4/users/5f3db4a8937446e0ac01a47493e79bab/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:22.603769 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf683f0-f05b-4f28-a782-8260ffa5e4c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=30d8b4c5971e4749af20c3d4bee02af4, user_id=5f3db4a8937446e0ac01a47493e79bab, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:22.605270 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf683f0-f05b-4f28-a782-8260ffa5e4c1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:22.623203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 534/1068] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 1 16:21:22 2022] PUT /identity/v3/projects/30d8b4c5971e4749af20c3d4bee02af4/users/5f3db4a8937446e0ac01a47493e79bab/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:21:22.668926 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17d76e-8344-4895-afd1-e44abba5b4db None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:22.800594 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:22.881749 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17d76e-8344-4895-afd1-e44abba5b4db None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:22.951851 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c764916-da15-4cde-a329-cad3b8acb8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:22.952496 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c764916-da15-4cde-a329-cad3b8acb8be None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:22.952827 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c764916-da15-4cde-a329-cad3b8acb8be None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:22.953101 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c764916-da15-4cde-a329-cad3b8acb8be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:23.061264 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c764916-da15-4cde-a329-cad3b8acb8be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:23.062927 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c764916-da15-4cde-a329-cad3b8acb8be None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:23.149870 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:23.204691 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 535/1069] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:21:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:21:23.210244 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf683f0-f05b-4f28-a782-8260ffa5e4c1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:23.249390 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:23.342758 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf683f0-f05b-4f28-a782-8260ffa5e4c1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:23.390512 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0447b-7e90-471f-81e6-8ae224866aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:23.391459 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0447b-7e90-471f-81e6-8ae224866aff None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:23.391738 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0447b-7e90-471f-81e6-8ae224866aff None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:23.391901 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1481635-9b0d-4a1e-9ed2-9cb587392f23 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:23.392059 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0447b-7e90-471f-81e6-8ae224866aff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:23.392334 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1481635-9b0d-4a1e-9ed2-9cb587392f23 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:23.392925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1481635-9b0d-4a1e-9ed2-9cb587392f23 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:23.395727 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 536/1070] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:21:23.401890 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426daa1-e880-419c-b166-f7a0e05785bf None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:23.402071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426daa1-e880-419c-b166-f7a0e05785bf None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:23.402353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426daa1-e880-419c-b166-f7a0e05785bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:23.413812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0447b-7e90-471f-81e6-8ae224866aff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:23.416762 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0447b-7e90-471f-81e6-8ae224866aff None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:23.423365 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5426daa1-e880-419c-b166-f7a0e05785bf None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:23.424732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5426daa1-e880-419c-b166-f7a0e05785bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:23.446948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-c9b0447b-7e90-471f-81e6-8ae224866aff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:21:23.446948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:23.446948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:23.446948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:23.446948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:23.446948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:23.446948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:23.446948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:23.446948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:23.446948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:23.446948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:23.446948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:23.446948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:21:23.446948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:21:23.446948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:21:23.446948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:21:23.449233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:23.449233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:23.449233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:23.449233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:23.449233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:23.449233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:23.449233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:23.449233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:23.449233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:23.449233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:23.449233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:23.449233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:23.449233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:23.449233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:23.449233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:23.449233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:23.449233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:21:23.451203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:21:23.451203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:21:23.451203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:21:23.451203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 535/1071] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:21:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:21:23.455561 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0447b-7e90-471f-81e6-8ae224866aff None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:23.543753 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 537/1072] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:21:23.572081 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:23.600183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0447b-7e90-471f-81e6-8ae224866aff None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:23.646185 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548d80d-719c-4133-9f23-f897c2563114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:23.646807 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548d80d-719c-4133-9f23-f897c2563114 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:23.647080 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548d80d-719c-4133-9f23-f897c2563114 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:23.647352 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548d80d-719c-4133-9f23-f897c2563114 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:23.648005 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548d80d-719c-4133-9f23-f897c2563114 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:23.648298 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548d80d-719c-4133-9f23-f897c2563114 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:23.649799 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548d80d-719c-4133-9f23-f897c2563114 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:23.669393 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 536/1073] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:24.060975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426daa1-e880-419c-b166-f7a0e05785bf None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:24.177301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:24.185616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426daa1-e880-419c-b166-f7a0e05785bf None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:24.225868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f8938-c607-43d4-af37-dc88f9cf0541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:24.226569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f8938-c607-43d4-af37-dc88f9cf0541 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:24.226848 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f8938-c607-43d4-af37-dc88f9cf0541 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:24.227111 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f8938-c607-43d4-af37-dc88f9cf0541 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:24.239619 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f8938-c607-43d4-af37-dc88f9cf0541 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:21:24.245023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-b00f8938-c607-43d4-af37-dc88f9cf0541 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:21:24.245023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:24.245023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:24.245023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:24.245023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:24.245023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:24.245023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:24.245023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:24.245023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:24.245023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:24.245023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:24.245023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:24.245023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:21:24.245023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:21:24.245023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:21:24.245023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:21:24.249158 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:21:24.249158 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:21:24.249158 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:21:24.249158 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:21:24.249158 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:24.249158 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:24.249158 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:24.249158 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:24.249158 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:24.249158 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:24.249158 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:24.249158 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:24.249158 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:24.249158 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:24.249158 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:24.249158 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:24.249998 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:24.249998 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:24.249998 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:24.249998 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:24.249998 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:21:24.249998 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:21:24.249998 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:21:24.249998 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:21:24.249998 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:21:24.249998 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:21:24.249998 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:21:24.249998 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:24.249998 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 538/1074] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Sep 1 16:21:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:24.255899 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548d80d-719c-4133-9f23-f897c2563114 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:24.402192 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548d80d-719c-4133-9f23-f897c2563114 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:24.457957 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149391ff-3e94-44f2-a5db-812bb4831ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:24.458579 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149391ff-3e94-44f2-a5db-812bb4831ebf None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:24.458853 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149391ff-3e94-44f2-a5db-812bb4831ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:24.459125 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149391ff-3e94-44f2-a5db-812bb4831ebf None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:24.459818 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149391ff-3e94-44f2-a5db-812bb4831ebf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:24.460120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149391ff-3e94-44f2-a5db-812bb4831ebf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:24.461615 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149391ff-3e94-44f2-a5db-812bb4831ebf None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:24.467963 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:24.472054 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 537/1075] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Sep 1 16:21:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:24.479359 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f8938-c607-43d4-af37-dc88f9cf0541 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:24.677702 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f8938-c607-43d4-af37-dc88f9cf0541 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:24.721060 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8da87-c4f4-4455-a7a9-6b9ea8c2ef53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:24.721706 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8da87-c4f4-4455-a7a9-6b9ea8c2ef53 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:24.721975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8da87-c4f4-4455-a7a9-6b9ea8c2ef53 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:24.722245 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8da87-c4f4-4455-a7a9-6b9ea8c2ef53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:24.736434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8da87-c4f4-4455-a7a9-6b9ea8c2ef53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:24.738144 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8da87-c4f4-4455-a7a9-6b9ea8c2ef53 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:24.757180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-95f8da87-c4f4-4455-a7a9-6b9ea8c2ef53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:21:24.757180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:24.757180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:24.757180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:24.757180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:24.757180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:24.757180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:24.757180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:24.757180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:24.757180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:24.757180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:24.757180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:24.757180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:21:24.757180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:21:24.757180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:21:24.757180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:21:24.759738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:24.759738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:24.759738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:24.759738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:24.759738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:24.759738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:24.759738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:24.759738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:24.759738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:24.759738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:24.759738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:24.759738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:24.759738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:24.759738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:24.759738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:24.759738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:24.759738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:21:24.761568 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:21:24.761568 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:21:24.761568 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:24.761568 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 539/1076] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:21:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:21:24.766302 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149391ff-3e94-44f2-a5db-812bb4831ebf None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:24.963033 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149391ff-3e94-44f2-a5db-812bb4831ebf None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:24.989163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b82e88-45c7-4f68-bfbd-f8bc592e46e3 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:24.989485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b82e88-45c7-4f68-bfbd-f8bc592e46e3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:24.989701 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b82e88-45c7-4f68-bfbd-f8bc592e46e3 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:24.991137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 540/1077] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:21:25.000322 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094213f-f96e-44c2-8730-dbc06c2b3442 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:25.000602 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094213f-f96e-44c2-8730-dbc06c2b3442 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:25.000909 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094213f-f96e-44c2-8730-dbc06c2b3442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:25.013037 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f113a-ac8a-4dbb-8f8a-0af64cd6b7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:25.014084 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f113a-ac8a-4dbb-8f8a-0af64cd6b7cb None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:25.014570 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f113a-ac8a-4dbb-8f8a-0af64cd6b7cb None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:25.015046 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f113a-ac8a-4dbb-8f8a-0af64cd6b7cb None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:25.016206 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f113a-ac8a-4dbb-8f8a-0af64cd6b7cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:25.016758 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f113a-ac8a-4dbb-8f8a-0af64cd6b7cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:25.019430 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f113a-ac8a-4dbb-8f8a-0af64cd6b7cb None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:25.021831 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:25.039491 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 538/1078] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:25.039735 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d094213f-f96e-44c2-8730-dbc06c2b3442 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:25.039735 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d094213f-f96e-44c2-8730-dbc06c2b3442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:25.040965 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f113a-ac8a-4dbb-8f8a-0af64cd6b7cb None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:25.125243 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:25.136310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 541/1079] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:21:25.178676 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f113a-ac8a-4dbb-8f8a-0af64cd6b7cb None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:25.218752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ad448-5c85-4506-b164-6bb2e7e5ea6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:25.219444 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ad448-5c85-4506-b164-6bb2e7e5ea6b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:25.219916 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ad448-5c85-4506-b164-6bb2e7e5ea6b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:25.220297 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ad448-5c85-4506-b164-6bb2e7e5ea6b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:25.230754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ad448-5c85-4506-b164-6bb2e7e5ea6b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:25.232364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ad448-5c85-4506-b164-6bb2e7e5ea6b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:25.246763 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-2e7ad448-5c85-4506-b164-6bb2e7e5ea6b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:21:25.246763 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:25.246763 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:25.246763 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:25.246763 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:25.246763 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:25.246763 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:25.246763 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:25.246763 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:25.246763 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:25.246763 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:25.246763 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:25.246763 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:21:25.246763 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:21:25.246763 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:21:25.246763 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:21:25.248861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:25.248861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:25.248861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:21:25.248861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:21:25.248861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:21:25.248861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:21:25.248861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:25.248861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:25.248861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:25.248861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:25.248861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:25.248861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:25.248861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:25.248861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:25.248861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:25.248861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:25.248861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:25.248861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:25.250529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:25.250529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:25.250529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:21:25.250529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:21:25.250529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:21:25.250529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:21:25.250529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:21:25.250529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:21:25.250529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:21:25.250529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:21:25.250529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 539/1080] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Sep 1 16:21:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:25.254852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094213f-f96e-44c2-8730-dbc06c2b3442 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:25.379438 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094213f-f96e-44c2-8730-dbc06c2b3442 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:25.419323 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ad448-5c85-4506-b164-6bb2e7e5ea6b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:25.420477 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6cb76f-eace-4760-97a6-2c7f1ad2cabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:25.421141 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cb76f-eace-4760-97a6-2c7f1ad2cabd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:25.421422 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cb76f-eace-4760-97a6-2c7f1ad2cabd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:25.421696 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cb76f-eace-4760-97a6-2c7f1ad2cabd None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:25.422458 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6cb76f-eace-4760-97a6-2c7f1ad2cabd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:25.422767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6cb76f-eace-4760-97a6-2c7f1ad2cabd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:25.424271 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6cb76f-eace-4760-97a6-2c7f1ad2cabd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:25.427806 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:25.454140 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 542/1081] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Sep 1 16:21:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:25.455644 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6cb76f-eace-4760-97a6-2c7f1ad2cabd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:25.580229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6cb76f-eace-4760-97a6-2c7f1ad2cabd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:25.590672 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ad448-5c85-4506-b164-6bb2e7e5ea6b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:25.615395 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:25.640259 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88c3c2-8dd2-4f74-a254-40d04a2bc1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:25.641447 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88c3c2-8dd2-4f74-a254-40d04a2bc1fe None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:25.641878 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88c3c2-8dd2-4f74-a254-40d04a2bc1fe None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:25.641975 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ec0f8-fcbb-4078-bc99-ffee599ca582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:25.642330 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88c3c2-8dd2-4f74-a254-40d04a2bc1fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:25.642940 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ec0f8-fcbb-4078-bc99-ffee599ca582 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:25.643855 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ec0f8-fcbb-4078-bc99-ffee599ca582 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:25.644491 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ec0f8-fcbb-4078-bc99-ffee599ca582 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:25.659651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88c3c2-8dd2-4f74-a254-40d04a2bc1fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:25.661539 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88c3c2-8dd2-4f74-a254-40d04a2bc1fe None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:25.662547 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ec0f8-fcbb-4078-bc99-ffee599ca582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:21:25.668145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-b17ec0f8-fcbb-4078-bc99-ffee599ca582 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:21:25.668145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:25.668145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:25.668145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:25.668145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:25.668145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:25.668145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:25.668145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:25.668145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:25.668145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:25.668145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:25.668145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:25.668145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:21:25.668145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:21:25.668145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:21:25.668145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:21:25.670082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:21:25.670082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:21:25.670082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:21:25.670082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:21:25.670082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:25.670082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:25.670082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:25.670082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:25.670082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:25.670082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:25.670082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:25.670082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:25.670082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:25.670082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:25.670082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:25.670082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:25.672098 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:25.672098 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:25.672098 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:25.672098 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:25.672098 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:21:25.672098 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:21:25.672098 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:21:25.672098 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:21:25.672098 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:21:25.672098 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:21:25.672098 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:21:25.672098 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:21:25.672098 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 540/1082] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:21:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:21:25.680119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ec0f8-fcbb-4078-bc99-ffee599ca582 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:25.685648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-ef88c3c2-8dd2-4f74-a254-40d04a2bc1fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:21:25.685648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:25.685648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:25.685648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:25.685648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:25.685648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:25.685648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:25.685648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:25.685648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:25.685648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:25.685648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:25.685648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:25.685648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:21:25.685648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:21:25.685648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:21:25.685648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:21:25.688770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:25.688770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:25.688770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:25.688770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:25.688770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:25.688770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:25.688770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:25.688770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:25.688770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:25.688770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:25.688770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:25.688770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:25.688770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:25.688770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:25.688770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:25.688770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:25.688770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:21:25.690604 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:21:25.690604 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:21:25.690604 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:25.690604 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 543/1083] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:21:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:25.694532 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88c3c2-8dd2-4f74-a254-40d04a2bc1fe None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:25.760555 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:25.815354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ec0f8-fcbb-4078-bc99-ffee599ca582 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:25.857428 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32ed69-e7bc-4bda-98a7-19da3752136d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:25.857979 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32ed69-e7bc-4bda-98a7-19da3752136d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:25.858254 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32ed69-e7bc-4bda-98a7-19da3752136d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:25.858525 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32ed69-e7bc-4bda-98a7-19da3752136d None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:25.859208 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32ed69-e7bc-4bda-98a7-19da3752136d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:25.859518 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32ed69-e7bc-4bda-98a7-19da3752136d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:25.860945 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32ed69-e7bc-4bda-98a7-19da3752136d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:25.864534 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88c3c2-8dd2-4f74-a254-40d04a2bc1fe None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:25.872005 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 541/1084] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:21:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:25.878268 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32ed69-e7bc-4bda-98a7-19da3752136d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:25.922654 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2773c-8979-40b7-99f2-703683241e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:25.923276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2773c-8979-40b7-99f2-703683241e55 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:25.923559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2773c-8979-40b7-99f2-703683241e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:25.923837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2773c-8979-40b7-99f2-703683241e55 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:25.924503 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2773c-8979-40b7-99f2-703683241e55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:25.924846 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2773c-8979-40b7-99f2-703683241e55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:25.926320 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2773c-8979-40b7-99f2-703683241e55 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:25.931350 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:25.940762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 544/1085] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:25.946878 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2773c-8979-40b7-99f2-703683241e55 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:26.001158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32ed69-e7bc-4bda-98a7-19da3752136d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:26.041792 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18f3f0-0f31-4329-93b0-ebf046ffaf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:26.042679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18f3f0-0f31-4329-93b0-ebf046ffaf57 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:26.043078 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18f3f0-0f31-4329-93b0-ebf046ffaf57 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:26.043529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18f3f0-0f31-4329-93b0-ebf046ffaf57 None admin] PATH_INFO: `/v3/users/5f3db4a8937446e0ac01a47493e79bab` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:26.045382 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18f3f0-0f31-4329-93b0-ebf046ffaf57 None admin] RBAC: Authorizing `identity:get_user(user_id=5f3db4a8937446e0ac01a47493e79bab)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:26.048054 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18f3f0-0f31-4329-93b0-ebf046ffaf57 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:26.057769 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 542/1086] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:21:25 2022] GET /identity/v3/users/5f3db4a8937446e0ac01a47493e79bab => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:26.059397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18f3f0-0f31-4329-93b0-ebf046ffaf57 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:26.096571 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2773c-8979-40b7-99f2-703683241e55 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:26.105123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:26.156568 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7989689-70aa-4d16-b550-d9874992ada1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:26.157566 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7989689-70aa-4d16-b550-d9874992ada1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:26.158061 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7989689-70aa-4d16-b550-d9874992ada1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:26.158545 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7989689-70aa-4d16-b550-d9874992ada1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:26.170218 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7989689-70aa-4d16-b550-d9874992ada1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:26.172661 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7989689-70aa-4d16-b550-d9874992ada1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:26.185722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-c7989689-70aa-4d16-b550-d9874992ada1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:21:26.185722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:26.185722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:26.185722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:26.185722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:26.185722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:26.185722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:26.185722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:26.185722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:26.185722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:26.185722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:26.185722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:26.185722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:21:26.185722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:21:26.185722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:21:26.187643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:21:26.187643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:26.187643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:26.187643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:26.187643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:26.187643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:26.187643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:26.187643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:26.187643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:26.187643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:26.187643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:26.187643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:26.187643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:26.187643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:26.187643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:26.187643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:26.187643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:26.189660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:21:26.189660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:21:26.189660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:21:26.189660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:21:26.189660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:21:26.189660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:21:26.189660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:21:26.189660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:26.192028 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 545/1087] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:21:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:21:26.192913 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7989689-70aa-4d16-b550-d9874992ada1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:26.217470 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18f3f0-0f31-4329-93b0-ebf046ffaf57 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:26.231239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:26.264338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6bea5-d4a0-4b67-9aa6-16577ca6490c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:26.265365 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6bea5-d4a0-4b67-9aa6-16577ca6490c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:26.265766 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6bea5-d4a0-4b67-9aa6-16577ca6490c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:26.266134 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6bea5-d4a0-4b67-9aa6-16577ca6490c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:26.339177 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7989689-70aa-4d16-b550-d9874992ada1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:26.364532 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6bea5-d4a0-4b67-9aa6-16577ca6490c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:26.367441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6bea5-d4a0-4b67-9aa6-16577ca6490c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:26.401383 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb59ae-15ab-40d5-8107-b4ab7dac37d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:26.402346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb59ae-15ab-40d5-8107-b4ab7dac37d7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:26.402790 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb59ae-15ab-40d5-8107-b4ab7dac37d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:26.403234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb59ae-15ab-40d5-8107-b4ab7dac37d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:26.404420 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb59ae-15ab-40d5-8107-b4ab7dac37d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:26.405036 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb59ae-15ab-40d5-8107-b4ab7dac37d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:26.407610 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb59ae-15ab-40d5-8107-b4ab7dac37d7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:26.427476 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 546/1088] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:21:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:26.435052 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb59ae-15ab-40d5-8107-b4ab7dac37d7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:26.471471 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:26.524354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 543/1089] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:21:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:21:26.531575 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6bea5-d4a0-4b67-9aa6-16577ca6490c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:26.551654 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:26.593710 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb59ae-15ab-40d5-8107-b4ab7dac37d7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:26.649772 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed85de-9244-4999-8650-cd29b96b7023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:26.650765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed85de-9244-4999-8650-cd29b96b7023 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:26.651204 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed85de-9244-4999-8650-cd29b96b7023 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:26.651641 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed85de-9244-4999-8650-cd29b96b7023 None admin] PATH_INFO: `/v3/projects/43f5c22e38824a8b8dff2f9b4bc1df3f/users/55f389ab3ea046008b44f129113de995/roles/dd6eda7c9f7d4778ab381591e492859d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:26.654756 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed85de-9244-4999-8650-cd29b96b7023 None admin] RBAC: Authorizing `identity:create_grant(project_id=43f5c22e38824a8b8dff2f9b4bc1df3f, user_id=55f389ab3ea046008b44f129113de995, role_id=dd6eda7c9f7d4778ab381591e492859d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:26.656245 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed85de-9244-4999-8650-cd29b96b7023 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:26.674225 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 547/1090] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 1 16:21:26 2022] PUT /identity/v3/projects/43f5c22e38824a8b8dff2f9b4bc1df3f/users/55f389ab3ea046008b44f129113de995/roles/dd6eda7c9f7d4778ab381591e492859d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:21:26.692357 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6bea5-d4a0-4b67-9aa6-16577ca6490c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:26.737930 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ed46d-4ac2-47be-a2e0-d166be7fd4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:26.738591 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ed46d-4ac2-47be-a2e0-d166be7fd4a0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:26.738870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ed46d-4ac2-47be-a2e0-d166be7fd4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:26.739144 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ed46d-4ac2-47be-a2e0-d166be7fd4a0 None admin] PATH_INFO: `/v3/projects/30d8b4c5971e4749af20c3d4bee02af4` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:26.740402 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ed46d-4ac2-47be-a2e0-d166be7fd4a0 None admin] RBAC: Authorizing `identity:get_project(project_id=30d8b4c5971e4749af20c3d4bee02af4)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:26.741952 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ed46d-4ac2-47be-a2e0-d166be7fd4a0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:26.744988 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 544/1091] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:21:26 2022] GET /identity/v3/projects/30d8b4c5971e4749af20c3d4bee02af4 => generated 311 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:26.753919 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed85de-9244-4999-8650-cd29b96b7023 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:26.874253 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:26.893503 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed85de-9244-4999-8650-cd29b96b7023 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:26.933484 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23d660-68cb-4d71-8cca-cf8a34bca3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:26.934104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23d660-68cb-4d71-8cca-cf8a34bca3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:26.934383 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23d660-68cb-4d71-8cca-cf8a34bca3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:26.934656 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23d660-68cb-4d71-8cca-cf8a34bca3b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:26.935410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23d660-68cb-4d71-8cca-cf8a34bca3b8 None admin] RBAC: Adding query filter params (role.id=a8896546a02c42489ef73c7ad7c43542, scope.project.id=30d8b4c5971e4749af20c3d4bee02af4, user.id=5f3db4a8937446e0ac01a47493e79bab) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:26.935720 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23d660-68cb-4d71-8cca-cf8a34bca3b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:26.937252 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23d660-68cb-4d71-8cca-cf8a34bca3b8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:26.944103 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 548/1092] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:21:26 2022] GET /identity/v3/role_assignments?user.id=5f3db4a8937446e0ac01a47493e79bab&scope.project.id=30d8b4c5971e4749af20c3d4bee02af4&role.id=a8896546a02c42489ef73c7ad7c43542 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:28.986321 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129afed4-d41f-4414-a1f5-18eedfa9d78d None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:28.987140 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129afed4-d41f-4414-a1f5-18eedfa9d78d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:28.987296 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129afed4-d41f-4414-a1f5-18eedfa9d78d None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:28.988794 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 545/1093] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:28.994867 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493977d-0626-4d59-8e1f-595e6bfbe8dd None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:28.995593 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493977d-0626-4d59-8e1f-595e6bfbe8dd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:28.995593 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493977d-0626-4d59-8e1f-595e6bfbe8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:29.016811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5493977d-0626-4d59-8e1f-595e6bfbe8dd None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:29.018173 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5493977d-0626-4d59-8e1f-595e6bfbe8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:29.129885 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 549/1094] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:21:29.399937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129afed4-d41f-4414-a1f5-18eedfa9d78d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:29.500227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:29.526773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129afed4-d41f-4414-a1f5-18eedfa9d78d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:29.569490 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f630b1-3502-43b5-8a73-37bc463c529b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:29.570310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f630b1-3502-43b5-8a73-37bc463c529b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:29.570586 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f630b1-3502-43b5-8a73-37bc463c529b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:29.570853 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f630b1-3502-43b5-8a73-37bc463c529b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:29.584017 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f630b1-3502-43b5-8a73-37bc463c529b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:21:29.589391 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-88f630b1-3502-43b5-8a73-37bc463c529b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:21:29.589391 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:29.589391 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:29.589391 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:29.589391 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:29.589391 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:29.589391 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:29.589391 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:29.589391 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:29.589391 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:29.589391 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:29.589391 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:29.589391 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:21:29.589391 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:21:29.589391 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:21:29.589391 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:21:29.591644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:21:29.591644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:21:29.591644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:21:29.591644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:21:29.591644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:29.591644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:29.591644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:29.591644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:29.591644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:29.591644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:29.591644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:29.591644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:29.591644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:29.591644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:29.591644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:29.591644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:29.593611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:29.593611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:29.593611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:29.593611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:29.593611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:21:29.593611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:21:29.593611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:21:29.593611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:21:29.593611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:21:29.593611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:21:29.593611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:21:29.593611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:21:29.593611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 546/1095] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Sep 1 16:21:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:29.597187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493977d-0626-4d59-8e1f-595e6bfbe8dd None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:29.697528 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:29.721473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493977d-0626-4d59-8e1f-595e6bfbe8dd None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:29.730332 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c7746-5a6b-4e41-959e-5b6b879d7d75 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:29.730733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c7746-5a6b-4e41-959e-5b6b879d7d75 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:29.731104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c7746-5a6b-4e41-959e-5b6b879d7d75 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:29.733677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 547/1096] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:21:29.739279 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10983bae-340a-41b3-828b-c7f20dbc51c0 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:29.739671 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10983bae-340a-41b3-828b-c7f20dbc51c0 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:29.740018 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10983bae-340a-41b3-828b-c7f20dbc51c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:29.761007 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-10983bae-340a-41b3-828b-c7f20dbc51c0 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:29.762233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-10983bae-340a-41b3-828b-c7f20dbc51c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:29.766915 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb710e1-a549-4864-9da4-f5dfa9284a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:29.767533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb710e1-a549-4864-9da4-f5dfa9284a47 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:29.767806 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb710e1-a549-4864-9da4-f5dfa9284a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:29.768076 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb710e1-a549-4864-9da4-f5dfa9284a47 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:29.768797 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb710e1-a549-4864-9da4-f5dfa9284a47 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:29.769183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb710e1-a549-4864-9da4-f5dfa9284a47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:29.770602 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb710e1-a549-4864-9da4-f5dfa9284a47 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:29.780296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 550/1097] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Sep 1 16:21:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:29.786366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb710e1-a549-4864-9da4-f5dfa9284a47 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:29.855745 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 548/1098] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:21:29.904765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb710e1-a549-4864-9da4-f5dfa9284a47 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:29.953419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6bbbb-10cc-464e-9a69-8bab9c44617f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:29.954518 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6bbbb-10cc-464e-9a69-8bab9c44617f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:29.955005 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6bbbb-10cc-464e-9a69-8bab9c44617f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:29.955708 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6bbbb-10cc-464e-9a69-8bab9c44617f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:29.976346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6bbbb-10cc-464e-9a69-8bab9c44617f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:29.979122 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6bbbb-10cc-464e-9a69-8bab9c44617f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:29.982345 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:30.001187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-24e6bbbb-10cc-464e-9a69-8bab9c44617f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:21:30.001187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:30.001187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:30.001187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:30.001187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:30.001187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:30.001187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:30.001187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:30.001187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:30.001187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:30.001187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:30.001187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:30.001187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:21:30.001187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:21:30.001187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:21:30.001187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:21:30.003936 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:30.003936 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:30.003936 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:30.003936 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:30.003936 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:30.003936 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:30.003936 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:30.003936 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:30.003936 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:30.003936 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:30.003936 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:30.003936 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:30.003936 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:30.003936 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:30.003936 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:30.003936 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:30.003936 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:21:30.005912 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:21:30.005912 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:21:30.005912 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:30.006807 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 551/1099] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:21:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:21:30.010110 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10983bae-340a-41b3-828b-c7f20dbc51c0 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:30.091944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:30.129846 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10983bae-340a-41b3-828b-c7f20dbc51c0 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:30.168970 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6bbbb-10cc-464e-9a69-8bab9c44617f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:30.173567 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0eec3-7dd0-4dd5-accc-afb96d85e663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:30.174191 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0eec3-7dd0-4dd5-accc-afb96d85e663 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:30.174469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0eec3-7dd0-4dd5-accc-afb96d85e663 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:30.174737 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0eec3-7dd0-4dd5-accc-afb96d85e663 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:30.175409 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0eec3-7dd0-4dd5-accc-afb96d85e663 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:30.175705 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0eec3-7dd0-4dd5-accc-afb96d85e663 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:30.177185 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0eec3-7dd0-4dd5-accc-afb96d85e663 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:30.190943 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 549/1100] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:30.201048 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0eec3-7dd0-4dd5-accc-afb96d85e663 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:30.309136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6bbbb-10cc-464e-9a69-8bab9c44617f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:30.319594 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0eec3-7dd0-4dd5-accc-afb96d85e663 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:30.353858 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:30.364830 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bc5e0-94c8-4d35-9d21-753ddacea4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:30.365651 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bc5e0-94c8-4d35-9d21-753ddacea4ec None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:30.366019 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bc5e0-94c8-4d35-9d21-753ddacea4ec None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:30.366417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bc5e0-94c8-4d35-9d21-753ddacea4ec None admin] PATH_INFO: `/v3/users/nova` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:30.368941 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f9330-7959-42ed-8aa7-16c36eb57591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:30.369589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f9330-7959-42ed-8aa7-16c36eb57591 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:30.369862 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f9330-7959-42ed-8aa7-16c36eb57591 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:30.370128 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f9330-7959-42ed-8aa7-16c36eb57591 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:30.371593 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f9330-7959-42ed-8aa7-16c36eb57591 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:30.373107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f9330-7959-42ed-8aa7-16c36eb57591 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:30.374748 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 552/1101] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:21:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:30.380504 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bc5e0-94c8-4d35-9d21-753ddacea4ec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:30.380878 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f9330-7959-42ed-8aa7-16c36eb57591 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:30.382768 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bc5e0-94c8-4d35-9d21-753ddacea4ec None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:30.404479 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-1c2bc5e0-94c8-4d35-9d21-753ddacea4ec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:21:30.404479 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:30.404479 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:30.404479 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:30.404479 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:30.404479 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:30.404479 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:30.404479 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:30.404479 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:30.404479 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:30.404479 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:30.404479 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:30.404479 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:21:30.404479 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:21:30.404479 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:21:30.404479 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:21:30.406232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:30.406232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:30.406232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:21:30.406232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:21:30.406232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:21:30.406232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:21:30.406232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:30.406232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:30.406232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:30.406232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:30.406232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:30.406232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:30.406232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:30.406232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:30.406232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:30.406232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:30.406232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:30.406232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:30.407837 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:30.407837 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:30.407837 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:21:30.407837 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:21:30.407837 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:21:30.407837 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:21:30.407837 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:21:30.407837 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:21:30.407837 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:21:30.407837 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:21:30.407837 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 550/1102] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Sep 1 16:21:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:21:30.414825 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bc5e0-94c8-4d35-9d21-753ddacea4ec None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:30.467216 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:30.517560 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f9330-7959-42ed-8aa7-16c36eb57591 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:30.547162 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bc5e0-94c8-4d35-9d21-753ddacea4ec None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:30.565306 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa4581-7395-4935-a433-3c3cc5347d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:30.566226 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa4581-7395-4935-a433-3c3cc5347d98 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:30.566702 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa4581-7395-4935-a433-3c3cc5347d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:30.567180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa4581-7395-4935-a433-3c3cc5347d98 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:30.568392 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa4581-7395-4935-a433-3c3cc5347d98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:30.571122 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa4581-7395-4935-a433-3c3cc5347d98 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:30.588868 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ef16c-ca91-4441-b4bc-37d40485dd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:30.589738 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ef16c-ca91-4441-b4bc-37d40485dd12 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:30.589982 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ef16c-ca91-4441-b4bc-37d40485dd12 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:30.590865 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ef16c-ca91-4441-b4bc-37d40485dd12 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:30.591124 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ef16c-ca91-4441-b4bc-37d40485dd12 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:30.591564 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ef16c-ca91-4441-b4bc-37d40485dd12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:30.593090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ef16c-ca91-4441-b4bc-37d40485dd12 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:30.605613 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 553/1103] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 1 16:21:30 2022] POST /identity/v3/users => generated 286 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:21:30.618070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 551/1104] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Sep 1 16:21:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:30.625472 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa4581-7395-4935-a433-3c3cc5347d98 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:30.761346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa4581-7395-4935-a433-3c3cc5347d98 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:30.787738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:30.830441 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82376970-e9a6-4f4a-bbed-fbb86c9adf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:30.830965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82376970-e9a6-4f4a-bbed-fbb86c9adf6d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:30.831240 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82376970-e9a6-4f4a-bbed-fbb86c9adf6d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:30.831512 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82376970-e9a6-4f4a-bbed-fbb86c9adf6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:30.917246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82376970-e9a6-4f4a-bbed-fbb86c9adf6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:30.918742 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82376970-e9a6-4f4a-bbed-fbb86c9adf6d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:31.040123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 554/1105] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:21:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 16:21:31.049999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ef16c-ca91-4441-b4bc-37d40485dd12 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:31.131691 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:31.195725 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ef16c-ca91-4441-b4bc-37d40485dd12 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:31.238692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55fbd6-fbf5-46ad-9948-3660067d7b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:31.239347 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55fbd6-fbf5-46ad-9948-3660067d7b5c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:31.239619 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55fbd6-fbf5-46ad-9948-3660067d7b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:31.239885 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55fbd6-fbf5-46ad-9948-3660067d7b5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:31.253004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55fbd6-fbf5-46ad-9948-3660067d7b5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:31.254562 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55fbd6-fbf5-46ad-9948-3660067d7b5c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:31.272498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-2a55fbd6-fbf5-46ad-9948-3660067d7b5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:21:31.272498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:31.272498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:31.272498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:31.272498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:31.272498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:31.272498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:31.272498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:31.272498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:31.272498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:31.272498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:31.272498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:31.272498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:21:31.272498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:21:31.272498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:21:31.272498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:21:31.282884 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:31.282884 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:31.282884 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:31.282884 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:31.282884 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:31.282884 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:31.282884 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:31.282884 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:31.282884 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:31.282884 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:31.282884 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:31.282884 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:31.282884 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:31.282884 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:31.282884 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:31.282884 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:31.282884 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:21:31.284606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:21:31.284606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:21:31.284606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:21:31.284606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 552/1106] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:21:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:31.285113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82376970-e9a6-4f4a-bbed-fbb86c9adf6d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:31.304828 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:31.405167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82376970-e9a6-4f4a-bbed-fbb86c9adf6d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:31.447610 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f8471-7c7b-4b27-8c49-c8a254a40e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:31.448225 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f8471-7c7b-4b27-8c49-c8a254a40e91 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:31.448554 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f8471-7c7b-4b27-8c49-c8a254a40e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:31.448861 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f8471-7c7b-4b27-8c49-c8a254a40e91 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:31.449521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f8471-7c7b-4b27-8c49-c8a254a40e91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:31.449820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f8471-7c7b-4b27-8c49-c8a254a40e91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:31.451233 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f8471-7c7b-4b27-8c49-c8a254a40e91 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:31.465087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 555/1107] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:31.472049 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55fbd6-fbf5-46ad-9948-3660067d7b5c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:31.629439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:31.634511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55fbd6-fbf5-46ad-9948-3660067d7b5c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:31.677399 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee9367-aa56-4362-9a8e-af9d5ce1a63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:31.678010 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee9367-aa56-4362-9a8e-af9d5ce1a63d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:31.678343 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee9367-aa56-4362-9a8e-af9d5ce1a63d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:31.678663 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee9367-aa56-4362-9a8e-af9d5ce1a63d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:31.687306 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee9367-aa56-4362-9a8e-af9d5ce1a63d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:31.688935 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee9367-aa56-4362-9a8e-af9d5ce1a63d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:31.703355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-06ee9367-aa56-4362-9a8e-af9d5ce1a63d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:21:31.703355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:31.703355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:31.703355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:31.703355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:31.703355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:31.703355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:31.703355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:31.703355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:31.703355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:31.703355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:31.703355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:31.703355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:21:31.703355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:21:31.703355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:21:31.705281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:21:31.705281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:31.705281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:31.705281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:31.705281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:31.705281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:31.705281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:31.705281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:31.705281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:31.705281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:31.705281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:31.705281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:31.705281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:31.705281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:31.705281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:31.705281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:31.705281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:31.710978 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:21:31.710978 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:21:31.710978 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:21:31.710978 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:21:31.710978 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:21:31.710978 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:21:31.710978 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:21:31.710978 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:21:31.710978 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 553/1108] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:21:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:31.712145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f8471-7c7b-4b27-8c49-c8a254a40e91 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:31.810051 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:31.836261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f8471-7c7b-4b27-8c49-c8a254a40e91 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:31.876781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0584b49-9cdb-4434-a25f-f442694084eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:31.877409 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0584b49-9cdb-4434-a25f-f442694084eb None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:31.877686 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0584b49-9cdb-4434-a25f-f442694084eb None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:31.877957 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0584b49-9cdb-4434-a25f-f442694084eb None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:31.878704 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0584b49-9cdb-4434-a25f-f442694084eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:31.879009 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0584b49-9cdb-4434-a25f-f442694084eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:31.880518 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0584b49-9cdb-4434-a25f-f442694084eb None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:31.896013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 556/1109] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:21:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:31.903484 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee9367-aa56-4362-9a8e-af9d5ce1a63d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:32.014504 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee9367-aa56-4362-9a8e-af9d5ce1a63d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:32.053225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f6d54-9a59-45ba-9eab-44367bd496a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:32.053705 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f6d54-9a59-45ba-9eab-44367bd496a6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:32.054037 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f6d54-9a59-45ba-9eab-44367bd496a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:32.054147 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f6d54-9a59-45ba-9eab-44367bd496a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:32.054865 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f6d54-9a59-45ba-9eab-44367bd496a6 None admin] RBAC: Adding query filter params (role.id=dd6eda7c9f7d4778ab381591e492859d, scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f, user.id=55f389ab3ea046008b44f129113de995) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:32.055168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f6d54-9a59-45ba-9eab-44367bd496a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:32.059778 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f6d54-9a59-45ba-9eab-44367bd496a6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:32.066250 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 554/1110] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:21:31 2022] GET /identity/v3/role_assignments?user.id=55f389ab3ea046008b44f129113de995&scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f&role.id=dd6eda7c9f7d4778ab381591e492859d => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:32.988052 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4151b5a-3efb-4743-b8c2-b90e7d4f574f None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:32.988660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4151b5a-3efb-4743-b8c2-b90e7d4f574f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:32.988984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4151b5a-3efb-4743-b8c2-b90e7d4f574f None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:32.991892 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 557/1111] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:32.999579 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a0143-0154-4c34-8b8c-53378dc35c5b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:33.000024 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a0143-0154-4c34-8b8c-53378dc35c5b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:33.000450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a0143-0154-4c34-8b8c-53378dc35c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:33.024896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4a0a0143-0154-4c34-8b8c-53378dc35c5b None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:33.026148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4a0a0143-0154-4c34-8b8c-53378dc35c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:33.051008 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:33.121354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 555/1112] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:33.453611 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4151b5a-3efb-4743-b8c2-b90e7d4f574f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:33.567996 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4151b5a-3efb-4743-b8c2-b90e7d4f574f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:33.606925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8dbfbb-9944-4001-970a-a6296d2344f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:33.607571 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dbfbb-9944-4001-970a-a6296d2344f3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:33.607853 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dbfbb-9944-4001-970a-a6296d2344f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:33.608139 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dbfbb-9944-4001-970a-a6296d2344f3 None admin] PATH_INFO: `/v3/roles/f889b15cab8c46f58be00f84143aac60` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:33.609651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8dbfbb-9944-4001-970a-a6296d2344f3 None admin] RBAC: Authorizing `identity:get_role(role_id=f889b15cab8c46f58be00f84143aac60)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:33.611367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8dbfbb-9944-4001-970a-a6296d2344f3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:33.612787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 558/1113] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:21:33 2022] GET /identity/v3/roles/f889b15cab8c46f58be00f84143aac60 => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:33.618964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a0143-0154-4c34-8b8c-53378dc35c5b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:33.799012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a0143-0154-4c34-8b8c-53378dc35c5b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:33.849635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb047aff-08a0-42ef-b3a7-d76381337082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:33.850306 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb047aff-08a0-42ef-b3a7-d76381337082 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:33.850579 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb047aff-08a0-42ef-b3a7-d76381337082 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:33.851503 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb047aff-08a0-42ef-b3a7-d76381337082 None admin] PATH_INFO: `/v3/users/7f9e2723479b48a5b28677c6f11b7972` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:33.867653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb047aff-08a0-42ef-b3a7-d76381337082 None admin] RBAC: Authorizing `identity:get_user(user_id=7f9e2723479b48a5b28677c6f11b7972)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:33.869568 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb047aff-08a0-42ef-b3a7-d76381337082 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:33.871620 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 556/1114] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:21:33 2022] GET /identity/v3/users/7f9e2723479b48a5b28677c6f11b7972 => generated 286 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:33.877750 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8dbfbb-9944-4001-970a-a6296d2344f3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:33.887766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:34.033327 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8dbfbb-9944-4001-970a-a6296d2344f3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:34.098598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2699f71-5c3b-4060-a064-4753fe995f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:34.099560 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2699f71-5c3b-4060-a064-4753fe995f2c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:34.099999 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2699f71-5c3b-4060-a064-4753fe995f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:34.100429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2699f71-5c3b-4060-a064-4753fe995f2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:34.229802 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2699f71-5c3b-4060-a064-4753fe995f2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:34.232521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2699f71-5c3b-4060-a064-4753fe995f2c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:34.248890 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:34.421728 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 559/1115] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:21:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:21:34.427893 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb047aff-08a0-42ef-b3a7-d76381337082 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:34.443514 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:34.548147 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb047aff-08a0-42ef-b3a7-d76381337082 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:34.587030 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77084cb-63de-4de6-8592-f2933da3c8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:34.587685 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77084cb-63de-4de6-8592-f2933da3c8cf None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:34.587964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77084cb-63de-4de6-8592-f2933da3c8cf None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:34.588242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77084cb-63de-4de6-8592-f2933da3c8cf None admin] PATH_INFO: `/v3/projects/30d8b4c5971e4749af20c3d4bee02af4` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:34.589498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77084cb-63de-4de6-8592-f2933da3c8cf None admin] RBAC: Authorizing `identity:get_project(project_id=30d8b4c5971e4749af20c3d4bee02af4)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:34.590965 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77084cb-63de-4de6-8592-f2933da3c8cf None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:34.592738 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 557/1116] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:21:34 2022] GET /identity/v3/projects/30d8b4c5971e4749af20c3d4bee02af4 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:34.599622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2699f71-5c3b-4060-a064-4753fe995f2c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:34.716286 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2699f71-5c3b-4060-a064-4753fe995f2c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:34.724611 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:34.755170 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea665de-2aaf-4aea-af2d-15b1797a672a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:34.755885 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea665de-2aaf-4aea-af2d-15b1797a672a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:34.756216 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea665de-2aaf-4aea-af2d-15b1797a672a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:34.756566 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea665de-2aaf-4aea-af2d-15b1797a672a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:34.757987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea665de-2aaf-4aea-af2d-15b1797a672a None admin] RBAC: Adding query filter params (role.id=f889b15cab8c46f58be00f84143aac60, scope.project.id=30d8b4c5971e4749af20c3d4bee02af4, user.id=7f9e2723479b48a5b28677c6f11b7972) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:34.758296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea665de-2aaf-4aea-af2d-15b1797a672a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:34.759762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea665de-2aaf-4aea-af2d-15b1797a672a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:34.766105 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 560/1117] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:21:34 2022] GET /identity/v3/role_assignments?user.id=7f9e2723479b48a5b28677c6f11b7972&scope.project.id=30d8b4c5971e4749af20c3d4bee02af4&role.id=f889b15cab8c46f58be00f84143aac60 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:36.733099 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cf647-7127-4e40-93c1-fa54a6daec8a None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:36.734060 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cf647-7127-4e40-93c1-fa54a6daec8a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:36.734060 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cf647-7127-4e40-93c1-fa54a6daec8a None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:36.735647 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 558/1118] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:21:36.741938 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d4e1a-4b9b-4a23-b3b0-cf43890be622 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:36.742483 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d4e1a-4b9b-4a23-b3b0-cf43890be622 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:36.742483 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d4e1a-4b9b-4a23-b3b0-cf43890be622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:36.762020 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ff4d4e1a-4b9b-4a23-b3b0-cf43890be622 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:36.763272 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ff4d4e1a-4b9b-4a23-b3b0-cf43890be622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:36.840598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 561/1119] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:21:37.114592 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cf647-7127-4e40-93c1-fa54a6daec8a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:37.208613 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:37.235426 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cf647-7127-4e40-93c1-fa54a6daec8a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:37.274705 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a1750-485d-4d89-bf40-ef86c6d2b884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:37.275358 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a1750-485d-4d89-bf40-ef86c6d2b884 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:37.275638 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a1750-485d-4d89-bf40-ef86c6d2b884 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:37.275910 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a1750-485d-4d89-bf40-ef86c6d2b884 None admin] PATH_INFO: `/v3/roles/f889b15cab8c46f58be00f84143aac60` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:37.277426 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a1750-485d-4d89-bf40-ef86c6d2b884 None admin] RBAC: Authorizing `identity:get_role(role_id=f889b15cab8c46f58be00f84143aac60)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:37.278952 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a1750-485d-4d89-bf40-ef86c6d2b884 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:37.280362 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 559/1120] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:21:37 2022] GET /identity/v3/roles/f889b15cab8c46f58be00f84143aac60 => generated 223 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:37.286734 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d4e1a-4b9b-4a23-b3b0-cf43890be622 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:37.397881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:37.401296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d4e1a-4b9b-4a23-b3b0-cf43890be622 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:37.442208 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c5d84-e952-47b0-86c4-c287a1f70fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:37.442864 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c5d84-e952-47b0-86c4-c287a1f70fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:37.443145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c5d84-e952-47b0-86c4-c287a1f70fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:37.443420 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c5d84-e952-47b0-86c4-c287a1f70fa6 None admin] PATH_INFO: `/v3/users/7f9e2723479b48a5b28677c6f11b7972` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:37.445316 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c5d84-e952-47b0-86c4-c287a1f70fa6 None admin] RBAC: Authorizing `identity:get_user(user_id=7f9e2723479b48a5b28677c6f11b7972)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:37.446822 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c5d84-e952-47b0-86c4-c287a1f70fa6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:37.448525 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 562/1121] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:21:37 2022] GET /identity/v3/users/7f9e2723479b48a5b28677c6f11b7972 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:37.457288 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a1750-485d-4d89-bf40-ef86c6d2b884 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:37.577743 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a1750-485d-4d89-bf40-ef86c6d2b884 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:37.618548 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f0de9-014a-4b6f-b688-c9aef1f8f467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:37.619353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f0de9-014a-4b6f-b688-c9aef1f8f467 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:37.619630 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f0de9-014a-4b6f-b688-c9aef1f8f467 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:37.619896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f0de9-014a-4b6f-b688-c9aef1f8f467 None admin] PATH_INFO: `/v3/projects/30d8b4c5971e4749af20c3d4bee02af4` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:37.621378 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f0de9-014a-4b6f-b688-c9aef1f8f467 None admin] RBAC: Authorizing `identity:get_project(project_id=30d8b4c5971e4749af20c3d4bee02af4)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:37.622829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f0de9-014a-4b6f-b688-c9aef1f8f467 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:37.624531 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 560/1122] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:21:37 2022] GET /identity/v3/projects/30d8b4c5971e4749af20c3d4bee02af4 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:37.630917 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c5d84-e952-47b0-86c4-c287a1f70fa6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:37.775763 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c5d84-e952-47b0-86c4-c287a1f70fa6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:37.813977 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa201c-efac-45a9-bece-c2cf980e011c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:37.814643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa201c-efac-45a9-bece-c2cf980e011c None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:37.814912 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa201c-efac-45a9-bece-c2cf980e011c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:37.815177 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa201c-efac-45a9-bece-c2cf980e011c None admin] PATH_INFO: `/v3/projects/30d8b4c5971e4749af20c3d4bee02af4/users/7f9e2723479b48a5b28677c6f11b7972/roles/f889b15cab8c46f58be00f84143aac60` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:37.817394 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa201c-efac-45a9-bece-c2cf980e011c None admin] RBAC: Authorizing `identity:create_grant(project_id=30d8b4c5971e4749af20c3d4bee02af4, user_id=7f9e2723479b48a5b28677c6f11b7972, role_id=f889b15cab8c46f58be00f84143aac60)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:37.818875 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa201c-efac-45a9-bece-c2cf980e011c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:37.836021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 563/1123] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 1 16:21:37 2022] PUT /identity/v3/projects/30d8b4c5971e4749af20c3d4bee02af4/users/7f9e2723479b48a5b28677c6f11b7972/roles/f889b15cab8c46f58be00f84143aac60 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:21:39.856960 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd75bf6-ff45-4b5c-b548-e5edafe3a8b3 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:39.857842 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd75bf6-ff45-4b5c-b548-e5edafe3a8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:39.857842 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd75bf6-ff45-4b5c-b548-e5edafe3a8b3 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:39.859406 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 561/1124] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:21:39.865873 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733cff6-a55c-47dc-ac7c-866672c652e1 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:39.866515 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733cff6-a55c-47dc-ac7c-866672c652e1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:39.866515 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733cff6-a55c-47dc-ac7c-866672c652e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:39.886914 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7733cff6-a55c-47dc-ac7c-866672c652e1 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:39.888164 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7733cff6-a55c-47dc-ac7c-866672c652e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:39.916990 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:39.968006 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 564/1125] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:21:40.255483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd75bf6-ff45-4b5c-b548-e5edafe3a8b3 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:40.273998 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:40.383321 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd75bf6-ff45-4b5c-b548-e5edafe3a8b3 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:40.421707 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf68fe-cd99-42f7-8c02-36266d9b73a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:40.422420 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf68fe-cd99-42f7-8c02-36266d9b73a9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:40.422741 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf68fe-cd99-42f7-8c02-36266d9b73a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:40.423057 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf68fe-cd99-42f7-8c02-36266d9b73a9 None admin] PATH_INFO: `/v3/roles/f889b15cab8c46f58be00f84143aac60` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:40.424930 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf68fe-cd99-42f7-8c02-36266d9b73a9 None admin] RBAC: Authorizing `identity:get_role(role_id=f889b15cab8c46f58be00f84143aac60)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:40.426496 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf68fe-cd99-42f7-8c02-36266d9b73a9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:40.427988 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 562/1126] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:21:40 2022] GET /identity/v3/roles/f889b15cab8c46f58be00f84143aac60 => generated 223 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:40.434802 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733cff6-a55c-47dc-ac7c-866672c652e1 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:40.551202 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733cff6-a55c-47dc-ac7c-866672c652e1 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:40.593575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ddfae-5105-4f86-9cd5-867fd9f01e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:40.594218 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ddfae-5105-4f86-9cd5-867fd9f01e09 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:40.594505 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ddfae-5105-4f86-9cd5-867fd9f01e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:40.594784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ddfae-5105-4f86-9cd5-867fd9f01e09 None admin] PATH_INFO: `/v3/users/7f9e2723479b48a5b28677c6f11b7972` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:40.596154 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ddfae-5105-4f86-9cd5-867fd9f01e09 None admin] RBAC: Authorizing `identity:get_user(user_id=7f9e2723479b48a5b28677c6f11b7972)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:40.597916 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ddfae-5105-4f86-9cd5-867fd9f01e09 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:40.599665 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 565/1127] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:21:40 2022] GET /identity/v3/users/7f9e2723479b48a5b28677c6f11b7972 => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:40.609201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf68fe-cd99-42f7-8c02-36266d9b73a9 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:40.710524 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:40.739248 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf68fe-cd99-42f7-8c02-36266d9b73a9 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:40.781362 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d3afc-a244-4ff9-9e60-2a2a51a62e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:40.781997 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d3afc-a244-4ff9-9e60-2a2a51a62e56 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:40.782288 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d3afc-a244-4ff9-9e60-2a2a51a62e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:40.782557 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d3afc-a244-4ff9-9e60-2a2a51a62e56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:40.863612 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d3afc-a244-4ff9-9e60-2a2a51a62e56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:40.865053 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d3afc-a244-4ff9-9e60-2a2a51a62e56 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:40.961731 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:40.983545 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 563/1128] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:21:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:21:40.993155 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ddfae-5105-4f86-9cd5-867fd9f01e09 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:41.023812 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:41.111314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ddfae-5105-4f86-9cd5-867fd9f01e09 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:41.149838 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4eea7-6db6-4683-bf64-f9f3a0984c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:41.150402 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4eea7-6db6-4683-bf64-f9f3a0984c61 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:41.150686 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4eea7-6db6-4683-bf64-f9f3a0984c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:41.150964 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4eea7-6db6-4683-bf64-f9f3a0984c61 None admin] PATH_INFO: `/v3/projects/30d8b4c5971e4749af20c3d4bee02af4` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:41.152203 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4eea7-6db6-4683-bf64-f9f3a0984c61 None admin] RBAC: Authorizing `identity:get_project(project_id=30d8b4c5971e4749af20c3d4bee02af4)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:41.153718 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4eea7-6db6-4683-bf64-f9f3a0984c61 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:41.155457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 566/1129] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:21:40 2022] GET /identity/v3/projects/30d8b4c5971e4749af20c3d4bee02af4 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:41.161992 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d3afc-a244-4ff9-9e60-2a2a51a62e56 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:41.273559 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d3afc-a244-4ff9-9e60-2a2a51a62e56 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:41.311950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfa1c5-270b-4aab-b0c2-6e149932afbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:41.312564 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfa1c5-270b-4aab-b0c2-6e149932afbb None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:41.312873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfa1c5-270b-4aab-b0c2-6e149932afbb None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:41.313146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfa1c5-270b-4aab-b0c2-6e149932afbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:41.313890 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfa1c5-270b-4aab-b0c2-6e149932afbb None admin] RBAC: Adding query filter params (role.id=f889b15cab8c46f58be00f84143aac60, scope.project.id=30d8b4c5971e4749af20c3d4bee02af4, user.id=7f9e2723479b48a5b28677c6f11b7972) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:41.314197 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfa1c5-270b-4aab-b0c2-6e149932afbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:41.315678 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfa1c5-270b-4aab-b0c2-6e149932afbb None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:41.324294 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 564/1130] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:21:41 2022] GET /identity/v3/role_assignments?user.id=7f9e2723479b48a5b28677c6f11b7972&scope.project.id=30d8b4c5971e4749af20c3d4bee02af4&role.id=f889b15cab8c46f58be00f84143aac60 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:43.452872 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718e7eb-d7d8-46fb-8dc2-eb9be6260373 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:43.453476 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718e7eb-d7d8-46fb-8dc2-eb9be6260373 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:43.453821 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718e7eb-d7d8-46fb-8dc2-eb9be6260373 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:43.456346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 567/1131] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:43.462859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba8a2f-cad3-45d2-8b07-5fea65880b02 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:43.463417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba8a2f-cad3-45d2-8b07-5fea65880b02 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:43.463417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba8a2f-cad3-45d2-8b07-5fea65880b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:43.484304 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b7ba8a2f-cad3-45d2-8b07-5fea65880b02 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:43.485557 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b7ba8a2f-cad3-45d2-8b07-5fea65880b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:43.536771 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:43.567083 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 565/1132] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:43.845538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718e7eb-d7d8-46fb-8dc2-eb9be6260373 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:43.956389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:43.965769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718e7eb-d7d8-46fb-8dc2-eb9be6260373 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:44.003822 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fe63f-bb6e-4337-a7ed-adb02437f9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:44.004466 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fe63f-bb6e-4337-a7ed-adb02437f9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:44.004777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fe63f-bb6e-4337-a7ed-adb02437f9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:44.005057 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fe63f-bb6e-4337-a7ed-adb02437f9b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:44.006774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13fe63f-bb6e-4337-a7ed-adb02437f9b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:44.008262 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13fe63f-bb6e-4337-a7ed-adb02437f9b3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:44.009967 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 568/1133] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:21:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:44.016249 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba8a2f-cad3-45d2-8b07-5fea65880b02 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:44.131917 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba8a2f-cad3-45d2-8b07-5fea65880b02 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:44.172184 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547b15b-efb0-43d4-8158-5eb92a0ad181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:44.172858 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547b15b-efb0-43d4-8158-5eb92a0ad181 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:44.173140 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547b15b-efb0-43d4-8158-5eb92a0ad181 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:44.173415 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547b15b-efb0-43d4-8158-5eb92a0ad181 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:44.174119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7547b15b-efb0-43d4-8158-5eb92a0ad181 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:44.175600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7547b15b-efb0-43d4-8158-5eb92a0ad181 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:44.205651 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 566/1134] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 1 16:21:44 2022] POST /identity/v3/projects => generated 311 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:21:46.438797 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8ec8d-546d-4384-936c-b8dfd7ed0920 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:46.439377 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8ec8d-546d-4384-936c-b8dfd7ed0920 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:46.439377 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8ec8d-546d-4384-936c-b8dfd7ed0920 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:46.440978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 569/1135] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:46.447920 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd23534-4333-4d56-acaf-b7ae4a67ffd8 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:46.448707 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd23534-4333-4d56-acaf-b7ae4a67ffd8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:46.448707 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd23534-4333-4d56-acaf-b7ae4a67ffd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:46.469730 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-0fd23534-4333-4d56-acaf-b7ae4a67ffd8 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:46.471026 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0fd23534-4333-4d56-acaf-b7ae4a67ffd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:46.502745 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:46.563655 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 567/1136] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:21:46.889712 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8ec8d-546d-4384-936c-b8dfd7ed0920 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:47.044247 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8ec8d-546d-4384-936c-b8dfd7ed0920 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:47.092934 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ce374-6c62-487d-a80b-4bd5c27641e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:47.093580 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ce374-6c62-487d-a80b-4bd5c27641e0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:47.093861 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ce374-6c62-487d-a80b-4bd5c27641e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:47.094128 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ce374-6c62-487d-a80b-4bd5c27641e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:47.095304 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ce374-6c62-487d-a80b-4bd5c27641e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:47.096797 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ce374-6c62-487d-a80b-4bd5c27641e0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:47.098448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 570/1137] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:21:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:47.107651 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd23534-4333-4d56-acaf-b7ae4a67ffd8 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:47.237702 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd23534-4333-4d56-acaf-b7ae4a67ffd8 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:47.282598 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c2094-8a5a-4a72-a619-e7b662c57955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:47.283654 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c2094-8a5a-4a72-a619-e7b662c57955 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:47.284151 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c2094-8a5a-4a72-a619-e7b662c57955 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:47.284674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c2094-8a5a-4a72-a619-e7b662c57955 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:47.285921 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c2094-8a5a-4a72-a619-e7b662c57955 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:47.289269 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c2094-8a5a-4a72-a619-e7b662c57955 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:47.319872 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 568/1138] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 1 16:21:47 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:21:49.409247 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adac6fa-28db-49ae-9485-730da8a5eb2d None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:49.409773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adac6fa-28db-49ae-9485-730da8a5eb2d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:49.409773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adac6fa-28db-49ae-9485-730da8a5eb2d None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:49.411268 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 571/1139] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:49.417679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0fb2f-e853-45ce-85de-b8b54501554d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:49.418248 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0fb2f-e853-45ce-85de-b8b54501554d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:49.418248 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0fb2f-e853-45ce-85de-b8b54501554d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:49.440187 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3ed0fb2f-e853-45ce-85de-b8b54501554d None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:49.446791 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3ed0fb2f-e853-45ce-85de-b8b54501554d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:49.458371 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:49.532398 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 569/1140] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:49.821211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adac6fa-28db-49ae-9485-730da8a5eb2d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:49.859104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:49.951476 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adac6fa-28db-49ae-9485-730da8a5eb2d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:49.993627 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764199c-f00c-404d-9caa-13baf4aeb45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:49.994268 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764199c-f00c-404d-9caa-13baf4aeb45a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:49.994799 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764199c-f00c-404d-9caa-13baf4aeb45a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:49.995076 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764199c-f00c-404d-9caa-13baf4aeb45a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:50.009718 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764199c-f00c-404d-9caa-13baf4aeb45a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:21:50.014622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-3764199c-f00c-404d-9caa-13baf4aeb45a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:21:50.014622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:50.014622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:50.014622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:50.014622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:50.014622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:50.014622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:50.014622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:50.014622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:50.014622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:50.014622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:50.014622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:50.014622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:21:50.014622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:21:50.014622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:21:50.014622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:21:50.016386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:21:50.016386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:21:50.016386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:21:50.016386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:21:50.016386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:50.016386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:50.016386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:50.016386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:50.016386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:50.016386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:50.016386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:50.016386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:50.016386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:50.016386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:50.016386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:50.016386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:50.018367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:50.018367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:50.018367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:50.018367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:50.018367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:21:50.018367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:21:50.018367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:21:50.018367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:21:50.018367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:21:50.018367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:21:50.018367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:21:50.018367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:50.018367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 572/1141] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:21:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:21:50.024471 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0fb2f-e853-45ce-85de-b8b54501554d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:50.152324 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0fb2f-e853-45ce-85de-b8b54501554d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:50.193505 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703df69-a8e0-4083-a8b1-26779db8f31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:50.194118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703df69-a8e0-4083-a8b1-26779db8f31b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:50.194392 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703df69-a8e0-4083-a8b1-26779db8f31b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:50.194655 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703df69-a8e0-4083-a8b1-26779db8f31b None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:50.195335 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703df69-a8e0-4083-a8b1-26779db8f31b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:50.195625 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703df69-a8e0-4083-a8b1-26779db8f31b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:50.197055 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703df69-a8e0-4083-a8b1-26779db8f31b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:50.210227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 570/1142] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:21:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:50.217222 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764199c-f00c-404d-9caa-13baf4aeb45a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:50.323859 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:50.341184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764199c-f00c-404d-9caa-13baf4aeb45a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:50.381663 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a2025-db8b-4210-94ec-d38c37109542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:50.382303 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a2025-db8b-4210-94ec-d38c37109542 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:50.382581 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a2025-db8b-4210-94ec-d38c37109542 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:50.382852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a2025-db8b-4210-94ec-d38c37109542 None admin] PATH_INFO: `/v3/users/4d14660c9d184e3487f5c729d8a52d67` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:50.398331 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a2025-db8b-4210-94ec-d38c37109542 None admin] RBAC: Authorizing `identity:get_user(user_id=4d14660c9d184e3487f5c729d8a52d67)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:50.400046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a2025-db8b-4210-94ec-d38c37109542 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:50.401839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 573/1143] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:21:50 2022] GET /identity/v3/users/4d14660c9d184e3487f5c729d8a52d67 => generated 286 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:50.408746 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703df69-a8e0-4083-a8b1-26779db8f31b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:50.421637 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:50.541756 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703df69-a8e0-4083-a8b1-26779db8f31b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:50.587509 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccc5a9-d2db-425a-bd23-9663b67521fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:50.588126 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccc5a9-d2db-425a-bd23-9663b67521fd None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:50.588403 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccc5a9-d2db-425a-bd23-9663b67521fd None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:50.588697 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccc5a9-d2db-425a-bd23-9663b67521fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:50.675701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ccc5a9-d2db-425a-bd23-9663b67521fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:50.677414 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ccc5a9-d2db-425a-bd23-9663b67521fd None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:50.687310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:50.804782 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 571/1144] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:21:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 16:21:50.814087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a2025-db8b-4210-94ec-d38c37109542 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:50.934365 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a2025-db8b-4210-94ec-d38c37109542 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:50.975731 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9888c2e-eaf5-4631-8752-47247c797d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:50.976393 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9888c2e-eaf5-4631-8752-47247c797d39 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:50.976702 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9888c2e-eaf5-4631-8752-47247c797d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:50.976977 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9888c2e-eaf5-4631-8752-47247c797d39 None admin] PATH_INFO: `/v3/projects/31935a4591394f50907b97ba3ae8bf28` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:50.978190 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9888c2e-eaf5-4631-8752-47247c797d39 None admin] RBAC: Authorizing `identity:get_project(project_id=31935a4591394f50907b97ba3ae8bf28)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:50.979662 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9888c2e-eaf5-4631-8752-47247c797d39 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:50.981413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 574/1145] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:21:50 2022] GET /identity/v3/projects/31935a4591394f50907b97ba3ae8bf28 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:50.992212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccc5a9-d2db-425a-bd23-9663b67521fd None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:51.127184 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccc5a9-d2db-425a-bd23-9663b67521fd None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:51.141985 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:51.192292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd5042-c786-4809-9953-f30103bc9be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:51.193964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd5042-c786-4809-9953-f30103bc9be4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:51.194466 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd5042-c786-4809-9953-f30103bc9be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:51.194956 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd5042-c786-4809-9953-f30103bc9be4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:51.196319 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd5042-c786-4809-9953-f30103bc9be4 None admin] RBAC: Adding query filter params (role.id=a8896546a02c42489ef73c7ad7c43542, scope.project.id=31935a4591394f50907b97ba3ae8bf28, user.id=4d14660c9d184e3487f5c729d8a52d67) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:51.196882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd5042-c786-4809-9953-f30103bc9be4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:51.199477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd5042-c786-4809-9953-f30103bc9be4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:51.210165 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 572/1146] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:21:50 2022] GET /identity/v3/role_assignments?user.id=4d14660c9d184e3487f5c729d8a52d67&scope.project.id=31935a4591394f50907b97ba3ae8bf28&role.id=a8896546a02c42489ef73c7ad7c43542 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:53.208801 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0148f3-f28e-4234-a71f-eae1d9a83849 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:53.209594 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0148f3-f28e-4234-a71f-eae1d9a83849 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:53.209749 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0148f3-f28e-4234-a71f-eae1d9a83849 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:53.211210 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 575/1147] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:21:53.220363 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cd1a6-10cc-4b51-b143-80eb8713a991 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:53.220979 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cd1a6-10cc-4b51-b143-80eb8713a991 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:53.221322 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cd1a6-10cc-4b51-b143-80eb8713a991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:53.247353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-082cd1a6-10cc-4b51-b143-80eb8713a991 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:53.248595 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-082cd1a6-10cc-4b51-b143-80eb8713a991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:53.328437 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 573/1148] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:53.600186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0148f3-f28e-4234-a71f-eae1d9a83849 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:53.621549 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:53.740221 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0148f3-f28e-4234-a71f-eae1d9a83849 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:53.780949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc7071-c56d-4872-84ef-92354ba52bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:53.781594 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc7071-c56d-4872-84ef-92354ba52bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:53.781873 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc7071-c56d-4872-84ef-92354ba52bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:53.782145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc7071-c56d-4872-84ef-92354ba52bc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:53.794830 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc7071-c56d-4872-84ef-92354ba52bc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:21:53.799697 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-b9bc7071-c56d-4872-84ef-92354ba52bc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:21:53.799697 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:53.799697 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:53.799697 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:53.799697 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:53.799697 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:53.799697 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:53.799697 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:53.799697 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:53.799697 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:53.799697 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:53.799697 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:53.799697 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:21:53.799697 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:21:53.799697 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:21:53.799697 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:21:53.801521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:21:53.801521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:21:53.801521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:21:53.801521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:21:53.801521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:53.801521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:53.801521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:53.801521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:53.801521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:53.801521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:53.801521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:53.801521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:53.801521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:53.801521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:53.801521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:53.801521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:53.805273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:53.805273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:53.805273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:53.805273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:53.805273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:21:53.805273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:21:53.805273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:21:53.805273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:21:53.805273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:21:53.805273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:21:53.805273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:21:53.805273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:21:53.805273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 576/1149] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:21:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:21:53.808672 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cd1a6-10cc-4b51-b143-80eb8713a991 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:53.950582 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:53.954053 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cd1a6-10cc-4b51-b143-80eb8713a991 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:53.995880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff647134-4296-456c-87a7-823889c4cd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:53.996493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff647134-4296-456c-87a7-823889c4cd98 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:53.996831 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff647134-4296-456c-87a7-823889c4cd98 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:53.997100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff647134-4296-456c-87a7-823889c4cd98 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:53.997777 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff647134-4296-456c-87a7-823889c4cd98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:53.998078 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff647134-4296-456c-87a7-823889c4cd98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:53.999489 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff647134-4296-456c-87a7-823889c4cd98 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:54.010269 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 574/1150] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:21:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:54.019925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc7071-c56d-4872-84ef-92354ba52bc3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:54.138825 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:54.167780 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc7071-c56d-4872-84ef-92354ba52bc3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:54.213203 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5c010-d4f2-4dcc-a201-f6f2b3ddb0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:54.213897 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5c010-d4f2-4dcc-a201-f6f2b3ddb0fd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:54.214024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5c010-d4f2-4dcc-a201-f6f2b3ddb0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:54.214278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5c010-d4f2-4dcc-a201-f6f2b3ddb0fd None admin] PATH_INFO: `/v3/users/4d14660c9d184e3487f5c729d8a52d67` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:54.215704 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5c010-d4f2-4dcc-a201-f6f2b3ddb0fd None admin] RBAC: Authorizing `identity:get_user(user_id=4d14660c9d184e3487f5c729d8a52d67)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:54.217257 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5c010-d4f2-4dcc-a201-f6f2b3ddb0fd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:54.218945 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 577/1151] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:21:54 2022] GET /identity/v3/users/4d14660c9d184e3487f5c729d8a52d67 => generated 286 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:54.225726 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff647134-4296-456c-87a7-823889c4cd98 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:54.343597 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff647134-4296-456c-87a7-823889c4cd98 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:54.384921 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363ab11-d137-4351-b63e-a50228c3c4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:54.385566 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363ab11-d137-4351-b63e-a50228c3c4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:54.385845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363ab11-d137-4351-b63e-a50228c3c4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:54.386115 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363ab11-d137-4351-b63e-a50228c3c4f1 None admin] PATH_INFO: `/v3/projects/31935a4591394f50907b97ba3ae8bf28` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:54.387367 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7363ab11-d137-4351-b63e-a50228c3c4f1 None admin] RBAC: Authorizing `identity:get_project(project_id=31935a4591394f50907b97ba3ae8bf28)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:54.388855 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7363ab11-d137-4351-b63e-a50228c3c4f1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:54.390602 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 575/1152] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:21:54 2022] GET /identity/v3/projects/31935a4591394f50907b97ba3ae8bf28 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:54.397433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5c010-d4f2-4dcc-a201-f6f2b3ddb0fd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:54.516419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5c010-d4f2-4dcc-a201-f6f2b3ddb0fd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:54.554922 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb55afb-aa61-4835-af9f-bc7037cf6275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:54.555674 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb55afb-aa61-4835-af9f-bc7037cf6275 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:54.556121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb55afb-aa61-4835-af9f-bc7037cf6275 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:54.556573 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb55afb-aa61-4835-af9f-bc7037cf6275 None admin] PATH_INFO: `/v3/projects/31935a4591394f50907b97ba3ae8bf28/users/4d14660c9d184e3487f5c729d8a52d67/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:54.559741 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb55afb-aa61-4835-af9f-bc7037cf6275 None admin] RBAC: Authorizing `identity:create_grant(project_id=31935a4591394f50907b97ba3ae8bf28, user_id=4d14660c9d184e3487f5c729d8a52d67, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:54.562372 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb55afb-aa61-4835-af9f-bc7037cf6275 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:54.579302 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 578/1153] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 1 16:21:54 2022] PUT /identity/v3/projects/31935a4591394f50907b97ba3ae8bf28/users/4d14660c9d184e3487f5c729d8a52d67/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:21:56.713965 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb6d91-b391-4d71-9538-539b6fe8808f None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:56.714587 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb6d91-b391-4d71-9538-539b6fe8808f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:56.714587 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb6d91-b391-4d71-9538-539b6fe8808f None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:56.715895 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 576/1154] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:21:56.722291 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0d5fc-433d-41c8-98fd-68bcf5f0d35c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:56.722836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0d5fc-433d-41c8-98fd-68bcf5f0d35c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:56.722945 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0d5fc-433d-41c8-98fd-68bcf5f0d35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:56.731040 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:56.745624 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6bb0d5fc-433d-41c8-98fd-68bcf5f0d35c None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:21:56.746856 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6bb0d5fc-433d-41c8-98fd-68bcf5f0d35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:21:56.826220 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 579/1155] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:21:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:21:57.118338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb6d91-b391-4d71-9538-539b6fe8808f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:57.153803 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:57.237856 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb6d91-b391-4d71-9538-539b6fe8808f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:57.277824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be895f7c-6308-4cb6-8bd0-bae57ad0403d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:57.278931 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be895f7c-6308-4cb6-8bd0-bae57ad0403d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:57.279416 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be895f7c-6308-4cb6-8bd0-bae57ad0403d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:57.279911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be895f7c-6308-4cb6-8bd0-bae57ad0403d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:57.299786 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be895f7c-6308-4cb6-8bd0-bae57ad0403d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:21:57.310236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-be895f7c-6308-4cb6-8bd0-bae57ad0403d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:21:57.310236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:21:57.310236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:21:57.310236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:21:57.310236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:21:57.310236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:21:57.310236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:21:57.310236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:21:57.310236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:21:57.310236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:21:57.310236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:21:57.310236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:21:57.310236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:21:57.310236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:21:57.310236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:21:57.310236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:21:57.311464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:21:57.311464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:21:57.311464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:21:57.311464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:21:57.311464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:21:57.311464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:21:57.311464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:21:57.311464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:21:57.311464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:21:57.311464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:21:57.311464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:21:57.311464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:21:57.311464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:21:57.311464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:21:57.311464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:21:57.311464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:21:57.312518 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:21:57.312518 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:21:57.312518 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:21:57.312518 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:21:57.312518 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:21:57.312518 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:21:57.312518 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:21:57.312518 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:21:57.312518 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:21:57.312518 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:21:57.312518 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:21:57.312518 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:21:57.312518 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 577/1156] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:21:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:21:57.319616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0d5fc-433d-41c8-98fd-68bcf5f0d35c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:57.434773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0d5fc-433d-41c8-98fd-68bcf5f0d35c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:57.473145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be7a19-31c6-4706-b048-8ff8375029dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:57.474377 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be7a19-31c6-4706-b048-8ff8375029dc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:57.474712 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be7a19-31c6-4706-b048-8ff8375029dc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:57.475044 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be7a19-31c6-4706-b048-8ff8375029dc None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:57.475854 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be7a19-31c6-4706-b048-8ff8375029dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:57.476207 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be7a19-31c6-4706-b048-8ff8375029dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:57.477713 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be7a19-31c6-4706-b048-8ff8375029dc None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:57.479517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:57.488850 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 580/1157] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:21:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:57.495789 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be895f7c-6308-4cb6-8bd0-bae57ad0403d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:57.601382 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:57.612669 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be895f7c-6308-4cb6-8bd0-bae57ad0403d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:57.651810 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706ae53-d2a0-446e-a877-916b145751e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:57.652483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706ae53-d2a0-446e-a877-916b145751e8 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:57.652804 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706ae53-d2a0-446e-a877-916b145751e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:57.653079 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706ae53-d2a0-446e-a877-916b145751e8 None admin] PATH_INFO: `/v3/users/4d14660c9d184e3487f5c729d8a52d67` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:57.654575 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706ae53-d2a0-446e-a877-916b145751e8 None admin] RBAC: Authorizing `identity:get_user(user_id=4d14660c9d184e3487f5c729d8a52d67)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:57.656083 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706ae53-d2a0-446e-a877-916b145751e8 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:57.657979 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 578/1158] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:21:57 2022] GET /identity/v3/users/4d14660c9d184e3487f5c729d8a52d67 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:21:57.664911 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be7a19-31c6-4706-b048-8ff8375029dc None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:57.853832 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be7a19-31c6-4706-b048-8ff8375029dc None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:57.917064 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a7555-04fa-4875-84b9-0222dc4585df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:57.918112 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a7555-04fa-4875-84b9-0222dc4585df None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:57.918591 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a7555-04fa-4875-84b9-0222dc4585df None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:57.919099 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a7555-04fa-4875-84b9-0222dc4585df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:58.033759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:58.042679 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a7555-04fa-4875-84b9-0222dc4585df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:58.044161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a7555-04fa-4875-84b9-0222dc4585df None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:58.182835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 581/1159] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:21:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:21:58.189231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706ae53-d2a0-446e-a877-916b145751e8 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:58.321570 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706ae53-d2a0-446e-a877-916b145751e8 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:58.383960 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20eaaa-8923-488f-8a1e-4c41af752a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:58.385068 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20eaaa-8923-488f-8a1e-4c41af752a7b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:58.385558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20eaaa-8923-488f-8a1e-4c41af752a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:58.386039 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20eaaa-8923-488f-8a1e-4c41af752a7b None admin] PATH_INFO: `/v3/projects/31935a4591394f50907b97ba3ae8bf28` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:58.387855 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20eaaa-8923-488f-8a1e-4c41af752a7b None admin] RBAC: Authorizing `identity:get_project(project_id=31935a4591394f50907b97ba3ae8bf28)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:58.389385 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20eaaa-8923-488f-8a1e-4c41af752a7b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:58.391198 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 579/1160] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:21:58 2022] GET /identity/v3/projects/31935a4591394f50907b97ba3ae8bf28 => generated 311 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:21:58.397990 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a7555-04fa-4875-84b9-0222dc4585df None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:21:58.506434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:58.515343 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a7555-04fa-4875-84b9-0222dc4585df None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:21:58.557805 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec01359-3019-48c3-b17a-205ce0c32bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:21:58.558417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec01359-3019-48c3-b17a-205ce0c32bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:21:58.558693 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec01359-3019-48c3-b17a-205ce0c32bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:21:58.558964 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec01359-3019-48c3-b17a-205ce0c32bc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:21:58.559701 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec01359-3019-48c3-b17a-205ce0c32bc7 None admin] RBAC: Adding query filter params (role.id=a8896546a02c42489ef73c7ad7c43542, scope.project.id=31935a4591394f50907b97ba3ae8bf28, user.id=4d14660c9d184e3487f5c729d8a52d67) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:21:58.560005 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec01359-3019-48c3-b17a-205ce0c32bc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:21:58.561504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec01359-3019-48c3-b17a-205ce0c32bc7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:21:58.569176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 582/1161] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:21:58 2022] GET /identity/v3/role_assignments?user.id=4d14660c9d184e3487f5c729d8a52d67&scope.project.id=31935a4591394f50907b97ba3ae8bf28&role.id=a8896546a02c42489ef73c7ad7c43542 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:22:00.804414 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5298d-dc6c-4dd5-b424-755f85bd6b3e None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:00.805262 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5298d-dc6c-4dd5-b424-755f85bd6b3e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:00.805262 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5298d-dc6c-4dd5-b424-755f85bd6b3e None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:00.806753 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 580/1162] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:22:00.813249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd609a26-bca9-426b-85ca-d30492766ae9 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:00.813881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd609a26-bca9-426b-85ca-d30492766ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:00.813881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd609a26-bca9-426b-85ca-d30492766ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:00.836905 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-cd609a26-bca9-426b-85ca-d30492766ae9 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:22:00.838212 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cd609a26-bca9-426b-85ca-d30492766ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:22:00.924234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 583/1163] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:22:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:22:01.206597 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5298d-dc6c-4dd5-b424-755f85bd6b3e None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:01.242684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:01.339912 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5298d-dc6c-4dd5-b424-755f85bd6b3e None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:01.382223 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85794d07-bab9-4945-94df-437eead98c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:01.382905 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85794d07-bab9-4945-94df-437eead98c34 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:01.383229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85794d07-bab9-4945-94df-437eead98c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:01.383545 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85794d07-bab9-4945-94df-437eead98c34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:01.463158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85794d07-bab9-4945-94df-437eead98c34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:01.464590 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85794d07-bab9-4945-94df-437eead98c34 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:01.496766 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:01.583186 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 581/1164] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:22:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 16:22:01.590242 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd609a26-bca9-426b-85ca-d30492766ae9 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:01.696833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:01.709752 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd609a26-bca9-426b-85ca-d30492766ae9 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:01.748465 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd7894-0414-4c22-9784-d0612c2d2d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:01.749074 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd7894-0414-4c22-9784-d0612c2d2d3d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:01.749357 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd7894-0414-4c22-9784-d0612c2d2d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:01.749635 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd7894-0414-4c22-9784-d0612c2d2d3d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:01.757590 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd7894-0414-4c22-9784-d0612c2d2d3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:01.759083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd7894-0414-4c22-9784-d0612c2d2d3d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:01.772069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-55fd7894-0414-4c22-9784-d0612c2d2d3d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 16:22:01.772069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:22:01.772069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 01 16:22:01.772069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 01 16:22:01.772069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:22:01.772069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:22:01.772069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:22:01.772069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:22:01.772069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 01 16:22:01.772069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:22:01.772069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:22:01.772069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:22:01.772069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:22:01.772069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:22:01.772069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:22:01.772069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:22:01.772069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:22:01.774252 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:22:01.774252 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:22:01.774252 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:22:01.774252 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:22:01.774252 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:22:01.774252 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:22:01.774252 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:22:01.774252 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:22:01.774252 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:22:01.774252 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:22:01.774252 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:22:01.774252 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:22:01.774252 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:22:01.774252 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:22:01.774252 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:22:01.774252 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:22:01.775366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:22:01.775366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:22:01.775366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:22:01.775366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:22:01.775366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:22:01.775366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:22:01.775366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:22:01.775366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:22:01.775366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:22:01.775366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:22:01.775366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 01 16:22:01.775366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:22:01.775366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 16:22:01.775366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:22:01.775366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 584/1165] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Sep 1 16:22:01 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:22:01.779992 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85794d07-bab9-4945-94df-437eead98c34 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:01.897118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85794d07-bab9-4945-94df-437eead98c34 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:01.926149 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:01.936774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d7bf6-c68c-489d-bf30-82f630e633f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:01.937392 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d7bf6-c68c-489d-bf30-82f630e633f1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:01.937702 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d7bf6-c68c-489d-bf30-82f630e633f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:01.938148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d7bf6-c68c-489d-bf30-82f630e633f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:01.938874 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d7bf6-c68c-489d-bf30-82f630e633f1 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:01.939223 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d7bf6-c68c-489d-bf30-82f630e633f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:01.940785 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d7bf6-c68c-489d-bf30-82f630e633f1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:01.949667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 582/1166] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Sep 1 16:22:01 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:04.123660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefdb7a-3f34-4c76-b57e-48466915a067 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:04.124230 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefdb7a-3f34-4c76-b57e-48466915a067 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:04.124230 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefdb7a-3f34-4c76-b57e-48466915a067 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:04.125861 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 585/1167] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:22:04.132373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24095df-b188-47a3-9a67-f08d83b464fb None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:04.132970 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24095df-b188-47a3-9a67-f08d83b464fb None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:04.132970 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24095df-b188-47a3-9a67-f08d83b464fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:04.154776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f24095df-b188-47a3-9a67-f08d83b464fb None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:22:04.156240 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f24095df-b188-47a3-9a67-f08d83b464fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:22:04.236587 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 583/1168] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:22:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:22:04.508916 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefdb7a-3f34-4c76-b57e-48466915a067 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:04.632391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefdb7a-3f34-4c76-b57e-48466915a067 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:04.671478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf4466-cf6f-4af8-90b4-f392aa2f6ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:04.671478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf4466-cf6f-4af8-90b4-f392aa2f6ef4 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:04.671891 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf4466-cf6f-4af8-90b4-f392aa2f6ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:04.672108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf4466-cf6f-4af8-90b4-f392aa2f6ef4 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:04.672911 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf4466-cf6f-4af8-90b4-f392aa2f6ef4 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:04.674399 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf4466-cf6f-4af8-90b4-f392aa2f6ef4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:04.693852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 586/1169] 10.222.0.52 () {60 vars in 1138 bytes} [Thu Sep 1 16:22:04 2022] POST /identity/v3/domains => generated 267 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:22:06.858016 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36505d-5ff3-4b79-92cd-8f5e49faf8f9 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:06.858865 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36505d-5ff3-4b79-92cd-8f5e49faf8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:06.858865 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36505d-5ff3-4b79-92cd-8f5e49faf8f9 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:06.860832 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 584/1170] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:22:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:22:06.868032 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871693fc-f6a5-46b9-8eb5-bb6fc149ee0b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:06.868931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871693fc-f6a5-46b9-8eb5-bb6fc149ee0b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:06.869469 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871693fc-f6a5-46b9-8eb5-bb6fc149ee0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:06.901909 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-871693fc-f6a5-46b9-8eb5-bb6fc149ee0b None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:22:06.904062 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-871693fc-f6a5-46b9-8eb5-bb6fc149ee0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:22:06.909653 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:06.986964 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 587/1171] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:22:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:22:07.263984 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36505d-5ff3-4b79-92cd-8f5e49faf8f9 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:07.385656 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36505d-5ff3-4b79-92cd-8f5e49faf8f9 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:07.414167 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:07.430699 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e81f3b-ad16-4599-85f8-0c38bbb1f004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:07.431369 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e81f3b-ad16-4599-85f8-0c38bbb1f004 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:07.431648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e81f3b-ad16-4599-85f8-0c38bbb1f004 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:07.431919 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e81f3b-ad16-4599-85f8-0c38bbb1f004 None admin] PATH_INFO: `/v3/domains/2434fa90d23c401e9bf2568d91a96c1a` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:07.445047 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e81f3b-ad16-4599-85f8-0c38bbb1f004 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2434fa90d23c401e9bf2568d91a96c1a)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:07.446527 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e81f3b-ad16-4599-85f8-0c38bbb1f004 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:07.448280 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 585/1172] 10.222.0.52 () {56 vars in 1183 bytes} [Thu Sep 1 16:22:07 2022] GET /identity/v3/domains/2434fa90d23c401e9bf2568d91a96c1a => generated 267 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:07.456419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871693fc-f6a5-46b9-8eb5-bb6fc149ee0b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:07.579264 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871693fc-f6a5-46b9-8eb5-bb6fc149ee0b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:07.620478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968d374-4a29-4fdb-af15-fabff763e818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:07.621217 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968d374-4a29-4fdb-af15-fabff763e818 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:07.621538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968d374-4a29-4fdb-af15-fabff763e818 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:07.621862 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968d374-4a29-4fdb-af15-fabff763e818 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:07.622604 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968d374-4a29-4fdb-af15-fabff763e818 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:07.624171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968d374-4a29-4fdb-af15-fabff763e818 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:07.637756 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:07.660649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 588/1173] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 1 16:22:07 2022] POST /identity/v3/projects => generated 361 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:22:09.739827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a7a1c-c050-44f7-b7ed-ddf90038cd90 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:09.740379 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a7a1c-c050-44f7-b7ed-ddf90038cd90 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:09.740845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a7a1c-c050-44f7-b7ed-ddf90038cd90 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:09.743720 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 586/1174] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:22:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:22:09.749981 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e31be-b2e8-488a-ae64-d435069d78b3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:09.750537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e31be-b2e8-488a-ae64-d435069d78b3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:09.750537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e31be-b2e8-488a-ae64-d435069d78b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:09.776836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a60e31be-b2e8-488a-ae64-d435069d78b3 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:22:09.778080 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a60e31be-b2e8-488a-ae64-d435069d78b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:22:09.866461 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 589/1175] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:22:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:22:10.158662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a7a1c-c050-44f7-b7ed-ddf90038cd90 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:10.279556 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a7a1c-c050-44f7-b7ed-ddf90038cd90 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:10.321883 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619b452-11bb-4f41-ac51-f1863afd4858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:10.322521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619b452-11bb-4f41-ac51-f1863afd4858 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:10.322849 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619b452-11bb-4f41-ac51-f1863afd4858 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:10.323170 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619b452-11bb-4f41-ac51-f1863afd4858 None admin] PATH_INFO: `/v3/domains/2434fa90d23c401e9bf2568d91a96c1a` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:10.324393 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619b452-11bb-4f41-ac51-f1863afd4858 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2434fa90d23c401e9bf2568d91a96c1a)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:10.325990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619b452-11bb-4f41-ac51-f1863afd4858 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:10.327666 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 587/1176] 10.222.0.52 () {56 vars in 1183 bytes} [Thu Sep 1 16:22:10 2022] GET /identity/v3/domains/2434fa90d23c401e9bf2568d91a96c1a => generated 267 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:22:10.334557 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e31be-b2e8-488a-ae64-d435069d78b3 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:10.455273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e31be-b2e8-488a-ae64-d435069d78b3 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:10.481428 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:10.497505 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700479c9-c324-420f-950e-3aec56207997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:10.498181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700479c9-c324-420f-950e-3aec56207997 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:10.498512 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700479c9-c324-420f-950e-3aec56207997 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:10.498837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700479c9-c324-420f-950e-3aec56207997 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:10.499566 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700479c9-c324-420f-950e-3aec56207997 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:10.501162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700479c9-c324-420f-950e-3aec56207997 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:10.525257 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 590/1177] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 1 16:22:10 2022] POST /identity/v3/users => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:22:12.614080 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d79a1f-73ce-46b7-b238-caa4046b7a42 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:12.614664 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d79a1f-73ce-46b7-b238-caa4046b7a42 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:12.614664 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d79a1f-73ce-46b7-b238-caa4046b7a42 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:12.616136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 588/1178] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:22:12.623171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57575f95-f05f-433e-97da-9524d3d3fd54 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:12.623670 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57575f95-f05f-433e-97da-9524d3d3fd54 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:12.624095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57575f95-f05f-433e-97da-9524d3d3fd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:12.652820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-57575f95-f05f-433e-97da-9524d3d3fd54 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:22:12.654745 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-57575f95-f05f-433e-97da-9524d3d3fd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:22:12.740337 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 591/1179] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:22:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:22:13.022993 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d79a1f-73ce-46b7-b238-caa4046b7a42 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:13.083433 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:13.149523 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d79a1f-73ce-46b7-b238-caa4046b7a42 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:13.187353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813a5ce-b331-4ec2-b2d1-8a9658e25076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:13.188008 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813a5ce-b331-4ec2-b2d1-8a9658e25076 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:13.188289 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813a5ce-b331-4ec2-b2d1-8a9658e25076 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:13.188562 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813a5ce-b331-4ec2-b2d1-8a9658e25076 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:13.201084 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813a5ce-b331-4ec2-b2d1-8a9658e25076 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:22:13.205972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-5813a5ce-b331-4ec2-b2d1-8a9658e25076 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:22:13.205972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:22:13.205972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:22:13.205972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:22:13.205972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:22:13.205972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:22:13.205972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:22:13.205972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:22:13.205972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:22:13.205972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:22:13.205972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:22:13.205972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:22:13.205972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:22:13.205972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:22:13.205972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:22:13.205972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:22:13.207696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:22:13.207696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:22:13.207696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:22:13.207696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:22:13.207696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:22:13.207696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:22:13.207696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:22:13.207696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:22:13.207696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:22:13.207696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:22:13.207696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:22:13.207696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:22:13.207696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:22:13.207696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:22:13.207696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:22:13.207696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:22:13.209511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:22:13.209511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:22:13.209511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:22:13.209511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:22:13.209511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:22:13.209511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:22:13.209511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:22:13.209511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:22:13.209511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:22:13.209511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:22:13.209511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:22:13.209511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:22:13.209511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 589/1180] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:22:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:22:13.214128 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57575f95-f05f-433e-97da-9524d3d3fd54 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:13.327230 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57575f95-f05f-433e-97da-9524d3d3fd54 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:13.338358 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:13.366922 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6f953-2407-49ab-a7e4-0d84e3239b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:13.367540 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6f953-2407-49ab-a7e4-0d84e3239b01 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:13.367820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6f953-2407-49ab-a7e4-0d84e3239b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:13.368362 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6f953-2407-49ab-a7e4-0d84e3239b01 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:13.369081 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6f953-2407-49ab-a7e4-0d84e3239b01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:13.369388 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6f953-2407-49ab-a7e4-0d84e3239b01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:13.370805 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6f953-2407-49ab-a7e4-0d84e3239b01 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:13.380132 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 592/1181] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:22:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:13.389621 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813a5ce-b331-4ec2-b2d1-8a9658e25076 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:13.505542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813a5ce-b331-4ec2-b2d1-8a9658e25076 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:13.517457 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:13.545160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bc845-8c90-46cf-93f1-cffe25aa8c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:13.545796 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bc845-8c90-46cf-93f1-cffe25aa8c8d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:13.546072 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bc845-8c90-46cf-93f1-cffe25aa8c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:13.546345 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bc845-8c90-46cf-93f1-cffe25aa8c8d None admin] PATH_INFO: `/v3/users/25065f6660734958b7a23b8605b80b6e` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:13.562104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bc845-8c90-46cf-93f1-cffe25aa8c8d None admin] RBAC: Authorizing `identity:get_user(user_id=25065f6660734958b7a23b8605b80b6e)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:13.563671 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bc845-8c90-46cf-93f1-cffe25aa8c8d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:13.566300 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 590/1182] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:22:13 2022] GET /identity/v3/users/25065f6660734958b7a23b8605b80b6e => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:13.572781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6f953-2407-49ab-a7e4-0d84e3239b01 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:13.688815 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6f953-2407-49ab-a7e4-0d84e3239b01 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:13.732362 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df261c53-7358-487d-a8d2-a42f288c1812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:13.733102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df261c53-7358-487d-a8d2-a42f288c1812 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:13.733432 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df261c53-7358-487d-a8d2-a42f288c1812 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:13.733754 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df261c53-7358-487d-a8d2-a42f288c1812 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:13.779666 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:13.811641 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df261c53-7358-487d-a8d2-a42f288c1812 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:13.813161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df261c53-7358-487d-a8d2-a42f288c1812 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:13.933965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 593/1183] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:22:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 16:22:13.943868 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bc845-8c90-46cf-93f1-cffe25aa8c8d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:14.133288 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bc845-8c90-46cf-93f1-cffe25aa8c8d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:14.197770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9655b91-ca41-4607-bb80-9f7f5efc2622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:14.198780 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9655b91-ca41-4607-bb80-9f7f5efc2622 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:14.199283 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9655b91-ca41-4607-bb80-9f7f5efc2622 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:14.199777 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9655b91-ca41-4607-bb80-9f7f5efc2622 None admin] PATH_INFO: `/v3/projects/fffd38dca91440768b19942a9d887a1b` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:14.201877 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9655b91-ca41-4607-bb80-9f7f5efc2622 None admin] RBAC: Authorizing `identity:get_project(project_id=fffd38dca91440768b19942a9d887a1b)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:14.204737 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9655b91-ca41-4607-bb80-9f7f5efc2622 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:14.207998 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 591/1184] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:22:13 2022] GET /identity/v3/projects/fffd38dca91440768b19942a9d887a1b => generated 361 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:14.214702 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df261c53-7358-487d-a8d2-a42f288c1812 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:14.295366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:14.331561 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df261c53-7358-487d-a8d2-a42f288c1812 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:14.372183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3004f4a-4bc1-40d2-846f-c92fce9a86d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:14.372824 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3004f4a-4bc1-40d2-846f-c92fce9a86d0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:14.373107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3004f4a-4bc1-40d2-846f-c92fce9a86d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:14.373383 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3004f4a-4bc1-40d2-846f-c92fce9a86d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:14.374127 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3004f4a-4bc1-40d2-846f-c92fce9a86d0 None admin] RBAC: Adding query filter params (role.id=a8896546a02c42489ef73c7ad7c43542, scope.project.id=fffd38dca91440768b19942a9d887a1b, user.id=25065f6660734958b7a23b8605b80b6e) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:14.374437 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3004f4a-4bc1-40d2-846f-c92fce9a86d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:14.375906 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3004f4a-4bc1-40d2-846f-c92fce9a86d0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:14.382367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 594/1185] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:22:14 2022] GET /identity/v3/role_assignments?user.id=25065f6660734958b7a23b8605b80b6e&scope.project.id=fffd38dca91440768b19942a9d887a1b&role.id=a8896546a02c42489ef73c7ad7c43542 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:16.417786 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ae2fd-d60e-412b-b66a-06821e5ffd51 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:16.418343 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ae2fd-d60e-412b-b66a-06821e5ffd51 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:16.418343 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ae2fd-d60e-412b-b66a-06821e5ffd51 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:16.419822 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 592/1186] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:22:16.426581 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb85c7-e3ca-4768-b331-88632f655956 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:16.427137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb85c7-e3ca-4768-b331-88632f655956 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:16.427137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb85c7-e3ca-4768-b331-88632f655956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:16.446989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-44eb85c7-e3ca-4768-b331-88632f655956 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:22:16.448214 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-44eb85c7-e3ca-4768-b331-88632f655956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:22:16.524703 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 595/1187] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:22:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:22:17.048072 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ae2fd-d60e-412b-b66a-06821e5ffd51 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:17.113855 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:17.241591 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ae2fd-d60e-412b-b66a-06821e5ffd51 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:17.320285 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30483aa-45d1-4c08-89ef-2ef1cea51470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:17.320871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30483aa-45d1-4c08-89ef-2ef1cea51470 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:17.321152 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30483aa-45d1-4c08-89ef-2ef1cea51470 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:17.321424 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30483aa-45d1-4c08-89ef-2ef1cea51470 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:17.334465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30483aa-45d1-4c08-89ef-2ef1cea51470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:22:17.339497 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-e30483aa-45d1-4c08-89ef-2ef1cea51470 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:22:17.339497 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:22:17.339497 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:22:17.339497 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:22:17.339497 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:22:17.339497 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:22:17.339497 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:22:17.339497 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:22:17.339497 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:22:17.339497 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:22:17.339497 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:22:17.339497 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:22:17.339497 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:22:17.339497 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:22:17.339497 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:22:17.339497 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:22:17.340880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:22:17.340880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:22:17.340880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:22:17.340880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:22:17.340880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:22:17.340880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:22:17.340880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:22:17.340880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:22:17.340880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:22:17.340880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:22:17.340880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:22:17.340880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:22:17.340880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:22:17.340880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:22:17.340880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:22:17.340880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:22:17.342155 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:22:17.342155 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:22:17.342155 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:22:17.342155 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:22:17.342155 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:22:17.342155 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:22:17.342155 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:22:17.342155 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:22:17.342155 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:22:17.342155 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:22:17.342155 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:22:17.342155 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:22:17.342155 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 593/1188] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:22:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:22:17.348977 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb85c7-e3ca-4768-b331-88632f655956 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:17.431773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:17.478735 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb85c7-e3ca-4768-b331-88632f655956 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:17.518402 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee4bcd-87fe-494c-8a75-e676169041ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:17.519018 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee4bcd-87fe-494c-8a75-e676169041ee None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:17.519397 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee4bcd-87fe-494c-8a75-e676169041ee None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:17.519674 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee4bcd-87fe-494c-8a75-e676169041ee None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:17.520365 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee4bcd-87fe-494c-8a75-e676169041ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:17.520696 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee4bcd-87fe-494c-8a75-e676169041ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:17.522114 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee4bcd-87fe-494c-8a75-e676169041ee None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:17.531977 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 596/1189] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:22:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:22:17.539297 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30483aa-45d1-4c08-89ef-2ef1cea51470 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:17.653210 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:17.661652 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30483aa-45d1-4c08-89ef-2ef1cea51470 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:17.700310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e15c7-33b6-48bc-bf84-43278b53d529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:17.701049 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e15c7-33b6-48bc-bf84-43278b53d529 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:17.701324 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e15c7-33b6-48bc-bf84-43278b53d529 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:17.701593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e15c7-33b6-48bc-bf84-43278b53d529 None admin] PATH_INFO: `/v3/users/25065f6660734958b7a23b8605b80b6e` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:17.702973 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e15c7-33b6-48bc-bf84-43278b53d529 None admin] RBAC: Authorizing `identity:get_user(user_id=25065f6660734958b7a23b8605b80b6e)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:17.704467 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e15c7-33b6-48bc-bf84-43278b53d529 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:17.706265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 594/1190] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:22:17 2022] GET /identity/v3/users/25065f6660734958b7a23b8605b80b6e => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:17.712809 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee4bcd-87fe-494c-8a75-e676169041ee None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:17.831612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee4bcd-87fe-494c-8a75-e676169041ee None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:17.864873 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:17.876379 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1bcff-98fc-4f69-a75d-67de02c7f742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:17.877205 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1bcff-98fc-4f69-a75d-67de02c7f742 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:17.877555 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1bcff-98fc-4f69-a75d-67de02c7f742 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:17.878065 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1bcff-98fc-4f69-a75d-67de02c7f742 None admin] PATH_INFO: `/v3/projects/fffd38dca91440768b19942a9d887a1b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:17.879509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1bcff-98fc-4f69-a75d-67de02c7f742 None admin] RBAC: Authorizing `identity:get_project(project_id=fffd38dca91440768b19942a9d887a1b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:17.881170 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1bcff-98fc-4f69-a75d-67de02c7f742 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:17.883082 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 597/1191] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:22:17 2022] GET /identity/v3/projects/fffd38dca91440768b19942a9d887a1b => generated 361 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:22:17.890658 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e15c7-33b6-48bc-bf84-43278b53d529 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:18.013321 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e15c7-33b6-48bc-bf84-43278b53d529 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:18.055554 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c95100-ddc8-4c00-a83a-8371c0edfab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:18.056481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c95100-ddc8-4c00-a83a-8371c0edfab6 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:18.056795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c95100-ddc8-4c00-a83a-8371c0edfab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:18.057066 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c95100-ddc8-4c00-a83a-8371c0edfab6 None admin] PATH_INFO: `/v3/projects/fffd38dca91440768b19942a9d887a1b/users/25065f6660734958b7a23b8605b80b6e/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:18.059198 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c95100-ddc8-4c00-a83a-8371c0edfab6 None admin] RBAC: Authorizing `identity:create_grant(project_id=fffd38dca91440768b19942a9d887a1b, user_id=25065f6660734958b7a23b8605b80b6e, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:18.060708 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c95100-ddc8-4c00-a83a-8371c0edfab6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:18.076449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 595/1192] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 1 16:22:17 2022] PUT /identity/v3/projects/fffd38dca91440768b19942a9d887a1b/users/25065f6660734958b7a23b8605b80b6e/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:22:20.098148 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef200808-6527-41a1-b047-242bee7c5f86 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:20.098732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef200808-6527-41a1-b047-242bee7c5f86 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:20.099094 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef200808-6527-41a1-b047-242bee7c5f86 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:20.100524 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 598/1193] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:22:20.106605 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917273f-df58-4db0-98fc-3b7bf710ebb1 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:20.107131 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917273f-df58-4db0-98fc-3b7bf710ebb1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:20.107262 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917273f-df58-4db0-98fc-3b7bf710ebb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:20.129638 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a917273f-df58-4db0-98fc-3b7bf710ebb1 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:22:20.130901 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a917273f-df58-4db0-98fc-3b7bf710ebb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:22:20.150508 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:20.211917 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 596/1194] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:22:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:22:20.492032 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef200808-6527-41a1-b047-242bee7c5f86 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:20.609865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef200808-6527-41a1-b047-242bee7c5f86 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:20.651850 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f70502-a629-47f6-82ed-e4f01ce0daa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:20.652508 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f70502-a629-47f6-82ed-e4f01ce0daa5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:20.652817 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f70502-a629-47f6-82ed-e4f01ce0daa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:20.653090 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f70502-a629-47f6-82ed-e4f01ce0daa5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:20.666213 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f70502-a629-47f6-82ed-e4f01ce0daa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:22:20.671163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-27f70502-a629-47f6-82ed-e4f01ce0daa5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:22:20.671163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:22:20.671163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:22:20.671163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:22:20.671163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:22:20.671163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:22:20.671163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:22:20.671163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:22:20.671163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:22:20.671163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:22:20.671163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:22:20.671163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:22:20.671163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:22:20.671163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:22:20.671163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:22:20.671163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:22:20.673054 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:22:20.673054 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:22:20.673054 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:22:20.673054 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:22:20.673054 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:22:20.673054 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:22:20.673054 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:22:20.673054 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:22:20.673054 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:22:20.673054 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:22:20.673054 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:22:20.673054 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:22:20.673054 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:22:20.673054 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:22:20.673054 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:22:20.673054 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:22:20.674780 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:22:20.674780 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:22:20.674780 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:22:20.674780 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:22:20.674780 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:22:20.674780 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:22:20.674780 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:22:20.674780 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:22:20.674780 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:22:20.674780 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:22:20.674780 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:22:20.674780 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:22:20.674780 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 599/1195] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:22:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:22:20.682229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917273f-df58-4db0-98fc-3b7bf710ebb1 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:20.800736 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917273f-df58-4db0-98fc-3b7bf710ebb1 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:20.841555 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a5122-cd1f-4996-a408-141a07669956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:20.842271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a5122-cd1f-4996-a408-141a07669956 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:20.842596 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a5122-cd1f-4996-a408-141a07669956 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:20.842913 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a5122-cd1f-4996-a408-141a07669956 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:20.843649 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a5122-cd1f-4996-a408-141a07669956 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:20.843996 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a5122-cd1f-4996-a408-141a07669956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:20.845490 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a5122-cd1f-4996-a408-141a07669956 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:20.855516 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 597/1196] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:22:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:20.866235 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f70502-a629-47f6-82ed-e4f01ce0daa5 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:20.971868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:21.054061 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f70502-a629-47f6-82ed-e4f01ce0daa5 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:21.117985 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d18ca-67bd-44a8-b6a6-c86bc15b1a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:21.119058 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d18ca-67bd-44a8-b6a6-c86bc15b1a1e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:21.119551 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d18ca-67bd-44a8-b6a6-c86bc15b1a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:21.120036 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d18ca-67bd-44a8-b6a6-c86bc15b1a1e None admin] PATH_INFO: `/v3/users/25065f6660734958b7a23b8605b80b6e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:21.122205 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d18ca-67bd-44a8-b6a6-c86bc15b1a1e None admin] RBAC: Authorizing `identity:get_user(user_id=25065f6660734958b7a23b8605b80b6e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:21.124997 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d18ca-67bd-44a8-b6a6-c86bc15b1a1e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:21.128423 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 600/1197] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 1 16:22:20 2022] GET /identity/v3/users/25065f6660734958b7a23b8605b80b6e => generated 311 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:21.134490 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a5122-cd1f-4996-a408-141a07669956 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:21.153122 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:21.264789 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a5122-cd1f-4996-a408-141a07669956 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:21.304816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19347a0-df81-4798-bef8-78599ecd9469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:21.305358 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19347a0-df81-4798-bef8-78599ecd9469 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:21.305634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19347a0-df81-4798-bef8-78599ecd9469 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:21.305901 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19347a0-df81-4798-bef8-78599ecd9469 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:21.389083 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19347a0-df81-4798-bef8-78599ecd9469 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:21.390579 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19347a0-df81-4798-bef8-78599ecd9469 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:21.409313 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:21.513700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 598/1198] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:22:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:22:21.520159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d18ca-67bd-44a8-b6a6-c86bc15b1a1e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:21.635214 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d18ca-67bd-44a8-b6a6-c86bc15b1a1e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:21.663033 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:21.676873 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26001a09-ad1e-4969-a488-f9049e0cf555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:21.677529 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26001a09-ad1e-4969-a488-f9049e0cf555 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:21.677803 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26001a09-ad1e-4969-a488-f9049e0cf555 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:21.678074 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26001a09-ad1e-4969-a488-f9049e0cf555 None admin] PATH_INFO: `/v3/projects/fffd38dca91440768b19942a9d887a1b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:21.679349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26001a09-ad1e-4969-a488-f9049e0cf555 None admin] RBAC: Authorizing `identity:get_project(project_id=fffd38dca91440768b19942a9d887a1b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:21.680854 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26001a09-ad1e-4969-a488-f9049e0cf555 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:21.682596 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 601/1199] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 1 16:22:21 2022] GET /identity/v3/projects/fffd38dca91440768b19942a9d887a1b => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:22:21.693079 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19347a0-df81-4798-bef8-78599ecd9469 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:22:21.875920 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19347a0-df81-4798-bef8-78599ecd9469 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:22:21.903517 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:21.927358 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc96bae-870b-4c52-918f-efab7abaee16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:22:21.928004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc96bae-870b-4c52-918f-efab7abaee16 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:22:21.928281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc96bae-870b-4c52-918f-efab7abaee16 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:22:21.928570 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc96bae-870b-4c52-918f-efab7abaee16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:22:21.929384 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc96bae-870b-4c52-918f-efab7abaee16 None admin] RBAC: Adding query filter params (role.id=a8896546a02c42489ef73c7ad7c43542, scope.project.id=fffd38dca91440768b19942a9d887a1b, user.id=25065f6660734958b7a23b8605b80b6e) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:22:21.929689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc96bae-870b-4c52-918f-efab7abaee16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:22:21.931164 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc96bae-870b-4c52-918f-efab7abaee16 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:22:21.937824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 599/1200] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:22:21 2022] GET /identity/v3/role_assignments?user.id=25065f6660734958b7a23b8605b80b6e&scope.project.id=fffd38dca91440768b19942a9d887a1b&role.id=a8896546a02c42489ef73c7ad7c43542 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:22:31.671892 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:22:31.934941 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=11 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:24.706033 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc1674-8a02-4914-8a3e-365cae4c4a41 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:24.707079 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc1674-8a02-4914-8a3e-365cae4c4a41 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:24.707079 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc1674-8a02-4914-8a3e-365cae4c4a41 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:24.708159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 602/1201] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:23:24.715082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cbcd1-72f4-4e8b-82be-79259fb7bf2b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:24.716094 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cbcd1-72f4-4e8b-82be-79259fb7bf2b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:24.716094 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cbcd1-72f4-4e8b-82be-79259fb7bf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:24.740728 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-cd5cbcd1-72f4-4e8b-82be-79259fb7bf2b None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:23:24.743824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cd5cbcd1-72f4-4e8b-82be-79259fb7bf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:23:24.868555 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 600/1202] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:23:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:23:25.209762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc1674-8a02-4914-8a3e-365cae4c4a41 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:25.426148 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc1674-8a02-4914-8a3e-365cae4c4a41 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:25.488844 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3aae9-864a-4bc0-9cf3-ccc04a9e3ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:25.489864 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3aae9-864a-4bc0-9cf3-ccc04a9e3ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:25.490184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3aae9-864a-4bc0-9cf3-ccc04a9e3ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:25.490529 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3aae9-864a-4bc0-9cf3-ccc04a9e3ee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:25.505081 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3aae9-864a-4bc0-9cf3-ccc04a9e3ee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:25.507106 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3aae9-864a-4bc0-9cf3-ccc04a9e3ee5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:25.530980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-1eb3aae9-864a-4bc0-9cf3-ccc04a9e3ee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:25.530980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:25.530980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:25.530980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:25.530980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:25.530980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:25.530980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:25.530980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:25.530980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:25.530980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:25.530980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:25.530980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:25.530980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:23:25.530980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:23:25.530980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:23:25.530980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:23:25.532468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:25.532468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:25.532468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:25.532468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:25.532468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:25.532468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:25.532468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:25.532468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:25.532468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:25.532468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:25.532468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:25.532468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:25.532468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:25.532468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:25.532468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:25.532468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:25.532468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:23:25.533733 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:23:25.533733 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:25.533733 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:23:25.533733 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 603/1203] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:23:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:23:25.537209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cbcd1-72f4-4e8b-82be-79259fb7bf2b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:25.750022 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cbcd1-72f4-4e8b-82be-79259fb7bf2b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:25.797363 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:25.810996 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf9584-2943-401f-979c-96845f73fd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:25.812081 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf9584-2943-401f-979c-96845f73fd31 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:25.812574 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf9584-2943-401f-979c-96845f73fd31 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:25.813007 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf9584-2943-401f-979c-96845f73fd31 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:25.814039 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf9584-2943-401f-979c-96845f73fd31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:25.814571 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf9584-2943-401f-979c-96845f73fd31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:25.816975 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf9584-2943-401f-979c-96845f73fd31 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:25.835955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 601/1204] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:25.843395 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3aae9-864a-4bc0-9cf3-ccc04a9e3ee5 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:25.916443 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:26.008205 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3aae9-864a-4bc0-9cf3-ccc04a9e3ee5 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:26.064665 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4446db3-6ee9-4a4f-92b3-97edc050a82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:26.064665 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4446db3-6ee9-4a4f-92b3-97edc050a82d None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:26.064665 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4446db3-6ee9-4a4f-92b3-97edc050a82d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:26.064665 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4446db3-6ee9-4a4f-92b3-97edc050a82d None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:26.066563 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4446db3-6ee9-4a4f-92b3-97edc050a82d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:26.076668 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4446db3-6ee9-4a4f-92b3-97edc050a82d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:26.102865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 604/1205] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 1 16:23:25 2022] POST /identity/v3/users => generated 251 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:23:28.854395 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff4354-fde6-4e79-9a6b-93347f3b79c0 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:28.859364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff4354-fde6-4e79-9a6b-93347f3b79c0 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:28.859364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff4354-fde6-4e79-9a6b-93347f3b79c0 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:28.859364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 602/1206] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:23:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:23:28.863183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c896a-7df3-42b8-8bc7-1f1e1b4192b6 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:28.863822 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c896a-7df3-42b8-8bc7-1f1e1b4192b6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:28.863822 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c896a-7df3-42b8-8bc7-1f1e1b4192b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:28.892103 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f79c896a-7df3-42b8-8bc7-1f1e1b4192b6 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:23:28.894148 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f79c896a-7df3-42b8-8bc7-1f1e1b4192b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:23:29.016727 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 605/1207] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:23:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:23:29.403202 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff4354-fde6-4e79-9a6b-93347f3b79c0 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:29.545493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff4354-fde6-4e79-9a6b-93347f3b79c0 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:29.590152 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9c8fc-f7cd-403e-a151-63c21db04be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:29.593204 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9c8fc-f7cd-403e-a151-63c21db04be0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:29.593204 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9c8fc-f7cd-403e-a151-63c21db04be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:29.593204 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9c8fc-f7cd-403e-a151-63c21db04be0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:29.607039 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9c8fc-f7cd-403e-a151-63c21db04be0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:23:29.612446 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-8cf9c8fc-f7cd-403e-a151-63c21db04be0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:23:29.612446 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:29.612446 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:29.612446 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:29.612446 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:29.612446 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:29.612446 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:29.612446 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:29.612446 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:29.612446 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:29.612446 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:29.612446 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:29.612446 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:23:29.612446 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:23:29.612446 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:23:29.612446 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:23:29.619667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:23:29.619667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:23:29.619667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:23:29.619667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:23:29.619667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:29.619667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:29.619667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:29.619667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:29.619667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:29.619667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:29.619667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:29.619667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:29.619667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:29.619667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:29.619667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:29.619667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:29.622199 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:29.622199 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:29.622199 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:29.622199 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:29.622199 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:23:29.622199 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:23:29.622199 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:23:29.622199 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:23:29.622199 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:23:29.622199 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:23:29.622199 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:23:29.622199 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:23:29.622199 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 603/1208] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 1 16:23:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:29.624087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c896a-7df3-42b8-8bc7-1f1e1b4192b6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:29.682199 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:29.774742 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c896a-7df3-42b8-8bc7-1f1e1b4192b6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:29.823929 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707346e3-0152-4b73-a77d-2037c24b9e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:29.824656 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707346e3-0152-4b73-a77d-2037c24b9e30 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:29.824985 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707346e3-0152-4b73-a77d-2037c24b9e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:29.825270 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707346e3-0152-4b73-a77d-2037c24b9e30 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:29.825975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707346e3-0152-4b73-a77d-2037c24b9e30 None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:29.826281 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707346e3-0152-4b73-a77d-2037c24b9e30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:29.829685 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707346e3-0152-4b73-a77d-2037c24b9e30 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:29.841406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 606/1209] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 1 16:23:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:29.850709 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9c8fc-f7cd-403e-a151-63c21db04be0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:29.956397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:30.051510 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9c8fc-f7cd-403e-a151-63c21db04be0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:30.117919 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ab410-8b94-4e24-9870-2ca447cfd31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:30.119362 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ab410-8b94-4e24-9870-2ca447cfd31f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:30.119362 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ab410-8b94-4e24-9870-2ca447cfd31f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:30.119362 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ab410-8b94-4e24-9870-2ca447cfd31f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:30.131999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ab410-8b94-4e24-9870-2ca447cfd31f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:30.133584 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ab410-8b94-4e24-9870-2ca447cfd31f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:30.151185 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-575ab410-8b94-4e24-9870-2ca447cfd31f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:30.151185 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:30.151185 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:30.151185 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:30.151185 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:30.151185 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:30.151185 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:30.151185 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:30.151185 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:30.151185 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:30.151185 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:30.151185 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:30.151185 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:23:30.151185 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:23:30.151185 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:23:30.151185 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:23:30.154301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:30.154301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:30.154301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:30.154301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:30.154301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:30.154301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:30.154301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:30.154301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:30.154301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:30.154301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:30.154301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:30.154301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:30.154301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:30.154301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:30.154301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:30.154301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:30.154301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:23:30.155200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:23:30.155200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:30.155200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:23:30.155200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 604/1210] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:23:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:30.160953 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707346e3-0152-4b73-a77d-2037c24b9e30 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:30.306414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:30.312826 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707346e3-0152-4b73-a77d-2037c24b9e30 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:30.371800 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d8d67-064b-458d-b514-ac58a03267c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:30.372436 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d8d67-064b-458d-b514-ac58a03267c0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:30.372761 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d8d67-064b-458d-b514-ac58a03267c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:30.373041 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d8d67-064b-458d-b514-ac58a03267c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:30.373754 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d8d67-064b-458d-b514-ac58a03267c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:30.374152 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d8d67-064b-458d-b514-ac58a03267c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:30.376162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d8d67-064b-458d-b514-ac58a03267c0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:30.399704 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 607/1211] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:23:30.410741 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ab410-8b94-4e24-9870-2ca447cfd31f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:30.582963 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ab410-8b94-4e24-9870-2ca447cfd31f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:30.584816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:30.634700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e2071-07ea-43e7-8772-61b86b9ddd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:30.635940 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e2071-07ea-43e7-8772-61b86b9ddd2a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:30.636223 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e2071-07ea-43e7-8772-61b86b9ddd2a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:30.636507 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e2071-07ea-43e7-8772-61b86b9ddd2a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:30.645689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e2071-07ea-43e7-8772-61b86b9ddd2a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:30.647484 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e2071-07ea-43e7-8772-61b86b9ddd2a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:30.661911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-c75e2071-07ea-43e7-8772-61b86b9ddd2a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:23:30.661911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:30.661911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:30.661911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:30.661911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:30.661911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:30.661911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:30.661911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:30.661911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:30.661911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:30.661911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:30.661911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:30.661911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:23:30.661911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:23:30.661911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:23:30.661911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:23:30.664146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:30.664146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:30.664146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:23:30.664146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:23:30.664146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:23:30.664146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:23:30.664146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:30.664146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:30.664146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:30.664146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:30.664146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:30.664146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:30.664146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:30.664146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:30.664146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:30.664146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:30.664146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:30.664146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:30.666158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:30.666158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:30.666158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:23:30.666158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:23:30.666158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:23:30.666158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:23:30.666158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:23:30.666158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:23:30.666158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:23:30.666158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:23:30.666158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 605/1212] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:23:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:30.670350 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d8d67-064b-458d-b514-ac58a03267c0 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:30.832838 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d8d67-064b-458d-b514-ac58a03267c0 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:30.899716 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c540a41-5249-498d-9c18-46799e1d31b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:30.900824 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c540a41-5249-498d-9c18-46799e1d31b5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:30.901951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c540a41-5249-498d-9c18-46799e1d31b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:30.902529 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c540a41-5249-498d-9c18-46799e1d31b5 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:30.904060 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c540a41-5249-498d-9c18-46799e1d31b5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:30.904732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c540a41-5249-498d-9c18-46799e1d31b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:30.907403 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c540a41-5249-498d-9c18-46799e1d31b5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:30.938349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 608/1213] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Sep 1 16:23:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:30.944559 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e2071-07ea-43e7-8772-61b86b9ddd2a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:31.116307 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e2071-07ea-43e7-8772-61b86b9ddd2a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:31.156470 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c6eca-dac4-4b13-a115-e0cde379cbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:31.157051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c6eca-dac4-4b13-a115-e0cde379cbb9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:31.157331 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c6eca-dac4-4b13-a115-e0cde379cbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:31.157605 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c6eca-dac4-4b13-a115-e0cde379cbb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:31.201012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:31.260103 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c6eca-dac4-4b13-a115-e0cde379cbb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:31.262192 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c6eca-dac4-4b13-a115-e0cde379cbb9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:31.369717 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 606/1214] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:23:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:23:31.375957 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c540a41-5249-498d-9c18-46799e1d31b5 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:31.401632 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:31.513647 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c540a41-5249-498d-9c18-46799e1d31b5 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:31.564145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38f331-4a5c-440b-8945-5d5b023f4b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:31.564827 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38f331-4a5c-440b-8945-5d5b023f4b2a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:31.565110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38f331-4a5c-440b-8945-5d5b023f4b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:31.565385 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38f331-4a5c-440b-8945-5d5b023f4b2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:31.587472 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38f331-4a5c-440b-8945-5d5b023f4b2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:31.590863 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38f331-4a5c-440b-8945-5d5b023f4b2a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:31.621267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-9e38f331-4a5c-440b-8945-5d5b023f4b2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:31.621267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:31.621267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:31.621267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:31.621267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:31.621267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:31.621267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:31.621267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:31.621267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:31.621267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:31.621267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:31.621267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:31.621267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:23:31.621267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:23:31.621267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:23:31.621267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:23:31.622429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:31.622429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:31.622429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:31.622429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:31.622429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:31.622429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:31.622429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:31.622429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:31.622429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:31.622429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:31.622429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:31.622429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:31.622429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:31.622429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:31.622429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:31.622429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:31.622429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:23:31.623582 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:23:31.623582 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:31.623582 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:23:31.631250 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 609/1215] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:31.632470 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c6eca-dac4-4b13-a115-e0cde379cbb9 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:31.715221 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:31.769346 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c6eca-dac4-4b13-a115-e0cde379cbb9 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:31.822331 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef3bdf-cd42-4508-9ac7-71153b7ce7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:31.824126 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef3bdf-cd42-4508-9ac7-71153b7ce7fd None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:31.824607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef3bdf-cd42-4508-9ac7-71153b7ce7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:31.825084 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef3bdf-cd42-4508-9ac7-71153b7ce7fd None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:31.825950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef3bdf-cd42-4508-9ac7-71153b7ce7fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:31.826408 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef3bdf-cd42-4508-9ac7-71153b7ce7fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:31.827965 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef3bdf-cd42-4508-9ac7-71153b7ce7fd None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:31.841006 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 607/1216] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:23:31.847540 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38f331-4a5c-440b-8945-5d5b023f4b2a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:31.977613 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:32.025358 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38f331-4a5c-440b-8945-5d5b023f4b2a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:32.081060 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146df08-2778-47f6-8bc2-b31c80968d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:32.081707 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146df08-2778-47f6-8bc2-b31c80968d7d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:32.081986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146df08-2778-47f6-8bc2-b31c80968d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:32.082258 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146df08-2778-47f6-8bc2-b31c80968d7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:32.091020 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146df08-2778-47f6-8bc2-b31c80968d7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:32.093002 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146df08-2778-47f6-8bc2-b31c80968d7d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:32.113000 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-9146df08-2778-47f6-8bc2-b31c80968d7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:23:32.113000 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:32.113000 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:32.113000 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:32.113000 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:32.113000 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:32.113000 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:32.113000 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:32.113000 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:32.113000 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:32.113000 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:32.113000 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:32.113000 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:23:32.113000 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:23:32.113000 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:23:32.115145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:23:32.115145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:32.115145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:32.115145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:32.115145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:32.115145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:32.115145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:32.115145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:32.115145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:32.115145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:32.115145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:32.115145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:32.115145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:32.115145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:32.115145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:32.115145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:32.115145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:32.116601 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:23:32.116601 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:23:32.116601 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:23:32.116601 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:23:32.116601 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:23:32.116601 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:23:32.116601 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:23:32.116601 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:23:32.116601 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 610/1217] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:23:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:32.122510 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef3bdf-cd42-4508-9ac7-71153b7ce7fd None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:32.266994 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef3bdf-cd42-4508-9ac7-71153b7ce7fd None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:32.295424 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:32.313137 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9537e3-3b37-48c3-8202-4d7d4bc166d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:32.313752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9537e3-3b37-48c3-8202-4d7d4bc166d4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:32.314034 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9537e3-3b37-48c3-8202-4d7d4bc166d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:32.314308 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9537e3-3b37-48c3-8202-4d7d4bc166d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:32.315017 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9537e3-3b37-48c3-8202-4d7d4bc166d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:32.315323 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9537e3-3b37-48c3-8202-4d7d4bc166d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:32.316773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9537e3-3b37-48c3-8202-4d7d4bc166d4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:32.331394 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 608/1218] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:23:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:23:32.337619 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146df08-2778-47f6-8bc2-b31c80968d7d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:32.468556 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146df08-2778-47f6-8bc2-b31c80968d7d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:32.508850 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:32.517624 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872da0e2-bbd5-41aa-becb-b358088fdab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:32.518265 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872da0e2-bbd5-41aa-becb-b358088fdab1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:32.518540 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872da0e2-bbd5-41aa-becb-b358088fdab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:32.518813 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872da0e2-bbd5-41aa-becb-b358088fdab1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:32.519606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872da0e2-bbd5-41aa-becb-b358088fdab1 None admin] RBAC: Adding query filter params (role.id=93abdb875d35417d91e420a60ccafbd2, scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f, user.id=d64fc190fac540259444a531cdbb8d53) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:32.519923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872da0e2-bbd5-41aa-becb-b358088fdab1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:32.521509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872da0e2-bbd5-41aa-becb-b358088fdab1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:32.529088 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 611/1219] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:23:32 2022] GET /identity/v3/role_assignments?user.id=d64fc190fac540259444a531cdbb8d53&scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f&role.id=93abdb875d35417d91e420a60ccafbd2 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:34.581449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca51f0-ed1a-47f9-b708-567c9efa4fa1 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:34.582101 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca51f0-ed1a-47f9-b708-567c9efa4fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:34.582101 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca51f0-ed1a-47f9-b708-567c9efa4fa1 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:34.583440 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 609/1220] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:23:34.590762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47403d-cb2f-4087-b5f9-eb7a1bdd57c6 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:34.591797 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47403d-cb2f-4087-b5f9-eb7a1bdd57c6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:34.591797 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47403d-cb2f-4087-b5f9-eb7a1bdd57c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:34.621070 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2e47403d-cb2f-4087-b5f9-eb7a1bdd57c6 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:23:34.623387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2e47403d-cb2f-4087-b5f9-eb7a1bdd57c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:23:34.748504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 612/1221] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:23:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:23:35.089463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca51f0-ed1a-47f9-b708-567c9efa4fa1 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:35.259682 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca51f0-ed1a-47f9-b708-567c9efa4fa1 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:35.343012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8606018-483b-414d-8376-84f1ef513e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:35.343717 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8606018-483b-414d-8376-84f1ef513e65 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:35.344097 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8606018-483b-414d-8376-84f1ef513e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:35.344550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8606018-483b-414d-8376-84f1ef513e65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:35.360883 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8606018-483b-414d-8376-84f1ef513e65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:23:35.366679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-c8606018-483b-414d-8376-84f1ef513e65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:23:35.366679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:35.366679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:35.366679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:35.366679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:35.366679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:35.366679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:35.366679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:35.366679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:35.366679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:35.366679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:35.366679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:35.366679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:23:35.366679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:23:35.366679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:23:35.366679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:23:35.368876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:23:35.368876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:23:35.368876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:23:35.368876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:23:35.368876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:35.368876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:35.368876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:35.368876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:35.368876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:35.368876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:35.368876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:35.368876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:35.368876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:35.368876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:35.368876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:35.368876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:35.371439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:35.371439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:35.371439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:35.371439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:35.371439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:23:35.371439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:23:35.371439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:23:35.371439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:23:35.371439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:23:35.371439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:23:35.371439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:23:35.371439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:23:35.371439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 610/1222] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 1 16:23:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:35.377807 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47403d-cb2f-4087-b5f9-eb7a1bdd57c6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:35.557184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47403d-cb2f-4087-b5f9-eb7a1bdd57c6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:35.597788 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:35.617381 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcbf7c-bbce-48a7-9644-46e3e8b8cfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:35.618331 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcbf7c-bbce-48a7-9644-46e3e8b8cfdb None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:35.618745 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcbf7c-bbce-48a7-9644-46e3e8b8cfdb None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:35.620045 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcbf7c-bbce-48a7-9644-46e3e8b8cfdb None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:35.621392 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fcbf7c-bbce-48a7-9644-46e3e8b8cfdb None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:35.622014 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fcbf7c-bbce-48a7-9644-46e3e8b8cfdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:35.624810 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fcbf7c-bbce-48a7-9644-46e3e8b8cfdb None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:35.640696 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 613/1223] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 1 16:23:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:35.641975 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8606018-483b-414d-8376-84f1ef513e65 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:35.705541 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:35.828245 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8606018-483b-414d-8376-84f1ef513e65 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:35.893456 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190ee27-6f7c-431f-b73f-f89e54682d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:35.894203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190ee27-6f7c-431f-b73f-f89e54682d20 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:35.894583 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190ee27-6f7c-431f-b73f-f89e54682d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:35.895033 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190ee27-6f7c-431f-b73f-f89e54682d20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:35.911225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190ee27-6f7c-431f-b73f-f89e54682d20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:35.913013 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190ee27-6f7c-431f-b73f-f89e54682d20 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:35.948203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-a190ee27-6f7c-431f-b73f-f89e54682d20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:35.948203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:35.948203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:35.948203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:35.948203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:35.948203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:35.948203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:35.948203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:35.948203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:35.948203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:35.948203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:35.948203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:35.948203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:23:35.948203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:23:35.948203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:23:35.948203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:23:35.950537 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:35.950537 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:35.950537 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:35.950537 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:35.950537 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:35.950537 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:35.950537 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:35.950537 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:35.950537 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:35.950537 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:35.950537 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:35.950537 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:35.950537 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:35.950537 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:35.950537 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:35.950537 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:35.950537 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:23:35.952392 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:23:35.952392 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:35.952392 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:23:35.952392 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 611/1224] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:23:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:35.958664 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcbf7c-bbce-48a7-9644-46e3e8b8cfdb None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:36.128587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcbf7c-bbce-48a7-9644-46e3e8b8cfdb None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:36.196847 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633995e6-9f54-44af-930f-045a59d6eb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:36.197608 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633995e6-9f54-44af-930f-045a59d6eb03 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:36.197968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633995e6-9f54-44af-930f-045a59d6eb03 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:36.198324 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633995e6-9f54-44af-930f-045a59d6eb03 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:36.199190 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633995e6-9f54-44af-930f-045a59d6eb03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:36.199555 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633995e6-9f54-44af-930f-045a59d6eb03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:36.201153 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633995e6-9f54-44af-930f-045a59d6eb03 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:36.220724 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 614/1225] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:23:36.229393 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190ee27-6f7c-431f-b73f-f89e54682d20 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:36.403255 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:36.411944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190ee27-6f7c-431f-b73f-f89e54682d20 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:36.466499 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc792c54-e348-427d-8279-ff7acae9155b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:36.467089 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc792c54-e348-427d-8279-ff7acae9155b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:36.467355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc792c54-e348-427d-8279-ff7acae9155b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:36.467626 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc792c54-e348-427d-8279-ff7acae9155b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:36.476550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc792c54-e348-427d-8279-ff7acae9155b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:36.478169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc792c54-e348-427d-8279-ff7acae9155b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:36.501003 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-dc792c54-e348-427d-8279-ff7acae9155b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:23:36.501003 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:36.501003 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:36.501003 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:36.501003 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:36.501003 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:36.501003 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:36.501003 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:36.501003 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:36.501003 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:36.501003 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:36.501003 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:36.501003 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:23:36.501003 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:23:36.501003 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:23:36.501003 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:23:36.502812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:36.502812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:36.502812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:23:36.502812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:23:36.502812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:23:36.502812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:23:36.502812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:36.502812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:36.502812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:36.502812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:36.502812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:36.502812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:36.502812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:36.502812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:36.502812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:36.502812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:36.502812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:36.502812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:36.504701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:36.504701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:36.504701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:23:36.504701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:23:36.504701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:23:36.504701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:23:36.504701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:23:36.504701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:23:36.504701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:23:36.504701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:23:36.504701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 612/1226] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:23:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:36.512016 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633995e6-9f54-44af-930f-045a59d6eb03 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:36.599115 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:36.679738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633995e6-9f54-44af-930f-045a59d6eb03 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:36.725742 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a371cd-5bea-40c8-b98c-52393071d90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:36.726415 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a371cd-5bea-40c8-b98c-52393071d90a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:36.726812 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a371cd-5bea-40c8-b98c-52393071d90a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:36.727313 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a371cd-5bea-40c8-b98c-52393071d90a None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:36.728598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a371cd-5bea-40c8-b98c-52393071d90a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:36.729120 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a371cd-5bea-40c8-b98c-52393071d90a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:36.731004 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a371cd-5bea-40c8-b98c-52393071d90a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:36.757842 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 615/1227] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Sep 1 16:23:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:36.765544 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc792c54-e348-427d-8279-ff7acae9155b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:36.927856 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc792c54-e348-427d-8279-ff7acae9155b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:36.989532 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01923f81-9d49-49e1-a5ee-bf7beda316ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:36.990234 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01923f81-9d49-49e1-a5ee-bf7beda316ec None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:36.990676 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01923f81-9d49-49e1-a5ee-bf7beda316ec None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:36.991079 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01923f81-9d49-49e1-a5ee-bf7beda316ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:37.011164 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01923f81-9d49-49e1-a5ee-bf7beda316ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:37.013425 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01923f81-9d49-49e1-a5ee-bf7beda316ec None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:37.038692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-01923f81-9d49-49e1-a5ee-bf7beda316ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:37.038692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:37.038692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:37.038692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:37.038692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:37.038692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:37.038692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:37.038692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:37.038692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:37.038692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:37.038692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:37.038692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:37.038692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:23:37.038692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:23:37.038692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:23:37.038692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:23:37.041475 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:37.041475 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:37.041475 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:37.041475 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:37.041475 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:37.041475 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:37.041475 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:37.041475 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:37.041475 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:37.041475 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:37.041475 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:37.041475 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:37.041475 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:37.041475 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:37.041475 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:37.041475 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:37.041475 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:23:37.043873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:23:37.043873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:37.043873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:23:37.043873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 613/1228] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:37.052404 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a371cd-5bea-40c8-b98c-52393071d90a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:37.221401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a371cd-5bea-40c8-b98c-52393071d90a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:37.225076 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:37.270524 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5dd92-7303-4404-9629-51beb98a5f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:37.271502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5dd92-7303-4404-9629-51beb98a5f47 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:37.271999 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5dd92-7303-4404-9629-51beb98a5f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:37.272529 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5dd92-7303-4404-9629-51beb98a5f47 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:37.273765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5dd92-7303-4404-9629-51beb98a5f47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:37.274331 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5dd92-7303-4404-9629-51beb98a5f47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:37.277848 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5dd92-7303-4404-9629-51beb98a5f47 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:37.304169 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 616/1229] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:23:37.315959 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01923f81-9d49-49e1-a5ee-bf7beda316ec None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:37.337323 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:37.493497 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01923f81-9d49-49e1-a5ee-bf7beda316ec None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:37.548409 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0516a-7024-4e2b-9965-03e179b2be26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:37.549013 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0516a-7024-4e2b-9965-03e179b2be26 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:37.549386 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0516a-7024-4e2b-9965-03e179b2be26 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:37.549743 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0516a-7024-4e2b-9965-03e179b2be26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:37.559128 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0516a-7024-4e2b-9965-03e179b2be26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:37.560824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0516a-7024-4e2b-9965-03e179b2be26 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:37.575364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-fbd0516a-7024-4e2b-9965-03e179b2be26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:23:37.575364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:37.575364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:37.575364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:37.575364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:37.575364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:37.575364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:37.575364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:37.575364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:37.575364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:37.575364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:37.575364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:37.575364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:23:37.575364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:23:37.575364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:23:37.576776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:23:37.576776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:37.576776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:37.576776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:37.576776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:37.576776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:37.576776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:37.576776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:37.576776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:37.576776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:37.576776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:37.576776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:37.576776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:37.576776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:37.576776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:37.576776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:37.576776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:37.577892 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:23:37.577892 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:23:37.577892 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:23:37.577892 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:23:37.577892 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:23:37.577892 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:23:37.577892 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:23:37.577892 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:23:37.577892 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 614/1230] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:23:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:23:37.583886 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5dd92-7303-4404-9629-51beb98a5f47 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:37.735325 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5dd92-7303-4404-9629-51beb98a5f47 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:37.787367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3716c-8cc6-4547-824a-79448087ab06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:37.788449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3716c-8cc6-4547-824a-79448087ab06 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:37.789018 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3716c-8cc6-4547-824a-79448087ab06 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:37.789386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3716c-8cc6-4547-824a-79448087ab06 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:37.790277 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3716c-8cc6-4547-824a-79448087ab06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:37.790591 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3716c-8cc6-4547-824a-79448087ab06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:37.792703 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3716c-8cc6-4547-824a-79448087ab06 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:37.824189 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 617/1231] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:23:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:23:37.825512 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0516a-7024-4e2b-9965-03e179b2be26 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:37.934307 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:38.012597 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0516a-7024-4e2b-9965-03e179b2be26 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:38.074066 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff4ae8-738d-468f-93a5-eb4622536e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:38.075454 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff4ae8-738d-468f-93a5-eb4622536e11 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:38.075707 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff4ae8-738d-468f-93a5-eb4622536e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:38.075936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff4ae8-738d-468f-93a5-eb4622536e11 None admin] PATH_INFO: `/v3/projects/43f5c22e38824a8b8dff2f9b4bc1df3f/users/d64fc190fac540259444a531cdbb8d53/roles/93abdb875d35417d91e420a60ccafbd2` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:38.105727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff4ae8-738d-468f-93a5-eb4622536e11 None admin] RBAC: Authorizing `identity:create_grant(project_id=43f5c22e38824a8b8dff2f9b4bc1df3f, user_id=d64fc190fac540259444a531cdbb8d53, role_id=93abdb875d35417d91e420a60ccafbd2)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:38.108743 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff4ae8-738d-468f-93a5-eb4622536e11 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:38.133296 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 615/1232] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 1 16:23:37 2022] PUT /identity/v3/projects/43f5c22e38824a8b8dff2f9b4bc1df3f/users/d64fc190fac540259444a531cdbb8d53/roles/93abdb875d35417d91e420a60ccafbd2 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:23:40.539096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7c267-6228-4b3d-a637-2a77e27fb31b None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:40.539859 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7c267-6228-4b3d-a637-2a77e27fb31b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:40.539859 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7c267-6228-4b3d-a637-2a77e27fb31b None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:40.541615 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 618/1233] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:23:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:23:40.547933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b57b0c-de7e-44c0-a5d7-7c945d50caa3 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:40.548795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b57b0c-de7e-44c0-a5d7-7c945d50caa3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:40.548956 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b57b0c-de7e-44c0-a5d7-7c945d50caa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:40.575364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-33b57b0c-de7e-44c0-a5d7-7c945d50caa3 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:23:40.575364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-33b57b0c-de7e-44c0-a5d7-7c945d50caa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:23:40.656293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 616/1234] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:23:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:23:40.933667 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7c267-6228-4b3d-a637-2a77e27fb31b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:40.969450 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:41.086701 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7c267-6228-4b3d-a637-2a77e27fb31b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:41.135239 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd60e21-da40-4d97-870a-ab1b52f30328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:41.136518 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd60e21-da40-4d97-870a-ab1b52f30328 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:41.138779 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd60e21-da40-4d97-870a-ab1b52f30328 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:41.139964 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd60e21-da40-4d97-870a-ab1b52f30328 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:41.166299 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd60e21-da40-4d97-870a-ab1b52f30328 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:23:41.171796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-4fd60e21-da40-4d97-870a-ab1b52f30328 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:23:41.171796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:41.171796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:41.171796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:41.171796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:41.171796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:41.171796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:41.171796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:41.171796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:41.171796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:41.171796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:41.171796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:41.171796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:23:41.171796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:23:41.171796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:23:41.171796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:23:41.173071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:23:41.173071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:23:41.173071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:23:41.173071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:23:41.173071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:41.173071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:41.173071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:41.173071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:41.173071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:41.173071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:41.173071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:41.173071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:41.173071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:41.173071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:41.173071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:41.173071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:41.174204 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:41.174204 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:41.174204 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:41.174204 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:41.174204 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:23:41.174204 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:23:41.174204 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:23:41.174204 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:23:41.174204 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:23:41.174204 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:23:41.174204 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:23:41.174204 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:23:41.174204 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 619/1235] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 1 16:23:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:41.182231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b57b0c-de7e-44c0-a5d7-7c945d50caa3 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:41.251573 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:41.343492 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b57b0c-de7e-44c0-a5d7-7c945d50caa3 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:41.416882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82835333-a746-48e7-ad3b-135e44c643a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:41.417851 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82835333-a746-48e7-ad3b-135e44c643a8 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:41.418309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82835333-a746-48e7-ad3b-135e44c643a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:41.418785 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82835333-a746-48e7-ad3b-135e44c643a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:41.419965 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82835333-a746-48e7-ad3b-135e44c643a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:41.420504 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82835333-a746-48e7-ad3b-135e44c643a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:41.423118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82835333-a746-48e7-ad3b-135e44c643a8 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:41.439429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 617/1236] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 1 16:23:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:41.447957 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd60e21-da40-4d97-870a-ab1b52f30328 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:41.606661 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:41.629309 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd60e21-da40-4d97-870a-ab1b52f30328 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:41.690683 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb4d44-cb54-4fc7-ad18-98ac23ca978b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:41.691648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb4d44-cb54-4fc7-ad18-98ac23ca978b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:41.692166 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb4d44-cb54-4fc7-ad18-98ac23ca978b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:41.692599 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb4d44-cb54-4fc7-ad18-98ac23ca978b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:41.709236 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb4d44-cb54-4fc7-ad18-98ac23ca978b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:41.711490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb4d44-cb54-4fc7-ad18-98ac23ca978b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:41.733198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-a2eb4d44-cb54-4fc7-ad18-98ac23ca978b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:41.733198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:41.733198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:41.733198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:41.733198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:41.733198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:41.733198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:41.733198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:41.733198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:41.733198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:41.733198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:41.733198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:41.733198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:23:41.733198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:23:41.733198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:23:41.733198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:23:41.735639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:41.735639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:41.735639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:41.735639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:41.735639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:41.735639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:41.735639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:41.735639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:41.735639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:41.735639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:41.735639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:41.735639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:41.735639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:41.735639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:41.735639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:41.735639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:41.735639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:23:41.738131 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:23:41.738131 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:41.738131 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:23:41.738131 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 620/1237] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:23:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:23:41.745260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82835333-a746-48e7-ad3b-135e44c643a8 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:41.933175 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82835333-a746-48e7-ad3b-135e44c643a8 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:41.955285 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:41.998636 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9cd18-6cf3-4c15-9aa4-ae4671d882aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:41.999257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9cd18-6cf3-4c15-9aa4-ae4671d882aa None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:41.999535 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9cd18-6cf3-4c15-9aa4-ae4671d882aa None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:41.999805 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9cd18-6cf3-4c15-9aa4-ae4671d882aa None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:42.000455 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9cd18-6cf3-4c15-9aa4-ae4671d882aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:42.000818 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9cd18-6cf3-4c15-9aa4-ae4671d882aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:42.002305 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9cd18-6cf3-4c15-9aa4-ae4671d882aa None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:42.019419 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 618/1238] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:42.031840 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb4d44-cb54-4fc7-ad18-98ac23ca978b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:42.211399 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb4d44-cb54-4fc7-ad18-98ac23ca978b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:42.287657 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f47bca-4f78-442c-8de8-0890bc377906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:42.288916 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f47bca-4f78-442c-8de8-0890bc377906 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:42.289477 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f47bca-4f78-442c-8de8-0890bc377906 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:42.289987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f47bca-4f78-442c-8de8-0890bc377906 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:42.296920 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:42.308266 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f47bca-4f78-442c-8de8-0890bc377906 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:42.311235 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f47bca-4f78-442c-8de8-0890bc377906 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:42.339491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-79f47bca-4f78-442c-8de8-0890bc377906 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:23:42.339491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:42.339491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:42.339491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:42.339491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:42.339491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:42.339491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:42.339491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:42.339491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:42.339491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:42.339491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:42.339491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:42.339491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:23:42.339491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:23:42.339491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:23:42.339491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:23:42.342522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:42.342522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:42.342522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:23:42.342522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:23:42.342522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:23:42.342522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:23:42.342522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:42.342522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:42.342522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:42.342522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:42.342522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:42.342522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:42.342522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:42.342522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:42.342522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:42.342522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:42.342522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:42.342522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:42.344427 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:42.344427 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:42.344427 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:23:42.344427 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:23:42.344427 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:23:42.344427 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:23:42.344427 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:23:42.344427 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:23:42.344427 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:23:42.344427 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:23:42.344427 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 621/1239] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:23:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:42.350192 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9cd18-6cf3-4c15-9aa4-ae4671d882aa None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:42.528938 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9cd18-6cf3-4c15-9aa4-ae4671d882aa None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:42.588924 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5031801-a56d-49b5-82fd-f3e7e9d14057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:42.589529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5031801-a56d-49b5-82fd-f3e7e9d14057 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:42.589873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5031801-a56d-49b5-82fd-f3e7e9d14057 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:42.590148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5031801-a56d-49b5-82fd-f3e7e9d14057 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:42.591752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5031801-a56d-49b5-82fd-f3e7e9d14057 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:42.592387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5031801-a56d-49b5-82fd-f3e7e9d14057 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:42.595997 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5031801-a56d-49b5-82fd-f3e7e9d14057 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:42.626819 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 619/1240] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Sep 1 16:23:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:42.633164 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f47bca-4f78-442c-8de8-0890bc377906 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:42.795325 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f47bca-4f78-442c-8de8-0890bc377906 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:42.850105 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec37cc-606c-42a1-b18f-4b17314df0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:42.850739 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec37cc-606c-42a1-b18f-4b17314df0b4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:42.851025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec37cc-606c-42a1-b18f-4b17314df0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:42.851398 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec37cc-606c-42a1-b18f-4b17314df0b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:42.952383 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:42.963834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec37cc-606c-42a1-b18f-4b17314df0b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:42.965773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec37cc-606c-42a1-b18f-4b17314df0b4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:43.136207 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 622/1241] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:23:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:23:43.144453 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5031801-a56d-49b5-82fd-f3e7e9d14057 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:43.179696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:43.287355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5031801-a56d-49b5-82fd-f3e7e9d14057 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:43.332842 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e34817-0061-4515-af8f-261b8529cd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:43.333747 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e34817-0061-4515-af8f-261b8529cd36 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:43.334215 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e34817-0061-4515-af8f-261b8529cd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:43.334658 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e34817-0061-4515-af8f-261b8529cd36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:43.358756 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e34817-0061-4515-af8f-261b8529cd36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:43.361434 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e34817-0061-4515-af8f-261b8529cd36 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:43.387481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-e8e34817-0061-4515-af8f-261b8529cd36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:43.387481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:43.387481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:43.387481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:43.387481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:43.387481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:43.387481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:43.387481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:43.387481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:43.387481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:43.387481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:43.387481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:43.387481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:23:43.387481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:23:43.387481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:23:43.387481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:23:43.390061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:43.390061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:43.390061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:43.390061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:43.390061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:43.390061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:43.390061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:43.390061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:43.390061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:43.390061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:43.390061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:43.390061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:43.390061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:43.390061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:43.390061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:43.390061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:43.390061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:23:43.391502 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:23:43.391502 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:43.391502 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:23:43.391502 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 620/1242] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:23:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:43.397934 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec37cc-606c-42a1-b18f-4b17314df0b4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:43.530107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:43.540752 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec37cc-606c-42a1-b18f-4b17314df0b4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:43.582702 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c939bd-de58-402d-a080-e208dd2981ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:43.583503 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c939bd-de58-402d-a080-e208dd2981ed None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:43.583837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c939bd-de58-402d-a080-e208dd2981ed None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:43.584205 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c939bd-de58-402d-a080-e208dd2981ed None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:43.585120 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c939bd-de58-402d-a080-e208dd2981ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:43.585556 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c939bd-de58-402d-a080-e208dd2981ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:43.587295 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c939bd-de58-402d-a080-e208dd2981ed None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:43.609276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 623/1243] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:23:43.615940 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e34817-0061-4515-af8f-261b8529cd36 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:43.760414 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:43.787774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e34817-0061-4515-af8f-261b8529cd36 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:43.834653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f890a4-91d5-4826-82d8-425abfb831ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:43.835228 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f890a4-91d5-4826-82d8-425abfb831ee None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:43.835587 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f890a4-91d5-4826-82d8-425abfb831ee None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:43.835783 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f890a4-91d5-4826-82d8-425abfb831ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:43.843718 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f890a4-91d5-4826-82d8-425abfb831ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:43.845268 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f890a4-91d5-4826-82d8-425abfb831ee None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:43.870237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-32f890a4-91d5-4826-82d8-425abfb831ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:23:43.870237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:43.870237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:43.870237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:43.870237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:43.870237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:43.870237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:43.870237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:43.870237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:43.870237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:43.870237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:43.870237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:43.870237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:23:43.870237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:23:43.870237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:23:43.871964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:23:43.871964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:43.871964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:43.871964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:43.871964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:43.871964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:43.871964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:43.871964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:43.871964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:43.871964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:43.871964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:43.871964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:43.871964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:43.871964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:43.871964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:43.871964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:43.871964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:43.873441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:23:43.873441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:23:43.873441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:23:43.873441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:23:43.873441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:23:43.873441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:23:43.873441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:23:43.873441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:23:43.873441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 621/1244] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:23:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:43.882121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c939bd-de58-402d-a080-e208dd2981ed None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:44.050799 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c939bd-de58-402d-a080-e208dd2981ed None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:44.120315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a6836-0d1f-4663-bd6f-3542edc82245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:44.121657 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a6836-0d1f-4663-bd6f-3542edc82245 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:44.122219 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a6836-0d1f-4663-bd6f-3542edc82245 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:44.122701 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a6836-0d1f-4663-bd6f-3542edc82245 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:44.124180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a6836-0d1f-4663-bd6f-3542edc82245 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:44.124844 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a6836-0d1f-4663-bd6f-3542edc82245 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:44.127868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a6836-0d1f-4663-bd6f-3542edc82245 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:44.156305 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 624/1245] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:23:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:23:44.167522 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f890a4-91d5-4826-82d8-425abfb831ee None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:44.323019 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f890a4-91d5-4826-82d8-425abfb831ee None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:44.382345 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37944fa-a76f-4fee-9e65-1011bcd34123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:44.383659 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37944fa-a76f-4fee-9e65-1011bcd34123 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:44.384123 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37944fa-a76f-4fee-9e65-1011bcd34123 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:44.384709 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37944fa-a76f-4fee-9e65-1011bcd34123 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:44.386130 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37944fa-a76f-4fee-9e65-1011bcd34123 None admin] RBAC: Adding query filter params (role.id=93abdb875d35417d91e420a60ccafbd2, scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f, user.id=d64fc190fac540259444a531cdbb8d53) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:44.386665 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37944fa-a76f-4fee-9e65-1011bcd34123 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:44.389604 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37944fa-a76f-4fee-9e65-1011bcd34123 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:44.416667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 622/1246] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:23:44 2022] GET /identity/v3/role_assignments?user.id=d64fc190fac540259444a531cdbb8d53&scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f&role.id=93abdb875d35417d91e420a60ccafbd2 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:47.012720 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48965b80-3d65-4ceb-8e43-a47ced55b195 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:47.013592 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48965b80-3d65-4ceb-8e43-a47ced55b195 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:47.013592 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48965b80-3d65-4ceb-8e43-a47ced55b195 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:47.014672 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 625/1247] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:23:47.022098 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82649e15-b134-41c0-a92c-b79e55cda8f7 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:47.023115 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82649e15-b134-41c0-a92c-b79e55cda8f7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:47.023319 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82649e15-b134-41c0-a92c-b79e55cda8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:47.032734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:47.052999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-82649e15-b134-41c0-a92c-b79e55cda8f7 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:23:47.055006 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-82649e15-b134-41c0-a92c-b79e55cda8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:23:47.172245 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 623/1248] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:23:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:23:47.505593 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48965b80-3d65-4ceb-8e43-a47ced55b195 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:47.531066 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:47.687738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48965b80-3d65-4ceb-8e43-a47ced55b195 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:47.740606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6f245-bedb-4a98-8889-4f2064f41d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:47.741295 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6f245-bedb-4a98-8889-4f2064f41d98 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:47.741565 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6f245-bedb-4a98-8889-4f2064f41d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:47.741838 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6f245-bedb-4a98-8889-4f2064f41d98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:47.756726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6f245-bedb-4a98-8889-4f2064f41d98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:23:47.766931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-3cb6f245-bedb-4a98-8889-4f2064f41d98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:23:47.766931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:47.766931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:47.766931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:47.766931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:47.766931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:47.766931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:47.766931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:47.766931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:47.766931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:47.766931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:47.766931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:47.766931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:23:47.766931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:23:47.766931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:23:47.766931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:23:47.768676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:23:47.768676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:23:47.768676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:23:47.768676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:23:47.768676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:47.768676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:47.768676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:47.768676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:47.768676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:47.768676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:47.768676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:47.768676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:47.768676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:47.768676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:47.768676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:47.768676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:47.770023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:47.770023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:47.770023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:47.770023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:47.770023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:23:47.770023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:23:47.770023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:23:47.770023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:23:47.770023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:23:47.770023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:23:47.770023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:23:47.770023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:23:47.770023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 626/1249] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:23:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:23:47.778804 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82649e15-b134-41c0-a92c-b79e55cda8f7 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:47.969200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82649e15-b134-41c0-a92c-b79e55cda8f7 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:48.017748 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:48.027078 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b6f63-2675-4c32-a373-3b4933759e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:48.028079 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b6f63-2675-4c32-a373-3b4933759e38 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:48.028549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b6f63-2675-4c32-a373-3b4933759e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:48.029044 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b6f63-2675-4c32-a373-3b4933759e38 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:48.030270 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b6f63-2675-4c32-a373-3b4933759e38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:48.030782 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b6f63-2675-4c32-a373-3b4933759e38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:48.033349 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b6f63-2675-4c32-a373-3b4933759e38 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:48.056733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 624/1250] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:23:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:48.061915 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6f245-bedb-4a98-8889-4f2064f41d98 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:48.204602 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:48.245653 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6f245-bedb-4a98-8889-4f2064f41d98 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:48.323153 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6dd1d-9b9b-4c51-becb-dbed711b14eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:48.324158 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6dd1d-9b9b-4c51-becb-dbed711b14eb None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:48.324669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6dd1d-9b9b-4c51-becb-dbed711b14eb None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:48.325158 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6dd1d-9b9b-4c51-becb-dbed711b14eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:48.346471 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6dd1d-9b9b-4c51-becb-dbed711b14eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:48.349249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6dd1d-9b9b-4c51-becb-dbed711b14eb None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:48.375186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-c6f6dd1d-9b9b-4c51-becb-dbed711b14eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:48.375186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:48.375186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:48.375186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:48.375186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:48.375186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:48.375186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:48.375186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:48.375186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:48.375186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:48.375186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:48.375186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:48.375186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:23:48.375186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:23:48.375186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:23:48.375186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:23:48.377025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:48.377025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:48.377025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:48.377025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:48.377025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:48.377025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:48.377025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:48.377025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:48.377025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:48.377025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:48.377025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:48.377025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:48.377025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:48.377025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:48.377025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:48.377025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:48.377025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:23:48.378766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:23:48.378766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:48.378766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:23:48.380806 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 627/1251] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:48.391781 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b6f63-2675-4c32-a373-3b4933759e38 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:48.559893 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b6f63-2675-4c32-a373-3b4933759e38 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:48.623827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde534b8-3517-49f8-a9c1-55b20e32e7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:48.624914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde534b8-3517-49f8-a9c1-55b20e32e7d5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:48.625717 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde534b8-3517-49f8-a9c1-55b20e32e7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:48.626215 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde534b8-3517-49f8-a9c1-55b20e32e7d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:48.627465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde534b8-3517-49f8-a9c1-55b20e32e7d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:48.627965 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde534b8-3517-49f8-a9c1-55b20e32e7d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:48.630245 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde534b8-3517-49f8-a9c1-55b20e32e7d5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:48.654509 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 625/1252] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:23:48.658252 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6dd1d-9b9b-4c51-becb-dbed711b14eb None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:48.833528 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6dd1d-9b9b-4c51-becb-dbed711b14eb None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:48.875840 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:48.889028 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7854b-6a3f-4aa5-a026-99210c96f966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:48.890084 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7854b-6a3f-4aa5-a026-99210c96f966 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:48.890636 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7854b-6a3f-4aa5-a026-99210c96f966 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:48.890996 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7854b-6a3f-4aa5-a026-99210c96f966 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:48.903361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7854b-6a3f-4aa5-a026-99210c96f966 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:48.905388 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7854b-6a3f-4aa5-a026-99210c96f966 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:48.922246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-20f7854b-6a3f-4aa5-a026-99210c96f966 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:23:48.922246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:48.922246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:48.922246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:48.922246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:48.922246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:48.922246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:48.922246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:48.922246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:48.922246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:48.922246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:48.922246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:48.922246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:23:48.922246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:23:48.922246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:23:48.922246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:23:48.924053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:48.924053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:48.924053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:23:48.924053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:23:48.924053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:23:48.924053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:23:48.924053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:48.924053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:48.924053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:48.924053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:48.924053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:48.924053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:48.924053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:48.924053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:48.924053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:48.924053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:48.924053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:48.924053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:48.926506 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:48.926506 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:48.926506 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:23:48.926506 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:23:48.926506 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:23:48.926506 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:23:48.926506 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:23:48.926506 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:23:48.926506 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:23:48.926506 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:23:48.929883 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 628/1253] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:23:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:48.938265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde534b8-3517-49f8-a9c1-55b20e32e7d5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:49.025755 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:49.092088 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde534b8-3517-49f8-a9c1-55b20e32e7d5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:49.149488 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27362bca-7b4e-4fba-a081-3b6b67b668c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:49.150186 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27362bca-7b4e-4fba-a081-3b6b67b668c9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:49.150546 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27362bca-7b4e-4fba-a081-3b6b67b668c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:49.151027 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27362bca-7b4e-4fba-a081-3b6b67b668c9 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:49.152204 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27362bca-7b4e-4fba-a081-3b6b67b668c9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:49.152664 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27362bca-7b4e-4fba-a081-3b6b67b668c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:49.154641 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27362bca-7b4e-4fba-a081-3b6b67b668c9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:49.187613 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 626/1254] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Sep 1 16:23:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:23:49.196223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7854b-6a3f-4aa5-a026-99210c96f966 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:49.374255 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7854b-6a3f-4aa5-a026-99210c96f966 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:49.440234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3c2dd-20d1-455d-bd0f-1327cded1e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:49.441292 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3c2dd-20d1-455d-bd0f-1327cded1e4d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:49.441774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3c2dd-20d1-455d-bd0f-1327cded1e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:49.442239 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3c2dd-20d1-455d-bd0f-1327cded1e4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:49.553484 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:49.569830 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3c2dd-20d1-455d-bd0f-1327cded1e4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:49.572806 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3c2dd-20d1-455d-bd0f-1327cded1e4d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:49.738129 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 629/1255] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:23:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:23:49.745398 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27362bca-7b4e-4fba-a081-3b6b67b668c9 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:49.935915 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27362bca-7b4e-4fba-a081-3b6b67b668c9 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:49.960476 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:49.996183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8939f98-7b0c-49aa-a8a7-cc48de12155c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:49.996998 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8939f98-7b0c-49aa-a8a7-cc48de12155c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:49.997588 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8939f98-7b0c-49aa-a8a7-cc48de12155c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:49.997897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8939f98-7b0c-49aa-a8a7-cc48de12155c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:50.017590 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8939f98-7b0c-49aa-a8a7-cc48de12155c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:50.020309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8939f98-7b0c-49aa-a8a7-cc48de12155c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:50.049521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-d8939f98-7b0c-49aa-a8a7-cc48de12155c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:50.049521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:50.049521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:50.049521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:50.049521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:50.049521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:50.049521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:50.049521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:50.049521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:50.049521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:50.049521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:50.049521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:50.049521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:23:50.049521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:23:50.049521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:23:50.049521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:23:50.051209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:50.051209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:50.051209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:50.051209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:50.051209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:50.051209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:50.051209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:50.051209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:50.051209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:50.051209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:50.051209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:50.051209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:50.051209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:50.051209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:50.051209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:50.051209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:50.051209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:23:50.052937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:23:50.052937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:50.052937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:23:50.052937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 627/1256] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:23:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:50.061746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3c2dd-20d1-455d-bd0f-1327cded1e4d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:50.233854 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:50.261892 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3c2dd-20d1-455d-bd0f-1327cded1e4d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:50.331794 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318bacf-aca0-4424-9508-63d7d7461c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:50.332840 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318bacf-aca0-4424-9508-63d7d7461c80 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:50.333165 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318bacf-aca0-4424-9508-63d7d7461c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:50.333496 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318bacf-aca0-4424-9508-63d7d7461c80 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:50.334178 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318bacf-aca0-4424-9508-63d7d7461c80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:50.334479 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318bacf-aca0-4424-9508-63d7d7461c80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:50.336331 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318bacf-aca0-4424-9508-63d7d7461c80 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:50.364839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 630/1257] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:23:50.373509 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8939f98-7b0c-49aa-a8a7-cc48de12155c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:50.546232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8939f98-7b0c-49aa-a8a7-cc48de12155c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:50.609669 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bd597-53a7-40fb-82b4-88fbb57b44e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:50.612205 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bd597-53a7-40fb-82b4-88fbb57b44e9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:50.612205 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bd597-53a7-40fb-82b4-88fbb57b44e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:50.612205 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bd597-53a7-40fb-82b4-88fbb57b44e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:50.628810 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395bd597-53a7-40fb-82b4-88fbb57b44e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:50.632380 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395bd597-53a7-40fb-82b4-88fbb57b44e9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:50.658277 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-395bd597-53a7-40fb-82b4-88fbb57b44e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:23:50.658277 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:50.658277 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:50.658277 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:50.658277 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:50.658277 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:50.658277 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:50.658277 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:50.658277 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:50.658277 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:50.658277 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:50.658277 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:50.658277 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:23:50.658277 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:23:50.658277 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:23:50.659463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:23:50.659463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:50.659463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:50.659463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:50.659463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:50.659463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:50.659463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:50.659463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:50.659463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:50.659463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:50.659463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:50.659463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:50.659463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:50.659463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:50.659463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:50.659463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:50.659463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:50.665474 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:23:50.665474 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:23:50.665474 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:23:50.665474 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:23:50.665474 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:23:50.665474 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:23:50.665474 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:23:50.665474 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:23:50.665474 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 628/1258] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:23:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:50.667181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318bacf-aca0-4424-9508-63d7d7461c80 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:50.869649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318bacf-aca0-4424-9508-63d7d7461c80 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:50.946109 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba09ba1-1eef-4e6b-a4a8-63ea8bd7068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:50.947261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba09ba1-1eef-4e6b-a4a8-63ea8bd7068b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:50.948177 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba09ba1-1eef-4e6b-a4a8-63ea8bd7068b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:50.948653 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba09ba1-1eef-4e6b-a4a8-63ea8bd7068b None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:50.949890 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba09ba1-1eef-4e6b-a4a8-63ea8bd7068b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:50.950411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba09ba1-1eef-4e6b-a4a8-63ea8bd7068b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:50.952393 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba09ba1-1eef-4e6b-a4a8-63ea8bd7068b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:50.980788 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 631/1259] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:23:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:50.982608 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bd597-53a7-40fb-82b4-88fbb57b44e9 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:51.026320 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:51.177716 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bd597-53a7-40fb-82b4-88fbb57b44e9 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:51.231468 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af07718-ca1e-4712-87f4-37b30c41c3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:51.232198 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af07718-ca1e-4712-87f4-37b30c41c3bd None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:51.232511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af07718-ca1e-4712-87f4-37b30c41c3bd None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:51.232867 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af07718-ca1e-4712-87f4-37b30c41c3bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:51.233637 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af07718-ca1e-4712-87f4-37b30c41c3bd None admin] RBAC: Adding query filter params (role.id=a8896546a02c42489ef73c7ad7c43542, scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f, user.id=d64fc190fac540259444a531cdbb8d53) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:51.233974 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af07718-ca1e-4712-87f4-37b30c41c3bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:51.235939 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af07718-ca1e-4712-87f4-37b30c41c3bd None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:51.245102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 629/1260] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:23:50 2022] GET /identity/v3/role_assignments?user.id=d64fc190fac540259444a531cdbb8d53&scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f&role.id=a8896546a02c42489ef73c7ad7c43542 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:23:53.618956 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b47b16-0175-49ed-af1e-d9276cb59a8c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:53.619564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b47b16-0175-49ed-af1e-d9276cb59a8c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:53.619564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b47b16-0175-49ed-af1e-d9276cb59a8c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:53.621168 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 632/1261] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:23:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:23:53.627498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180212f7-37ac-41c1-8951-53cbb4ad8e06 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:53.628127 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180212f7-37ac-41c1-8951-53cbb4ad8e06 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:53.628127 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180212f7-37ac-41c1-8951-53cbb4ad8e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:53.651662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-180212f7-37ac-41c1-8951-53cbb4ad8e06 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:23:53.653260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-180212f7-37ac-41c1-8951-53cbb4ad8e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:23:53.743785 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 630/1262] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:23:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:23:54.283416 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b47b16-0175-49ed-af1e-d9276cb59a8c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:54.302650 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:54.465206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b47b16-0175-49ed-af1e-d9276cb59a8c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:54.506098 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376c569-6336-4d97-8d7d-c235c5c13de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:54.506744 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376c569-6336-4d97-8d7d-c235c5c13de9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:54.507025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376c569-6336-4d97-8d7d-c235c5c13de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:54.507299 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376c569-6336-4d97-8d7d-c235c5c13de9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:54.520114 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376c569-6336-4d97-8d7d-c235c5c13de9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:23:54.525820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-1376c569-6336-4d97-8d7d-c235c5c13de9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:23:54.525820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:54.525820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:54.525820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:54.525820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:54.525820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:54.525820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:54.525820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:54.525820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:54.525820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:54.525820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:54.525820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:54.525820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:23:54.525820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:23:54.525820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:23:54.525820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:23:54.527583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:23:54.527583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:23:54.527583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:23:54.527583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:23:54.527583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:54.527583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:54.527583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:54.527583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:54.527583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:54.527583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:54.527583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:54.527583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:54.527583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:54.527583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:54.527583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:54.527583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:54.529321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:54.529321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:54.529321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:54.529321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:54.529321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:23:54.529321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:23:54.529321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:23:54.529321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:23:54.529321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:23:54.529321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:23:54.529321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:23:54.529321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:23:54.529321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 633/1263] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:23:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:54.534289 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180212f7-37ac-41c1-8951-53cbb4ad8e06 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:54.557488 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:54.651443 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180212f7-37ac-41c1-8951-53cbb4ad8e06 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:54.696924 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546b5f5-6884-4100-a43a-30bbbcf1b316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:54.697540 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546b5f5-6884-4100-a43a-30bbbcf1b316 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:54.697822 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546b5f5-6884-4100-a43a-30bbbcf1b316 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:54.698094 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546b5f5-6884-4100-a43a-30bbbcf1b316 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:54.698776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546b5f5-6884-4100-a43a-30bbbcf1b316 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:54.699077 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546b5f5-6884-4100-a43a-30bbbcf1b316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:54.700498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546b5f5-6884-4100-a43a-30bbbcf1b316 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:54.710050 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 631/1264] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:23:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:23:54.719964 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376c569-6336-4d97-8d7d-c235c5c13de9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:54.801434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:54.852666 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376c569-6336-4d97-8d7d-c235c5c13de9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:54.897783 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bda8e-4a53-4fd4-ad14-e2bb17fd0307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:54.899260 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bda8e-4a53-4fd4-ad14-e2bb17fd0307 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:54.899640 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bda8e-4a53-4fd4-ad14-e2bb17fd0307 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:54.900021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bda8e-4a53-4fd4-ad14-e2bb17fd0307 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:54.912512 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919bda8e-4a53-4fd4-ad14-e2bb17fd0307 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:54.914807 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919bda8e-4a53-4fd4-ad14-e2bb17fd0307 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:54.935700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-919bda8e-4a53-4fd4-ad14-e2bb17fd0307 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:54.935700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:54.935700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:54.935700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:54.935700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:54.935700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:54.935700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:54.935700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:54.935700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:54.935700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:54.935700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:54.935700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:54.935700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:23:54.935700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:23:54.935700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:23:54.935700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:23:54.936986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:54.936986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:54.936986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:54.936986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:54.936986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:54.936986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:54.936986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:54.936986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:54.936986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:54.936986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:54.936986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:54.936986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:54.936986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:54.936986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:54.936986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:54.936986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:54.936986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:23:54.938714 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:23:54.938714 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:54.938714 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:23:54.938714 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 634/1265] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:23:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:23:54.944133 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546b5f5-6884-4100-a43a-30bbbcf1b316 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:55.055966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:55.079519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546b5f5-6884-4100-a43a-30bbbcf1b316 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:55.134071 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41891a17-1f3f-4e17-b8d6-f53f04538f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:55.135490 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41891a17-1f3f-4e17-b8d6-f53f04538f01 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:55.135955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41891a17-1f3f-4e17-b8d6-f53f04538f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:55.136428 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41891a17-1f3f-4e17-b8d6-f53f04538f01 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:55.137673 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41891a17-1f3f-4e17-b8d6-f53f04538f01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:55.138229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41891a17-1f3f-4e17-b8d6-f53f04538f01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:55.140891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41891a17-1f3f-4e17-b8d6-f53f04538f01 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:55.164877 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 632/1266] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:23:55.171089 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bda8e-4a53-4fd4-ad14-e2bb17fd0307 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:55.298650 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bda8e-4a53-4fd4-ad14-e2bb17fd0307 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:55.322227 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:55.343074 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2863e3f-32d3-427b-9cba-4553c647b67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:55.343721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2863e3f-32d3-427b-9cba-4553c647b67a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:55.343998 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2863e3f-32d3-427b-9cba-4553c647b67a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:55.344269 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2863e3f-32d3-427b-9cba-4553c647b67a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:55.353082 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2863e3f-32d3-427b-9cba-4553c647b67a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:55.354583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2863e3f-32d3-427b-9cba-4553c647b67a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:55.367984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-c2863e3f-32d3-427b-9cba-4553c647b67a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:23:55.367984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:55.367984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:55.367984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:55.367984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:55.367984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:55.367984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:55.367984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:55.367984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:55.367984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:55.367984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:55.367984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:55.367984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:23:55.367984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:23:55.367984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:23:55.367984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:23:55.369893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:55.369893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:55.369893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:23:55.369893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:23:55.369893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:23:55.369893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:23:55.369893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:55.369893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:55.369893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:55.369893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:55.369893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:55.369893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:55.369893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:55.369893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:55.369893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:55.369893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:55.369893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:55.369893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:55.372110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:55.372110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:55.372110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:23:55.372110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:23:55.372110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:23:55.372110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:23:55.372110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:23:55.372110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:23:55.372110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:23:55.372110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:23:55.372110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 635/1267] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:23:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:55.377860 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41891a17-1f3f-4e17-b8d6-f53f04538f01 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:55.509751 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41891a17-1f3f-4e17-b8d6-f53f04538f01 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:55.558951 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e0bd7-04c5-4f42-9f18-b35d11d4522c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:55.559567 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e0bd7-04c5-4f42-9f18-b35d11d4522c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:55.559845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e0bd7-04c5-4f42-9f18-b35d11d4522c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:55.560116 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e0bd7-04c5-4f42-9f18-b35d11d4522c None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:55.560893 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e0bd7-04c5-4f42-9f18-b35d11d4522c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:55.561193 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e0bd7-04c5-4f42-9f18-b35d11d4522c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:55.562634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e0bd7-04c5-4f42-9f18-b35d11d4522c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:55.573725 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:55.583888 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 633/1268] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Sep 1 16:23:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:55.593405 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2863e3f-32d3-427b-9cba-4553c647b67a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:55.715928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2863e3f-32d3-427b-9cba-4553c647b67a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:55.764065 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115631b4-bd2a-40fc-8429-207f707cafcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:55.764988 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115631b4-bd2a-40fc-8429-207f707cafcd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:55.765503 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115631b4-bd2a-40fc-8429-207f707cafcd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:55.766027 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115631b4-bd2a-40fc-8429-207f707cafcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:55.786340 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115631b4-bd2a-40fc-8429-207f707cafcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:55.789714 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115631b4-bd2a-40fc-8429-207f707cafcd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:55.818083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-115631b4-bd2a-40fc-8429-207f707cafcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:55.818083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:55.818083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:55.818083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:55.818083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:55.818083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:55.818083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:55.818083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:55.818083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:55.818083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:55.818083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:55.818083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:55.818083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:23:55.818083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:23:55.818083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:23:55.818083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:23:55.819866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:55.819866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:55.819866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:55.819866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:55.819866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:55.819866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:55.819866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:55.819866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:55.819866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:55.819866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:55.819866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:55.819866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:55.819866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:55.819866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:55.819866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:55.819866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:55.819866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:23:55.822359 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:23:55.822359 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:55.822359 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:23:55.822359 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 636/1269] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:55.826897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e0bd7-04c5-4f42-9f18-b35d11d4522c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:56.009628 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e0bd7-04c5-4f42-9f18-b35d11d4522c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:56.076649 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf8905-fb10-4a3a-9aa8-5e0e3983d00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:56.077706 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf8905-fb10-4a3a-9aa8-5e0e3983d00f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:56.078190 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf8905-fb10-4a3a-9aa8-5e0e3983d00f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:56.078628 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf8905-fb10-4a3a-9aa8-5e0e3983d00f None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:56.079828 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf8905-fb10-4a3a-9aa8-5e0e3983d00f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:56.080374 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf8905-fb10-4a3a-9aa8-5e0e3983d00f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:56.083064 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf8905-fb10-4a3a-9aa8-5e0e3983d00f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:56.106044 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 634/1270] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:23:56.112537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115631b4-bd2a-40fc-8429-207f707cafcd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:56.150115 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:56.239629 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115631b4-bd2a-40fc-8429-207f707cafcd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:56.281142 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9e882-99cc-4aea-b9b8-357d96386154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:56.281847 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9e882-99cc-4aea-b9b8-357d96386154 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:56.282171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9e882-99cc-4aea-b9b8-357d96386154 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:56.282487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9e882-99cc-4aea-b9b8-357d96386154 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:56.290452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9e882-99cc-4aea-b9b8-357d96386154 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:56.292014 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9e882-99cc-4aea-b9b8-357d96386154 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:56.306546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-31d9e882-99cc-4aea-b9b8-357d96386154 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:23:56.306546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:56.306546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:56.306546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:56.306546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:56.306546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:56.306546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:56.306546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:56.306546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:56.306546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:56.306546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:56.306546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:56.306546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:23:56.306546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:23:56.306546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:23:56.308267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:23:56.308267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:56.308267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:56.308267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:56.308267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:56.308267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:56.308267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:56.308267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:56.308267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:56.308267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:56.308267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:56.308267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:56.308267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:56.308267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:56.308267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:56.308267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:56.308267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:56.309995 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:23:56.309995 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:23:56.309995 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:23:56.309995 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:23:56.309995 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:23:56.309995 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:23:56.309995 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:23:56.309995 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:23:56.309995 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 637/1271] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:23:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:23:56.316821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf8905-fb10-4a3a-9aa8-5e0e3983d00f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:56.387690 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:56.458491 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf8905-fb10-4a3a-9aa8-5e0e3983d00f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:56.501571 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd457977-4b09-4a2c-a512-45b71e30636f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:56.502190 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd457977-4b09-4a2c-a512-45b71e30636f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:56.502464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd457977-4b09-4a2c-a512-45b71e30636f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:56.502727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd457977-4b09-4a2c-a512-45b71e30636f None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:56.503435 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd457977-4b09-4a2c-a512-45b71e30636f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:56.503796 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd457977-4b09-4a2c-a512-45b71e30636f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:56.505333 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd457977-4b09-4a2c-a512-45b71e30636f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:56.522537 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 635/1272] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:23:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:56.528976 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9e882-99cc-4aea-b9b8-357d96386154 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:56.644677 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:56.655393 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9e882-99cc-4aea-b9b8-357d96386154 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:56.693726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e1bce-2f2d-440d-b1e8-32b57665b2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:56.694449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e1bce-2f2d-440d-b1e8-32b57665b2c8 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:56.694775 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e1bce-2f2d-440d-b1e8-32b57665b2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:56.695618 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e1bce-2f2d-440d-b1e8-32b57665b2c8 None admin] PATH_INFO: `/v3/projects/43f5c22e38824a8b8dff2f9b4bc1df3f/users/d64fc190fac540259444a531cdbb8d53/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:56.697716 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e1bce-2f2d-440d-b1e8-32b57665b2c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=43f5c22e38824a8b8dff2f9b4bc1df3f, user_id=d64fc190fac540259444a531cdbb8d53, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:56.699266 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e1bce-2f2d-440d-b1e8-32b57665b2c8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:56.717723 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 638/1273] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 1 16:23:56 2022] PUT /identity/v3/projects/43f5c22e38824a8b8dff2f9b4bc1df3f/users/d64fc190fac540259444a531cdbb8d53/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:23:58.773908 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a000a-583c-4fad-8c5b-eaab4c647258 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:58.774449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a000a-583c-4fad-8c5b-eaab4c647258 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:58.774870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a000a-583c-4fad-8c5b-eaab4c647258 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:58.777374 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 636/1274] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:23:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:23:58.783241 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a0d62-94c4-42ba-a47a-28d28174fb56 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:58.783799 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a0d62-94c4-42ba-a47a-28d28174fb56 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:58.783915 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a0d62-94c4-42ba-a47a-28d28174fb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:58.803808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-208a0d62-94c4-42ba-a47a-28d28174fb56 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:23:58.805599 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-208a0d62-94c4-42ba-a47a-28d28174fb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:23:58.882177 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 639/1275] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:23:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:23:59.185240 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a000a-583c-4fad-8c5b-eaab4c647258 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:59.302026 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a000a-583c-4fad-8c5b-eaab4c647258 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:59.323058 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:59.342911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a23971-45e8-4217-acb2-9ad62ff6d3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:59.343564 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a23971-45e8-4217-acb2-9ad62ff6d3de None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:59.343844 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a23971-45e8-4217-acb2-9ad62ff6d3de None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:59.344114 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a23971-45e8-4217-acb2-9ad62ff6d3de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:59.356596 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a23971-45e8-4217-acb2-9ad62ff6d3de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:23:59.362004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-78a23971-45e8-4217-acb2-9ad62ff6d3de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:23:59.362004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:59.362004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:59.362004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:59.362004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:59.362004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:59.362004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:59.362004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:59.362004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:59.362004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:59.362004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:59.362004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:59.362004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:23:59.362004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:23:59.362004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:23:59.362004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:23:59.363413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:23:59.363413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:23:59.363413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:23:59.363413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:23:59.363413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:59.363413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:59.363413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:59.363413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:59.363413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:59.363413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:59.363413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:59.363413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:59.363413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:59.363413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:59.363413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:59.363413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:59.364911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:59.364911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:59.364911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:59.364911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:59.364911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:23:59.364911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:23:59.364911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:23:59.364911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:23:59.364911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:23:59.364911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:23:59.364911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:23:59.364911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:23:59.364911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 637/1276] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 1 16:23:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:59.369679 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a0d62-94c4-42ba-a47a-28d28174fb56 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:59.465468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:59.491295 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a0d62-94c4-42ba-a47a-28d28174fb56 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:59.533307 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb38ef2-4e20-4bd2-a775-9a6ca70f155c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:59.533928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb38ef2-4e20-4bd2-a775-9a6ca70f155c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:59.534201 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb38ef2-4e20-4bd2-a775-9a6ca70f155c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:59.534474 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb38ef2-4e20-4bd2-a775-9a6ca70f155c None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:59.535149 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb38ef2-4e20-4bd2-a775-9a6ca70f155c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:59.535463 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb38ef2-4e20-4bd2-a775-9a6ca70f155c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:59.536896 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb38ef2-4e20-4bd2-a775-9a6ca70f155c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:59.547440 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 640/1277] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 1 16:23:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:59.557121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a23971-45e8-4217-acb2-9ad62ff6d3de None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:59.692196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a23971-45e8-4217-acb2-9ad62ff6d3de None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:59.734286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ad2df-4355-462a-ab0c-a4363870ba7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:59.735241 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ad2df-4355-462a-ab0c-a4363870ba7d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:59.735556 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ad2df-4355-462a-ab0c-a4363870ba7d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:59.735863 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ad2df-4355-462a-ab0c-a4363870ba7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:59.748556 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ad2df-4355-462a-ab0c-a4363870ba7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:59.750176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ad2df-4355-462a-ab0c-a4363870ba7d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:59.767477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-3e0ad2df-4355-462a-ab0c-a4363870ba7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:59.767477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:23:59.767477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:23:59.767477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:23:59.767477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:23:59.767477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:23:59.767477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:23:59.767477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:23:59.767477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:23:59.767477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:23:59.767477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:23:59.767477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:23:59.767477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:23:59.767477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:23:59.767477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:23:59.767477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:23:59.769239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:23:59.769239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:23:59.769239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:23:59.769239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:23:59.769239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:23:59.769239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:23:59.769239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:23:59.769239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:23:59.769239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:23:59.769239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:23:59.769239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:23:59.769239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:23:59.769239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:23:59.769239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:23:59.769239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:23:59.769239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:23:59.769239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:23:59.770914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:23:59.770914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:23:59.770914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:23:59.770914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 638/1278] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:23:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:23:59.775456 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb38ef2-4e20-4bd2-a775-9a6ca70f155c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:23:59.895484 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb38ef2-4e20-4bd2-a775-9a6ca70f155c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:23:59.937243 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad967ccf-9429-44d5-aba0-4063f4f2d243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:23:59.938012 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad967ccf-9429-44d5-aba0-4063f4f2d243 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:23:59.938301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad967ccf-9429-44d5-aba0-4063f4f2d243 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:23:59.938744 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad967ccf-9429-44d5-aba0-4063f4f2d243 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:23:59.939669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad967ccf-9429-44d5-aba0-4063f4f2d243 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:23:59.940079 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad967ccf-9429-44d5-aba0-4063f4f2d243 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:23:59.941675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad967ccf-9429-44d5-aba0-4063f4f2d243 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:23:59.958267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 641/1279] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:23:59.967816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ad2df-4355-462a-ab0c-a4363870ba7d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:00.026330 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:00.122129 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ad2df-4355-462a-ab0c-a4363870ba7d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:00.161799 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95b8e5-c70a-4f11-9d23-9aead6e91525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:00.162440 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95b8e5-c70a-4f11-9d23-9aead6e91525 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:00.162712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95b8e5-c70a-4f11-9d23-9aead6e91525 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:00.162977 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95b8e5-c70a-4f11-9d23-9aead6e91525 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:00.172253 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95b8e5-c70a-4f11-9d23-9aead6e91525 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:00.173839 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95b8e5-c70a-4f11-9d23-9aead6e91525 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:00.187734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-fe95b8e5-c70a-4f11-9d23-9aead6e91525 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:24:00.187734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:24:00.187734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:24:00.187734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:24:00.187734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:24:00.187734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:24:00.187734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:24:00.187734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:24:00.187734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:24:00.187734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:24:00.187734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:24:00.187734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:24:00.187734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:24:00.187734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:24:00.187734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:24:00.187734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:24:00.189752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:24:00.189752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:24:00.189752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:24:00.189752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:24:00.189752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:24:00.189752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:24:00.189752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:24:00.189752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:24:00.189752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:24:00.189752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:24:00.189752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:24:00.189752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:24:00.189752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:24:00.189752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:24:00.189752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:24:00.189752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:24:00.189752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:24:00.189752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:24:00.190802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:24:00.190802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:24:00.190802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:24:00.190802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:24:00.190802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:24:00.190802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:24:00.190802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:24:00.190802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:24:00.190802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:24:00.190802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:24:00.190802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 639/1280] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:23:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:24:00.201762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad967ccf-9429-44d5-aba0-4063f4f2d243 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:00.205900 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:00.326765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad967ccf-9429-44d5-aba0-4063f4f2d243 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:00.365881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d58d6e-a56c-4486-b2be-827c87d61160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:00.367035 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d58d6e-a56c-4486-b2be-827c87d61160 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:00.367355 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d58d6e-a56c-4486-b2be-827c87d61160 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:00.367671 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d58d6e-a56c-4486-b2be-827c87d61160 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:00.368497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d58d6e-a56c-4486-b2be-827c87d61160 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:24:00.369005 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d58d6e-a56c-4486-b2be-827c87d61160 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:00.370781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d58d6e-a56c-4486-b2be-827c87d61160 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:00.393813 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 642/1281] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Sep 1 16:24:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:24:00.404202 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95b8e5-c70a-4f11-9d23-9aead6e91525 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:00.598356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:00.620163 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95b8e5-c70a-4f11-9d23-9aead6e91525 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:00.686393 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd1f09-fa88-4679-8b3f-3ff5fadfb087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:00.687458 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd1f09-fa88-4679-8b3f-3ff5fadfb087 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:00.687952 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd1f09-fa88-4679-8b3f-3ff5fadfb087 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:00.688423 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd1f09-fa88-4679-8b3f-3ff5fadfb087 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:00.796373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd1f09-fa88-4679-8b3f-3ff5fadfb087 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:00.798025 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd1f09-fa88-4679-8b3f-3ff5fadfb087 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:00.910603 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:00.935019 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 640/1282] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 1 16:24:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:24:00.941299 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d58d6e-a56c-4486-b2be-827c87d61160 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:01.019150 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:01.071303 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d58d6e-a56c-4486-b2be-827c87d61160 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:01.112811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf378b98-fa9d-4697-9b9c-5434b7419737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:01.113454 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf378b98-fa9d-4697-9b9c-5434b7419737 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:01.113726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf378b98-fa9d-4697-9b9c-5434b7419737 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:01.113995 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf378b98-fa9d-4697-9b9c-5434b7419737 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:01.126451 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf378b98-fa9d-4697-9b9c-5434b7419737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:01.127933 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf378b98-fa9d-4697-9b9c-5434b7419737 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:01.145836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-cf378b98-fa9d-4697-9b9c-5434b7419737 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:24:01.145836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:24:01.145836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:24:01.145836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:24:01.145836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:24:01.145836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:24:01.145836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:24:01.145836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:24:01.145836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:24:01.145836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:24:01.145836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:24:01.145836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:24:01.145836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:24:01.145836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:24:01.145836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:24:01.145836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:24:01.147092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:24:01.147092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:24:01.147092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:24:01.147092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:24:01.147092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:24:01.147092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:24:01.147092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:24:01.147092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:24:01.147092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:24:01.147092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:24:01.147092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:24:01.147092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:24:01.147092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:24:01.147092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:24:01.147092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:24:01.147092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:24:01.147092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:24:01.148795 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:24:01.148795 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:24:01.148795 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:24:01.148795 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 643/1283] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:24:01.155366 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd1f09-fa88-4679-8b3f-3ff5fadfb087 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:01.285424 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd1f09-fa88-4679-8b3f-3ff5fadfb087 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:01.327761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c95ac-17b9-4b99-8419-dd0ab9b8183e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:01.328384 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c95ac-17b9-4b99-8419-dd0ab9b8183e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:01.328752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c95ac-17b9-4b99-8419-dd0ab9b8183e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:01.329025 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c95ac-17b9-4b99-8419-dd0ab9b8183e None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:01.334142 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c95ac-17b9-4b99-8419-dd0ab9b8183e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:24:01.334450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c95ac-17b9-4b99-8419-dd0ab9b8183e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:01.336548 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c95ac-17b9-4b99-8419-dd0ab9b8183e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:01.352452 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 641/1284] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 1 16:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:24:01.361879 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf378b98-fa9d-4697-9b9c-5434b7419737 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:01.486024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf378b98-fa9d-4697-9b9c-5434b7419737 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:01.502896 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:01.528677 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7204630-f0dd-4321-9305-03314228f6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:01.529345 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7204630-f0dd-4321-9305-03314228f6dc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:01.529621 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7204630-f0dd-4321-9305-03314228f6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:01.529904 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7204630-f0dd-4321-9305-03314228f6dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:01.538586 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7204630-f0dd-4321-9305-03314228f6dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:01.539983 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7204630-f0dd-4321-9305-03314228f6dc None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:01.553024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-e7204630-f0dd-4321-9305-03314228f6dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:24:01.553024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:24:01.553024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:24:01.553024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:24:01.553024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:24:01.553024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:24:01.553024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:24:01.553024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:24:01.553024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:24:01.553024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:24:01.553024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:24:01.553024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:24:01.553024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:24:01.553024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:24:01.553024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:24:01.555410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:24:01.555410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:24:01.555410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:24:01.555410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:24:01.555410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:24:01.555410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:24:01.555410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:24:01.555410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:24:01.555410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 01 16:24:01.555410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:24:01.555410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:24:01.555410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:24:01.555410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:24:01.555410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:24:01.555410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:24:01.555410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:24:01.555410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:24:01.557248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:24:01.557248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:24:01.557248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:24:01.557248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:24:01.557248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:24:01.557248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:24:01.557248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:24:01.557248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 01 16:24:01.557248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 644/1285] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 1 16:24:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:24:01.564141 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c95ac-17b9-4b99-8419-dd0ab9b8183e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:01.626379 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:01.684855 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c95ac-17b9-4b99-8419-dd0ab9b8183e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:01.726848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338cff4-70e8-485a-80f8-bf49fc24e12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:01.727471 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338cff4-70e8-485a-80f8-bf49fc24e12e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:01.727754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338cff4-70e8-485a-80f8-bf49fc24e12e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:01.728027 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338cff4-70e8-485a-80f8-bf49fc24e12e None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:01.728778 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338cff4-70e8-485a-80f8-bf49fc24e12e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:24:01.729088 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338cff4-70e8-485a-80f8-bf49fc24e12e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:01.730569 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338cff4-70e8-485a-80f8-bf49fc24e12e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:01.744560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 642/1286] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 1 16:24:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:24:01.751077 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7204630-f0dd-4321-9305-03314228f6dc None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:01.871707 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7204630-f0dd-4321-9305-03314228f6dc None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:01.914452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f1120-294d-4e15-8295-08c8e14ce185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:01.915067 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f1120-294d-4e15-8295-08c8e14ce185 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:01.915347 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f1120-294d-4e15-8295-08c8e14ce185 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:01.915611 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f1120-294d-4e15-8295-08c8e14ce185 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:01.916359 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f1120-294d-4e15-8295-08c8e14ce185 None admin] RBAC: Adding query filter params (role.id=a8896546a02c42489ef73c7ad7c43542, scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f, user.id=d64fc190fac540259444a531cdbb8d53) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:24:01.916727 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f1120-294d-4e15-8295-08c8e14ce185 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:01.918278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f1120-294d-4e15-8295-08c8e14ce185 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:01.927357 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 645/1287] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 1 16:24:01 2022] GET /identity/v3/role_assignments?user.id=d64fc190fac540259444a531cdbb8d53&scope.project.id=43f5c22e38824a8b8dff2f9b4bc1df3f&role.id=a8896546a02c42489ef73c7ad7c43542 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:24:04.002982 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438c9a4-f337-4639-83ac-536683f5e21a None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:04.003635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438c9a4-f337-4639-83ac-536683f5e21a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:04.003939 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438c9a4-f337-4639-83ac-536683f5e21a None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:04.006642 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 643/1288] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:24:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:24:04.012790 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5badc3-82e9-4dd8-abbc-eb9e2e78618c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:04.013616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5badc3-82e9-4dd8-abbc-eb9e2e78618c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:04.013616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5badc3-82e9-4dd8-abbc-eb9e2e78618c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:04.034532 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5e5badc3-82e9-4dd8-abbc-eb9e2e78618c None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:24:04.035912 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5e5badc3-82e9-4dd8-abbc-eb9e2e78618c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:04.081437 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:04.128451 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 646/1289] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:24:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:24:04.431777 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438c9a4-f337-4639-83ac-536683f5e21a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:04.591689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438c9a4-f337-4639-83ac-536683f5e21a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:04.606012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:04.638605 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232bfa1d-25ab-47fc-a389-8a6a60b7afc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:04.639329 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bfa1d-25ab-47fc-a389-8a6a60b7afc6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:04.639646 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bfa1d-25ab-47fc-a389-8a6a60b7afc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:04.639959 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bfa1d-25ab-47fc-a389-8a6a60b7afc6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:04.640652 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232bfa1d-25ab-47fc-a389-8a6a60b7afc6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:04.642145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232bfa1d-25ab-47fc-a389-8a6a60b7afc6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:04.653106 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-232bfa1d-25ab-47fc-a389-8a6a60b7afc6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:24:04.653106 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:24:04.653106 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:24:04.653106 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:24:04.653106 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:24:04.653106 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:24:04.653106 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:24:04.653106 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:24:04.653106 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:24:04.653106 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:24:04.653106 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:24:04.653106 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:24:04.653106 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:24:04.653106 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:24:04.653106 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:24:04.653106 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:24:04.653106 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:24:04.654944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:24:04.654944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:24:04.654944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:24:04.654944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:24:04.654944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:24:04.654944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:24:04.654944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:24:04.654944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:24:04.654944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:24:04.654944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:24:04.654944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:24:04.654944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:24:04.654944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:24:04.654944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:24:04.654944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:24:04.654944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:24:04.656070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:24:04.656070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:24:04.656070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:24:04.656070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:24:04.656070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:24:04.656070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:24:04.656070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:24:04.656070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:24:04.656070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:24:04.656070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:24:04.656070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:24:04.656070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:24:04.656070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:24:04.656070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:24:04.656070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 644/1290] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Sep 1 16:24:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:24:04.660973 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5badc3-82e9-4dd8-abbc-eb9e2e78618c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:04.794248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5badc3-82e9-4dd8-abbc-eb9e2e78618c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:04.840424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4dd11-e387-428d-be3a-dba3aba0e078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:04.841149 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4dd11-e387-428d-be3a-dba3aba0e078 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:04.841434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4dd11-e387-428d-be3a-dba3aba0e078 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:04.841713 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4dd11-e387-428d-be3a-dba3aba0e078 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:04.842393 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4dd11-e387-428d-be3a-dba3aba0e078 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:24:04.842698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4dd11-e387-428d-be3a-dba3aba0e078 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:04.844254 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4dd11-e387-428d-be3a-dba3aba0e078 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:04.850958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 647/1291] 10.222.0.52 () {56 vars in 1116 bytes} [Thu Sep 1 16:24:04 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:24:04.857894 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232bfa1d-25ab-47fc-a389-8a6a60b7afc6 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:05.018097 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232bfa1d-25ab-47fc-a389-8a6a60b7afc6 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:05.078064 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755bf11-4463-4669-aa0c-390f6965b488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:05.079259 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755bf11-4463-4669-aa0c-390f6965b488 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:05.079737 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755bf11-4463-4669-aa0c-390f6965b488 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:05.080269 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755bf11-4463-4669-aa0c-390f6965b488 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:05.081603 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755bf11-4463-4669-aa0c-390f6965b488 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:24:05.082146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755bf11-4463-4669-aa0c-390f6965b488 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:05.085353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755bf11-4463-4669-aa0c-390f6965b488 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:05.094722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 645/1292] 10.222.0.52 () {56 vars in 1116 bytes} [Thu Sep 1 16:24:04 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:24:07.226437 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4067a-0f83-4593-92c9-57b725579962 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:07.227048 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4067a-0f83-4593-92c9-57b725579962 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:07.227048 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4067a-0f83-4593-92c9-57b725579962 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:07.228553 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 648/1293] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:24:07.240042 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b6529-0afc-493d-bcb8-fab0974af8a9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:07.241252 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b6529-0afc-493d-bcb8-fab0974af8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:07.241567 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b6529-0afc-493d-bcb8-fab0974af8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:07.272988 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2d1b6529-0afc-493d-bcb8-fab0974af8a9 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:24:07.275099 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2d1b6529-0afc-493d-bcb8-fab0974af8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:07.332072 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:07.404446 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 646/1294] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:24:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:24:07.690239 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4067a-0f83-4593-92c9-57b725579962 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:07.732972 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:07.829903 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4067a-0f83-4593-92c9-57b725579962 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:07.883858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0ca61-153a-4635-a8d8-3c428f22f443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:07.884492 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0ca61-153a-4635-a8d8-3c428f22f443 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:07.884808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0ca61-153a-4635-a8d8-3c428f22f443 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:07.885084 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0ca61-153a-4635-a8d8-3c428f22f443 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:07.885759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0ca61-153a-4635-a8d8-3c428f22f443 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:07.887179 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0ca61-153a-4635-a8d8-3c428f22f443 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:07.904735 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 649/1295] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 1 16:24:07 2022] POST /identity/v3/services => generated 246 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:24:10.393495 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe57cf-e897-46a1-9229-f7f7454d4f1a None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:10.394298 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe57cf-e897-46a1-9229-f7f7454d4f1a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:10.394298 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe57cf-e897-46a1-9229-f7f7454d4f1a None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:10.395527 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 647/1296] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:24:10.402365 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b8344-ad55-4e83-bed5-f5063ec931d2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:10.402960 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b8344-ad55-4e83-bed5-f5063ec931d2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:10.402960 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b8344-ad55-4e83-bed5-f5063ec931d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:10.423938 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-444b8344-ad55-4e83-bed5-f5063ec931d2 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:24:10.425237 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-444b8344-ad55-4e83-bed5-f5063ec931d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:10.517369 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 650/1297] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:24:10 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:24:10.799904 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe57cf-e897-46a1-9229-f7f7454d4f1a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:10.926295 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe57cf-e897-46a1-9229-f7f7454d4f1a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:10.968796 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee2b5b-dd68-479f-8584-28a80626209c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:10.969522 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee2b5b-dd68-479f-8584-28a80626209c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:10.969852 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee2b5b-dd68-479f-8584-28a80626209c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:10.970173 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee2b5b-dd68-479f-8584-28a80626209c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:10.970829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee2b5b-dd68-479f-8584-28a80626209c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:10.972382 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee2b5b-dd68-479f-8584-28a80626209c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:10.982465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-1eee2b5b-dd68-479f-8584-28a80626209c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:24:10.982465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:24:10.982465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:24:10.982465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:24:10.982465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:24:10.982465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:24:10.982465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:24:10.982465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:24:10.982465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:24:10.982465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:24:10.982465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:24:10.982465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:24:10.982465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:24:10.982465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:24:10.982465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:24:10.982465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:24:10.982465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:24:10.985260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:24:10.985260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:24:10.985260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:24:10.985260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:24:10.985260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:24:10.985260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:24:10.985260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:24:10.985260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:24:10.985260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:24:10.985260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:24:10.985260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:24:10.985260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:24:10.985260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:24:10.985260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:24:10.985260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:24:10.985260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:24:10.987091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:24:10.987091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:24:10.987091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:24:10.987091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:24:10.987091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:24:10.987091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:24:10.987091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:24:10.987091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:24:10.987091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:24:10.987091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:24:10.987091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:24:10.987091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:24:10.987091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:24:10.987091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:24:10.987091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 648/1298] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Sep 1 16:24:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:24:10.992042 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b8344-ad55-4e83-bed5-f5063ec931d2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:11.013788 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:11.114595 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b8344-ad55-4e83-bed5-f5063ec931d2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:11.155927 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094e469-6e82-4201-b4a0-c1ed6fcb5582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:11.156664 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094e469-6e82-4201-b4a0-c1ed6fcb5582 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:11.157002 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094e469-6e82-4201-b4a0-c1ed6fcb5582 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:11.157357 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094e469-6e82-4201-b4a0-c1ed6fcb5582 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:11.158078 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094e469-6e82-4201-b4a0-c1ed6fcb5582 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:24:11.158436 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094e469-6e82-4201-b4a0-c1ed6fcb5582 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:11.159931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094e469-6e82-4201-b4a0-c1ed6fcb5582 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:11.166953 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 651/1299] 10.222.0.52 () {56 vars in 1116 bytes} [Thu Sep 1 16:24:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:24:11.173517 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee2b5b-dd68-479f-8584-28a80626209c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:11.210806 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:11.294130 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee2b5b-dd68-479f-8584-28a80626209c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:11.333761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789320f-f824-4909-8b23-0eee5e5f686b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:11.334966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789320f-f824-4909-8b23-0eee5e5f686b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:11.335249 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789320f-f824-4909-8b23-0eee5e5f686b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:11.335517 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789320f-f824-4909-8b23-0eee5e5f686b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:11.336256 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789320f-f824-4909-8b23-0eee5e5f686b None admin] RBAC: Adding query filter params (interface=public, service_id=cd0da2d2439144a99397fa81a6b29ce0, region_id=RegionOne) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:24:11.336565 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789320f-f824-4909-8b23-0eee5e5f686b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:11.338035 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789320f-f824-4909-8b23-0eee5e5f686b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:11.344232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 649/1300] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Sep 1 16:24:11 2022] GET /identity/v3/endpoints?service_id=cd0da2d2439144a99397fa81a6b29ce0&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:24:11.350541 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094e469-6e82-4201-b4a0-c1ed6fcb5582 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:11.447941 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:11.471185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094e469-6e82-4201-b4a0-c1ed6fcb5582 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:11.511490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd52352-a1f5-4da6-8184-7c4126968426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:11.512139 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd52352-a1f5-4da6-8184-7c4126968426 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:11.512447 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd52352-a1f5-4da6-8184-7c4126968426 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:11.512760 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd52352-a1f5-4da6-8184-7c4126968426 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:11.513413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd52352-a1f5-4da6-8184-7c4126968426 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:11.514858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd52352-a1f5-4da6-8184-7c4126968426 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:11.523537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 652/1301] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Sep 1 16:24:11 2022] GET /identity/v3/services => generated 2191 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:24:13.657739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c049300-cff0-4c44-8974-a4877361ee31 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:13.658400 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c049300-cff0-4c44-8974-a4877361ee31 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:13.658400 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c049300-cff0-4c44-8974-a4877361ee31 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:13.660002 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 650/1302] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:24:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:24:13.666487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299a536-5db1-4811-ab1b-b42588a020d9 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:13.667055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299a536-5db1-4811-ab1b-b42588a020d9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:13.667055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299a536-5db1-4811-ab1b-b42588a020d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:13.687208 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2299a536-5db1-4811-ab1b-b42588a020d9 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:24:13.688484 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2299a536-5db1-4811-ab1b-b42588a020d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:24:13.773748 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 653/1303] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:24:13 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:24:14.059431 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c049300-cff0-4c44-8974-a4877361ee31 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:14.176116 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:14.185194 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c049300-cff0-4c44-8974-a4877361ee31 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:14.225001 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef266b-06bf-4096-9882-a72f69963540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:14.225649 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef266b-06bf-4096-9882-a72f69963540 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:14.225925 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef266b-06bf-4096-9882-a72f69963540 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:14.226194 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef266b-06bf-4096-9882-a72f69963540 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:14.226796 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef266b-06bf-4096-9882-a72f69963540 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:14.228213 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef266b-06bf-4096-9882-a72f69963540 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:14.238407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-d4ef266b-06bf-4096-9882-a72f69963540 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:24:14.238407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:24:14.238407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:24:14.238407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:24:14.238407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:24:14.238407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:24:14.238407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:24:14.238407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:24:14.238407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:24:14.238407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:24:14.238407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:24:14.238407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:24:14.238407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:24:14.238407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:24:14.238407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:24:14.238407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:24:14.238407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:24:14.240958 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:24:14.240958 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:24:14.240958 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:24:14.240958 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:24:14.240958 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:24:14.240958 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:24:14.240958 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:24:14.240958 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:24:14.240958 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:24:14.240958 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:24:14.240958 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:24:14.240958 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:24:14.240958 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:24:14.240958 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:24:14.240958 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:24:14.240958 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:24:14.242634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:24:14.242634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 01 16:24:14.242634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:24:14.242634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:24:14.242634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:24:14.242634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:24:14.242634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:24:14.242634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:24:14.242634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:24:14.242634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:24:14.242634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:24:14.242634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:24:14.242634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:24:14.242634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 01 16:24:14.242634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 651/1304] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Sep 1 16:24:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:24:14.249388 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299a536-5db1-4811-ab1b-b42588a020d9 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:14.339689 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:14.374429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299a536-5db1-4811-ab1b-b42588a020d9 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:14.437282 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77f699-eeb8-48c2-a2cd-6caf2cc15947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:14.438377 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77f699-eeb8-48c2-a2cd-6caf2cc15947 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:14.438868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77f699-eeb8-48c2-a2cd-6caf2cc15947 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:14.439366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77f699-eeb8-48c2-a2cd-6caf2cc15947 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:14.440526 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77f699-eeb8-48c2-a2cd-6caf2cc15947 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:24:14.441089 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77f699-eeb8-48c2-a2cd-6caf2cc15947 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:14.444147 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77f699-eeb8-48c2-a2cd-6caf2cc15947 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:14.454415 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 654/1305] 10.222.0.52 () {56 vars in 1116 bytes} [Thu Sep 1 16:24:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:24:14.461414 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef266b-06bf-4096-9882-a72f69963540 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:24:14.582555 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef266b-06bf-4096-9882-a72f69963540 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:24:14.622878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad2336-1319-4d73-807c-5ad227c520bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:24:14.623473 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad2336-1319-4d73-807c-5ad227c520bd None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:24:14.623879 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad2336-1319-4d73-807c-5ad227c520bd None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:24:14.624208 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad2336-1319-4d73-807c-5ad227c520bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:24:14.625096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad2336-1319-4d73-807c-5ad227c520bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:24:14.626575 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad2336-1319-4d73-807c-5ad227c520bd None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:24:14.662142 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 652/1306] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:24:14 2022] POST /identity/v3/endpoints => generated 331 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:24:24.447941 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=30 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:24.657517 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:34.065000 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6ae24-6749-45db-9810-da4b88e9e836 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:34.065920 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6ae24-6749-45db-9810-da4b88e9e836 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:34.066412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6ae24-6749-45db-9810-da4b88e9e836 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:34.068903 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 655/1307] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:25:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:34.078124 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d1b02-f404-4e86-96eb-2d603f0b37eb None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:34.078614 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d1b02-f404-4e86-96eb-2d603f0b37eb None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:34.079098 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d1b02-f404-4e86-96eb-2d603f0b37eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:34.245006 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b63d1b02-f404-4e86-96eb-2d603f0b37eb None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:34.247529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b63d1b02-f404-4e86-96eb-2d603f0b37eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:34.586701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 653/1308] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:34.971443 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa49ef-118b-4eb9-b441-a8398853718a None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:34.972192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa49ef-118b-4eb9-b441-a8398853718a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:34.983994 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa49ef-118b-4eb9-b441-a8398853718a None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:34.987122 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 656/1309] 10.222.0.52 () {54 vars in 965 bytes} [Thu Sep 1 16:25:34 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:35.005554 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a66b30-3c7b-4e61-8945-c7b52b72fd25 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:35.005554 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a66b30-3c7b-4e61-8945-c7b52b72fd25 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:35.005554 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a66b30-3c7b-4e61-8945-c7b52b72fd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:35.132604 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a2a66b30-3c7b-4e61-8945-c7b52b72fd25 None None] MFA Rules not processed for user `0668b918bf2c49c2901838cd22770030`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:35.134181 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a2a66b30-3c7b-4e61-8945-c7b52b72fd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:35.162771 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:35.248005 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 654/1310] 10.222.0.52 () {58 vars in 1062 bytes} [Thu Sep 1 16:25:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:35.264322 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa49ef-118b-4eb9-b441-a8398853718a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:35.268334 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c7fa49ef-118b-4eb9-b441-a8398853718a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:35.508218 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa49ef-118b-4eb9-b441-a8398853718a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:35.612361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a6864-4de6-4eb4-8527-97295b9da600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:35.613010 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a6864-4de6-4eb4-8527-97295b9da600 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:35.613292 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a6864-4de6-4eb4-8527-97295b9da600 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:35.613722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a6864-4de6-4eb4-8527-97295b9da600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:35.615581 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-129a6864-4de6-4eb4-8527-97295b9da600 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:35.702503 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:35.781845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a6864-4de6-4eb4-8527-97295b9da600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:35.783442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a6864-4de6-4eb4-8527-97295b9da600 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:35.811711 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 657/1311] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:25:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:25:38.146032 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41dfe0c-a05c-43a8-9877-08858423ec6c None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:38.146654 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41dfe0c-a05c-43a8-9877-08858423ec6c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:38.146654 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41dfe0c-a05c-43a8-9877-08858423ec6c None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:38.148023 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 655/1312] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:38.154988 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfe9d8-bffa-45b8-8f70-046246a1edd2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:38.155546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfe9d8-bffa-45b8-8f70-046246a1edd2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:38.155546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfe9d8-bffa-45b8-8f70-046246a1edd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:38.238262 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-34cfe9d8-bffa-45b8-8f70-046246a1edd2 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:38.239537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-34cfe9d8-bffa-45b8-8f70-046246a1edd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:38.352118 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 658/1313] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:25:38.753152 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41dfe0c-a05c-43a8-9877-08858423ec6c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:38.754883 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b41dfe0c-a05c-43a8-9877-08858423ec6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:38.917028 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41dfe0c-a05c-43a8-9877-08858423ec6c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:39.016148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:39.019029 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e56755-8b16-4c14-a482-107902eea3bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:39.019734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e56755-8b16-4c14-a482-107902eea3bb service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:39.024158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e56755-8b16-4c14-a482-107902eea3bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:39.024158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e56755-8b16-4c14-a482-107902eea3bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:39.024158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-65e56755-8b16-4c14-a482-107902eea3bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:39.192057 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e56755-8b16-4c14-a482-107902eea3bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:39.193627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e56755-8b16-4c14-a482-107902eea3bb service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:39.217121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 656/1314] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:25:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:25:41.725327 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf36b83-eb42-4ec6-b5a6-3609aa22ae6c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:41.726185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf36b83-eb42-4ec6-b5a6-3609aa22ae6c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:41.726185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf36b83-eb42-4ec6-b5a6-3609aa22ae6c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:41.727878 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 659/1315] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:25:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:41.738018 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58eab48-a548-4868-80c2-cca5c6cd296e None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:41.738874 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58eab48-a548-4868-80c2-cca5c6cd296e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:41.739047 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58eab48-a548-4868-80c2-cca5c6cd296e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:41.819577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e58eab48-a548-4868-80c2-cca5c6cd296e None None] MFA Rules not processed for user `08a10ce8373d40309074b328c9c29722`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:41.821179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e58eab48-a548-4868-80c2-cca5c6cd296e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:41.891804 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:41.953246 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 657/1316] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:41 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:42.299671 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf36b83-eb42-4ec6-b5a6-3609aa22ae6c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:42.301441 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fdf36b83-eb42-4ec6-b5a6-3609aa22ae6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:42.313575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:42.441972 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf36b83-eb42-4ec6-b5a6-3609aa22ae6c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:42.542674 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c4d12-46dc-4eb1-81d4-1491484282ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:42.543674 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c4d12-46dc-4eb1-81d4-1491484282ce service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:42.544160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c4d12-46dc-4eb1-81d4-1491484282ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:42.544715 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c4d12-46dc-4eb1-81d4-1491484282ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:42.548284 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-043c4d12-46dc-4eb1-81d4-1491484282ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:42.670624 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:42.764180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c4d12-46dc-4eb1-81d4-1491484282ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:42.765841 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c4d12-46dc-4eb1-81d4-1491484282ce service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:42.790090 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 660/1317] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:25:42 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:25:45.715153 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ad442-e6ca-4189-99a9-4daff19b0085 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:45.715761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ad442-e6ca-4189-99a9-4daff19b0085 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:45.715761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ad442-e6ca-4189-99a9-4daff19b0085 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:45.717365 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 658/1318] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:45.723932 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05a847-d280-489f-b698-064698a688ed None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:45.724489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05a847-d280-489f-b698-064698a688ed None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:45.724489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05a847-d280-489f-b698-064698a688ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:45.838820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9e05a847-d280-489f-b698-064698a688ed None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:45.840930 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9e05a847-d280-489f-b698-064698a688ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:46.006819 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 661/1319] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:25:46.399642 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00943a62-bbab-4ced-8dfc-9fc662c40714 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:46.399971 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00943a62-bbab-4ced-8dfc-9fc662c40714 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:46.400182 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00943a62-bbab-4ced-8dfc-9fc662c40714 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:46.401779 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 659/1320] 10.222.0.52 () {54 vars in 965 bytes} [Thu Sep 1 16:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:46.409519 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2162e9e-dfda-4619-8671-594f7896cf74 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:46.409936 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2162e9e-dfda-4619-8671-594f7896cf74 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:46.410317 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2162e9e-dfda-4619-8671-594f7896cf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:46.437170 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:46.505995 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e2162e9e-dfda-4619-8671-594f7896cf74 None None] MFA Rules not processed for user `0668b918bf2c49c2901838cd22770030`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:46.507242 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e2162e9e-dfda-4619-8671-594f7896cf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:46.599641 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 662/1321] 10.222.0.52 () {58 vars in 1062 bytes} [Thu Sep 1 16:25:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:46.610464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00943a62-bbab-4ced-8dfc-9fc662c40714 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:46.612801 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-00943a62-bbab-4ced-8dfc-9fc662c40714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:46.741827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00943a62-bbab-4ced-8dfc-9fc662c40714 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:46.844115 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311660ff-a415-41a2-83d9-9f978562ef0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:46.844772 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311660ff-a415-41a2-83d9-9f978562ef0d service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:46.845057 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311660ff-a415-41a2-83d9-9f978562ef0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:46.845329 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311660ff-a415-41a2-83d9-9f978562ef0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:46.847118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-311660ff-a415-41a2-83d9-9f978562ef0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:46.856462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:46.990209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311660ff-a415-41a2-83d9-9f978562ef0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:46.991716 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311660ff-a415-41a2-83d9-9f978562ef0d service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:47.014842 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 660/1322] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:25:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:25:50.727824 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae1a27-5c12-44d5-902e-dfcf6358b27e None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:50.728692 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae1a27-5c12-44d5-902e-dfcf6358b27e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:50.728692 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae1a27-5c12-44d5-902e-dfcf6358b27e None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:50.730488 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 663/1323] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:25:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:50.736675 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f5619-4bcc-4be3-98cd-6103a40ba5a7 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:50.737308 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f5619-4bcc-4be3-98cd-6103a40ba5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:50.737308 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f5619-4bcc-4be3-98cd-6103a40ba5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:50.825952 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-fc3f5619-4bcc-4be3-98cd-6103a40ba5a7 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:50.827292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fc3f5619-4bcc-4be3-98cd-6103a40ba5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:50.905345 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:50.963103 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 661/1324] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:51.263174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae1a27-5c12-44d5-902e-dfcf6358b27e None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:51.265168 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a4ae1a27-5c12-44d5-902e-dfcf6358b27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:51.405363 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae1a27-5c12-44d5-902e-dfcf6358b27e None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:51.420301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:51.501428 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab9d9d-0d4d-4dcd-8733-dcb31bdd9ebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:51.502055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab9d9d-0d4d-4dcd-8733-dcb31bdd9ebd service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:51.502393 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab9d9d-0d4d-4dcd-8733-dcb31bdd9ebd service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:51.502645 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab9d9d-0d4d-4dcd-8733-dcb31bdd9ebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:51.504422 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-48ab9d9d-0d4d-4dcd-8733-dcb31bdd9ebd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:51.651288 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ab9d9d-0d4d-4dcd-8733-dcb31bdd9ebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:51.652772 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ab9d9d-0d4d-4dcd-8733-dcb31bdd9ebd service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:51.677359 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 664/1325] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:25:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:25:54.440011 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff3957-96b6-47c4-9c6e-a7b382fce1dd None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:54.440930 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff3957-96b6-47c4-9c6e-a7b382fce1dd None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:54.440930 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff3957-96b6-47c4-9c6e-a7b382fce1dd None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:54.442042 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 662/1326] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:25:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:54.449652 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dfc16-cd43-495d-878a-4f3516b361da None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:54.450501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dfc16-cd43-495d-878a-4f3516b361da None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:54.450501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dfc16-cd43-495d-878a-4f3516b361da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:54.519353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:54.546971 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-bf7dfc16-cd43-495d-878a-4f3516b361da None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:54.548613 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bf7dfc16-cd43-495d-878a-4f3516b361da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:54.693493 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 665/1327] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:25:54.996757 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff3957-96b6-47c4-9c6e-a7b382fce1dd None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:54.998694 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-82ff3957-96b6-47c4-9c6e-a7b382fce1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:55.145287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff3957-96b6-47c4-9c6e-a7b382fce1dd None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:55.253252 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfc114-c45c-45bf-b2af-0368cdeaef23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:55.253791 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfc114-c45c-45bf-b2af-0368cdeaef23 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:55.254076 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfc114-c45c-45bf-b2af-0368cdeaef23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:55.254345 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfc114-c45c-45bf-b2af-0368cdeaef23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:55.256529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f6dfc114-c45c-45bf-b2af-0368cdeaef23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:55.281170 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:55.401273 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfc114-c45c-45bf-b2af-0368cdeaef23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:55.402782 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfc114-c45c-45bf-b2af-0368cdeaef23 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:55.426375 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 663/1328] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:25:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:25:58.021365 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14caa37-6aa4-49de-abad-237d8736f73f None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:58.022193 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14caa37-6aa4-49de-abad-237d8736f73f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:58.022193 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14caa37-6aa4-49de-abad-237d8736f73f None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:58.023626 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 666/1329] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:25:58.030300 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c02ab-92ec-4397-942f-d2227537d471 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:58.031166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c02ab-92ec-4397-942f-d2227537d471 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:58.031166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c02ab-92ec-4397-942f-d2227537d471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:58.156303 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-032c02ab-92ec-4397-942f-d2227537d471 None None] MFA Rules not processed for user `08a10ce8373d40309074b328c9c29722`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:25:58.158309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-032c02ab-92ec-4397-942f-d2227537d471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:58.274243 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:58.323789 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 664/1330] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:25:58 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:25:58.620169 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14caa37-6aa4-49de-abad-237d8736f73f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:25:58.622003 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f14caa37-6aa4-49de-abad-237d8736f73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:58.776511 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14caa37-6aa4-49de-abad-237d8736f73f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:25:58.818825 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:58.911481 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5645aea-316d-43d6-aa13-1a725be46355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:25:58.912104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5645aea-316d-43d6-aa13-1a725be46355 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:25:58.912382 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5645aea-316d-43d6-aa13-1a725be46355 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:25:58.912687 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5645aea-316d-43d6-aa13-1a725be46355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:25:58.914459 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f5645aea-316d-43d6-aa13-1a725be46355 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:25:59.124791 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5645aea-316d-43d6-aa13-1a725be46355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:25:59.126446 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5645aea-316d-43d6-aa13-1a725be46355 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:25:59.153251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 667/1331] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:25:58 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:01.842044 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496b226-d1d6-4431-8de0-47f3a1953120 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:01.842834 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496b226-d1d6-4431-8de0-47f3a1953120 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:01.842834 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496b226-d1d6-4431-8de0-47f3a1953120 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:01.844373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 665/1332] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:01.851143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34604281-364d-4626-b241-d26fb0f31014 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:01.851711 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34604281-364d-4626-b241-d26fb0f31014 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:01.851870 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34604281-364d-4626-b241-d26fb0f31014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:01.956528 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:01.961398 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-34604281-364d-4626-b241-d26fb0f31014 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:01.963681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-34604281-364d-4626-b241-d26fb0f31014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:02.077985 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 668/1333] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:02.372453 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496b226-d1d6-4431-8de0-47f3a1953120 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:02.374125 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5496b226-d1d6-4431-8de0-47f3a1953120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:02.540180 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496b226-d1d6-4431-8de0-47f3a1953120 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:02.631546 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56230823-3d46-4b4e-b392-1ec2332ac08e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:02.632160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56230823-3d46-4b4e-b392-1ec2332ac08e service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:02.632442 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56230823-3d46-4b4e-b392-1ec2332ac08e service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:02.632744 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56230823-3d46-4b4e-b392-1ec2332ac08e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:02.634447 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-56230823-3d46-4b4e-b392-1ec2332ac08e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:02.667378 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:02.785644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56230823-3d46-4b4e-b392-1ec2332ac08e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:02.787126 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56230823-3d46-4b4e-b392-1ec2332ac08e service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:02.808485 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 666/1334] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:04.861698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e501ef9-2e8d-4ddb-a6a9-143df782cbe2 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:04.862564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e501ef9-2e8d-4ddb-a6a9-143df782cbe2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:04.862564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e501ef9-2e8d-4ddb-a6a9-143df782cbe2 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:04.864678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 669/1335] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:26:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:04.871349 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52c70d-dd6c-459f-b452-6d435e34c5ae None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:04.871919 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52c70d-dd6c-459f-b452-6d435e34c5ae None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:04.872049 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52c70d-dd6c-459f-b452-6d435e34c5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:04.953796 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-cd52c70d-dd6c-459f-b452-6d435e34c5ae None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:04.954932 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cd52c70d-dd6c-459f-b452-6d435e34c5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:05.045875 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:05.075070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 667/1336] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:05.367200 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e501ef9-2e8d-4ddb-a6a9-143df782cbe2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:05.368925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8e501ef9-2e8d-4ddb-a6a9-143df782cbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:05.493996 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e501ef9-2e8d-4ddb-a6a9-143df782cbe2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:05.528783 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:05.583154 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818481e-4e30-4f3c-a89e-fb6d53bc2617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:05.584096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818481e-4e30-4f3c-a89e-fb6d53bc2617 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:05.584388 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818481e-4e30-4f3c-a89e-fb6d53bc2617 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:05.584682 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818481e-4e30-4f3c-a89e-fb6d53bc2617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:05.586446 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2818481e-4e30-4f3c-a89e-fb6d53bc2617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:05.724846 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818481e-4e30-4f3c-a89e-fb6d53bc2617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:05.726443 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818481e-4e30-4f3c-a89e-fb6d53bc2617 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:05.747369 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 670/1337] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:08.366392 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bbd37-e847-4493-8410-3902afe83b5d None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:08.367251 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bbd37-e847-4493-8410-3902afe83b5d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:08.367251 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bbd37-e847-4493-8410-3902afe83b5d None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:08.368879 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 668/1338] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:26:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:26:08.378740 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fdd0e-1445-4b34-b272-cec7688347ec None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:08.379324 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fdd0e-1445-4b34-b272-cec7688347ec None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:08.379718 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fdd0e-1445-4b34-b272-cec7688347ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:08.469499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-846fdd0e-1445-4b34-b272-cec7688347ec None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:08.470763 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-846fdd0e-1445-4b34-b272-cec7688347ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:08.481634 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:08.588762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 671/1339] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:08.886312 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bbd37-e847-4493-8410-3902afe83b5d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:08.887949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-321bbd37-e847-4493-8410-3902afe83b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:09.072305 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bbd37-e847-4493-8410-3902afe83b5d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:09.191377 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d23176-c687-47fb-9c80-616d88e089d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:09.191994 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d23176-c687-47fb-9c80-616d88e089d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:09.192271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d23176-c687-47fb-9c80-616d88e089d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:09.192541 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d23176-c687-47fb-9c80-616d88e089d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:09.194242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a1d23176-c687-47fb-9c80-616d88e089d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:09.242498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:09.329852 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d23176-c687-47fb-9c80-616d88e089d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:09.331291 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d23176-c687-47fb-9c80-616d88e089d9 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:09.354103 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 669/1340] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:13.855805 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1a2d3-c0d7-4af2-ab26-7c64dcf63a64 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:13.856725 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1a2d3-c0d7-4af2-ab26-7c64dcf63a64 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:13.856725 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1a2d3-c0d7-4af2-ab26-7c64dcf63a64 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:13.857816 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 672/1341] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:13.864146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b2bcc-d893-4dd8-9983-53efe41fd36f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:13.864977 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b2bcc-d893-4dd8-9983-53efe41fd36f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:13.864977 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b2bcc-d893-4dd8-9983-53efe41fd36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:13.987010 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-455b2bcc-d893-4dd8-9983-53efe41fd36f None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:13.989394 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-455b2bcc-d893-4dd8-9983-53efe41fd36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:14.152017 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:14.167998 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 670/1342] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:26:14.464067 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d1a2d3-c0d7-4af2-ab26-7c64dcf63a64 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:14.465967 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f5d1a2d3-c0d7-4af2-ab26-7c64dcf63a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:14.605129 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d1a2d3-c0d7-4af2-ab26-7c64dcf63a64 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:14.652663 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:14.703802 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4fac5-e281-4bff-af29-2ebc596a9953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:14.704428 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4fac5-e281-4bff-af29-2ebc596a9953 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:14.704733 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4fac5-e281-4bff-af29-2ebc596a9953 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:14.705058 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4fac5-e281-4bff-af29-2ebc596a9953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:14.706732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-86a4fac5-e281-4bff-af29-2ebc596a9953 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:14.921362 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4fac5-e281-4bff-af29-2ebc596a9953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:14.924168 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4fac5-e281-4bff-af29-2ebc596a9953 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:14.962006 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 673/1343] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:18.991062 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38263625-d4a1-422c-a928-d2f82b1d62cf None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:18.992374 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38263625-d4a1-422c-a928-d2f82b1d62cf None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:18.992374 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38263625-d4a1-422c-a928-d2f82b1d62cf None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:18.993866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 671/1344] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:26:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:19.002413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962f5e0-9263-4864-a6f7-9cf41f027e7f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:19.003238 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962f5e0-9263-4864-a6f7-9cf41f027e7f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:19.003397 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962f5e0-9263-4864-a6f7-9cf41f027e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:19.109839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e962f5e0-9263-4864-a6f7-9cf41f027e7f None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:19.112010 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e962f5e0-9263-4864-a6f7-9cf41f027e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:19.146665 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:19.250130 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 674/1345] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:26:19.535996 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38263625-d4a1-422c-a928-d2f82b1d62cf None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:19.537659 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-38263625-d4a1-422c-a928-d2f82b1d62cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:19.665171 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38263625-d4a1-422c-a928-d2f82b1d62cf None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:19.762309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be07c52-03a4-442a-9bee-404912596cfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:19.763099 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be07c52-03a4-442a-9bee-404912596cfe service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:19.763383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be07c52-03a4-442a-9bee-404912596cfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:19.763665 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be07c52-03a4-442a-9bee-404912596cfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:19.765458 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6be07c52-03a4-442a-9bee-404912596cfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:19.821537 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:19.904467 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be07c52-03a4-442a-9bee-404912596cfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:19.906153 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be07c52-03a4-442a-9bee-404912596cfe service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:19.929567 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 672/1346] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:24.961739 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77215813-ab50-4845-a3a9-6ef0c3af13ed None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:24.962306 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77215813-ab50-4845-a3a9-6ef0c3af13ed None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:24.962901 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77215813-ab50-4845-a3a9-6ef0c3af13ed None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:24.966170 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 675/1347] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:26:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:24.975849 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676bb36-7f59-4e7b-9863-d411aec1f736 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:24.976424 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676bb36-7f59-4e7b-9863-d411aec1f736 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:24.976891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676bb36-7f59-4e7b-9863-d411aec1f736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:25.116802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f676bb36-7f59-4e7b-9863-d411aec1f736 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:25.119648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f676bb36-7f59-4e7b-9863-d411aec1f736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:25.271589 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:25.276866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 673/1348] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:25.571013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77215813-ab50-4845-a3a9-6ef0c3af13ed None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:25.572599 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-77215813-ab50-4845-a3a9-6ef0c3af13ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:25.728488 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77215813-ab50-4845-a3a9-6ef0c3af13ed None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:25.805956 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:25.843988 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fe881-083f-4888-8ed6-67e4b121665d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:25.844640 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fe881-083f-4888-8ed6-67e4b121665d service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:25.844989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fe881-083f-4888-8ed6-67e4b121665d service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:25.845319 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fe881-083f-4888-8ed6-67e4b121665d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:25.847036 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-087fe881-083f-4888-8ed6-67e4b121665d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:25.990334 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fe881-083f-4888-8ed6-67e4b121665d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:25.992087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fe881-083f-4888-8ed6-67e4b121665d service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:26.014551 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 676/1349] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:31.897689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55dba8-9621-41d3-bb86-7e8cd33072ec None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:31.898760 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55dba8-9621-41d3-bb86-7e8cd33072ec None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:31.899255 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55dba8-9621-41d3-bb86-7e8cd33072ec None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:31.901292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 674/1350] 10.222.0.52 () {54 vars in 921 bytes} [Thu Sep 1 16:26:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:26:31.907320 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969f76f-e462-4e55-b143-7b706a2488e6 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:31.908330 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969f76f-e462-4e55-b143-7b706a2488e6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:31.909434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969f76f-e462-4e55-b143-7b706a2488e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:32.014187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a969f76f-e462-4e55-b143-7b706a2488e6 None None] MFA Rules not processed for user `d64fc190fac540259444a531cdbb8d53`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:32.015450 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a969f76f-e462-4e55-b143-7b706a2488e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:32.050900 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:32.322136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 677/1351] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Sep 1 16:26:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:38.213128 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9d1be-f79a-43ee-bd89-72a89cadb62d None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:38.213754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9d1be-f79a-43ee-bd89-72a89cadb62d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:38.215049 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9d1be-f79a-43ee-bd89-72a89cadb62d None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:38.218533 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 675/1352] 10.222.0.52 () {54 vars in 921 bytes} [Thu Sep 1 16:26:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:38.225374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c529b8f-8533-443c-a74c-8da47603b147 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:38.226814 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c529b8f-8533-443c-a74c-8da47603b147 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:38.227090 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c529b8f-8533-443c-a74c-8da47603b147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:38.323482 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2c529b8f-8533-443c-a74c-8da47603b147 None None] MFA Rules not processed for user `d64fc190fac540259444a531cdbb8d53`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:38.325272 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2c529b8f-8533-443c-a74c-8da47603b147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:38.438965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:38.515990 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 678/1353] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Sep 1 16:26:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:26:40.607532 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e726f7-8e06-467e-a4db-30417e6f8793 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:40.608350 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e726f7-8e06-467e-a4db-30417e6f8793 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:40.608677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e726f7-8e06-467e-a4db-30417e6f8793 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:40.610724 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 676/1354] 10.222.0.52 () {54 vars in 921 bytes} [Thu Sep 1 16:26:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:40.617969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6aa3f3-32e5-4a66-8d15-311d439a2b65 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:40.618918 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6aa3f3-32e5-4a66-8d15-311d439a2b65 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:40.619158 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6aa3f3-32e5-4a66-8d15-311d439a2b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:40.787859 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3e6aa3f3-32e5-4a66-8d15-311d439a2b65 None None] MFA Rules not processed for user `d64fc190fac540259444a531cdbb8d53`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:40.790092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3e6aa3f3-32e5-4a66-8d15-311d439a2b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:40.987317 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 679/1355] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Sep 1 16:26:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:44.487948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74c8dd-3d3b-4b1f-9d1f-7ba7fc002e7a None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:44.488571 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74c8dd-3d3b-4b1f-9d1f-7ba7fc002e7a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:44.488571 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74c8dd-3d3b-4b1f-9d1f-7ba7fc002e7a None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:44.490056 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 677/1356] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:44.497544 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0441d-511d-4186-9ce6-59d0ba5d6c11 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:44.498093 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0441d-511d-4186-9ce6-59d0ba5d6c11 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:44.498273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0441d-511d-4186-9ce6-59d0ba5d6c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:44.547958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:44.588338 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4ff0441d-511d-4186-9ce6-59d0ba5d6c11 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:44.589649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4ff0441d-511d-4186-9ce6-59d0ba5d6c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:44.736534 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 680/1357] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:45.138578 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa04b7a-9aa0-460e-8324-98d6cc736134 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:45.138974 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa04b7a-9aa0-460e-8324-98d6cc736134 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:45.139210 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa04b7a-9aa0-460e-8324-98d6cc736134 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:45.141836 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 678/1358] 10.222.0.52 () {54 vars in 962 bytes} [Thu Sep 1 16:26:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:26:45.153580 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b8d84-ef67-402a-aab0-b6f6c3886b16 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:45.154078 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b8d84-ef67-402a-aab0-b6f6c3886b16 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:45.154560 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b8d84-ef67-402a-aab0-b6f6c3886b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:45.264790 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-834b8d84-ef67-402a-aab0-b6f6c3886b16 None None] MFA Rules not processed for user `55f389ab3ea046008b44f129113de995`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:45.266499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-834b8d84-ef67-402a-aab0-b6f6c3886b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:45.329947 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:45.425506 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 681/1359] 10.222.0.52 () {58 vars in 1059 bytes} [Thu Sep 1 16:26:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:45.434316 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa04b7a-9aa0-460e-8324-98d6cc736134 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:45.436029 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5fa04b7a-9aa0-460e-8324-98d6cc736134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:45.619747 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa04b7a-9aa0-460e-8324-98d6cc736134 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:45.714031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:45.767690 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef355b6-44f4-4ca6-b1a1-6372884bb741 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:45.768311 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef355b6-44f4-4ca6-b1a1-6372884bb741 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:45.768580 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef355b6-44f4-4ca6-b1a1-6372884bb741 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:45.768874 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef355b6-44f4-4ca6-b1a1-6372884bb741 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:45.770522 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1ef355b6-44f4-4ca6-b1a1-6372884bb741 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:45.877290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef355b6-44f4-4ca6-b1a1-6372884bb741 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:45.878882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef355b6-44f4-4ca6-b1a1-6372884bb741 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:45.901270 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 679/1360] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:26:48.719950 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0625c-923a-420b-99a0-e297b98563fc None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:48.720729 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0625c-923a-420b-99a0-e297b98563fc None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:48.720729 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0625c-923a-420b-99a0-e297b98563fc None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:48.722310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 682/1361] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:48.728109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea652ec8-6b8b-4257-9252-ca74e4aa5466 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:48.728829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea652ec8-6b8b-4257-9252-ca74e4aa5466 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:48.728829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea652ec8-6b8b-4257-9252-ca74e4aa5466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:48.831690 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ea652ec8-6b8b-4257-9252-ca74e4aa5466 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:48.833183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ea652ec8-6b8b-4257-9252-ca74e4aa5466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:48.886895 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:49.094740 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 680/1362] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:26:49.432792 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0625c-923a-420b-99a0-e297b98563fc None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:49.434895 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-25c0625c-923a-420b-99a0-e297b98563fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:49.758576 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0625c-923a-420b-99a0-e297b98563fc None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:49.773962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:49.949531 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3be92-3911-4bc9-83cb-802d29c0cfa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:49.950785 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3be92-3911-4bc9-83cb-802d29c0cfa8 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:49.951146 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3be92-3911-4bc9-83cb-802d29c0cfa8 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:49.951510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3be92-3911-4bc9-83cb-802d29c0cfa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:49.953346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-83a3be92-3911-4bc9-83cb-802d29c0cfa8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:50.126884 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3be92-3911-4bc9-83cb-802d29c0cfa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:50.128325 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3be92-3911-4bc9-83cb-802d29c0cfa8 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:50.153045 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 683/1363] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 721 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:52.878438 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912aa8a-4b26-4a20-9de2-fa6a469ab97c None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:52.879257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912aa8a-4b26-4a20-9de2-fa6a469ab97c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:52.879257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912aa8a-4b26-4a20-9de2-fa6a469ab97c None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:52.880701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 681/1364] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:26:52.886534 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd88c2-d3ea-41ce-b454-77eb3ef86f9e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:52.887356 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd88c2-d3ea-41ce-b454-77eb3ef86f9e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:52.887356 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd88c2-d3ea-41ce-b454-77eb3ef86f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:52.905220 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:52.984699 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d2dd88c2-d3ea-41ce-b454-77eb3ef86f9e None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:52.986880 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d2dd88c2-d3ea-41ce-b454-77eb3ef86f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:53.127437 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 684/1365] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:26:53.440091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42f017-540e-4582-8cac-31de68e563ea None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:53.440761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42f017-540e-4582-8cac-31de68e563ea None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:53.441354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42f017-540e-4582-8cac-31de68e563ea None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:53.444592 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 682/1366] 10.222.0.52 () {54 vars in 962 bytes} [Thu Sep 1 16:26:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:53.454455 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa1c4b-ffe2-4452-93d4-e30531394b50 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:53.454765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa1c4b-ffe2-4452-93d4-e30531394b50 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:53.455145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa1c4b-ffe2-4452-93d4-e30531394b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:53.571600 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7eaa1c4b-ffe2-4452-93d4-e30531394b50 None None] MFA Rules not processed for user `55f389ab3ea046008b44f129113de995`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:53.573776 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7eaa1c4b-ffe2-4452-93d4-e30531394b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:53.648303 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:53.809918 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 685/1367] 10.222.0.52 () {58 vars in 1059 bytes} [Thu Sep 1 16:26:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:53.823794 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42f017-540e-4582-8cac-31de68e563ea None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:53.826249 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1b42f017-540e-4582-8cac-31de68e563ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:54.064469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42f017-540e-4582-8cac-31de68e563ea None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:54.105748 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:54.296429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef783d-cbb1-4aa1-aec5-9a39efd6cb2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:54.297417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef783d-cbb1-4aa1-aec5-9a39efd6cb2b service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:54.297864 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef783d-cbb1-4aa1-aec5-9a39efd6cb2b service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:54.298300 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef783d-cbb1-4aa1-aec5-9a39efd6cb2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:54.300312 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8cef783d-cbb1-4aa1-aec5-9a39efd6cb2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:54.486279 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef783d-cbb1-4aa1-aec5-9a39efd6cb2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:54.488808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef783d-cbb1-4aa1-aec5-9a39efd6cb2b service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:54.528688 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 683/1368] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:55.057452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9eb3de-171e-4fce-955c-946cbd3dea70 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:55.057953 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9eb3de-171e-4fce-955c-946cbd3dea70 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:55.058443 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9eb3de-171e-4fce-955c-946cbd3dea70 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:55.064216 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 686/1369] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:26:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:55.068699 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb6b95-d1e2-44fd-ae4d-22fc1a860502 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:55.069513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb6b95-d1e2-44fd-ae4d-22fc1a860502 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:55.069513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb6b95-d1e2-44fd-ae4d-22fc1a860502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:55.133513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:55.206491 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-75eb6b95-d1e2-44fd-ae4d-22fc1a860502 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:55.208648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-75eb6b95-d1e2-44fd-ae4d-22fc1a860502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:55.415392 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 684/1370] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:56.321695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a994bed-29dd-41f3-86a7-5c143b44e73d None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:56.322468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a994bed-29dd-41f3-86a7-5c143b44e73d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:56.322468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a994bed-29dd-41f3-86a7-5c143b44e73d None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:56.324144 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 687/1371] 10.222.0.52 () {54 vars in 964 bytes} [Thu Sep 1 16:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:56.333895 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b842550-a0e0-410f-9319-9cc0a2700109 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:56.334505 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b842550-a0e0-410f-9319-9cc0a2700109 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:56.334817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b842550-a0e0-410f-9319-9cc0a2700109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:56.485219 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1b842550-a0e0-410f-9319-9cc0a2700109 None None] MFA Rules not processed for user `80a92eaeb5c54414864deef3052bd8f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:56.486459 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1b842550-a0e0-410f-9319-9cc0a2700109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:56.568861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:56.637044 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 685/1372] 10.222.0.52 () {58 vars in 1061 bytes} [Thu Sep 1 16:26:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:56.654795 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a994bed-29dd-41f3-86a7-5c143b44e73d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:56.660372 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9a994bed-29dd-41f3-86a7-5c143b44e73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:56.708766 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706d51a-d694-4401-b85c-b7a97c5c7c81 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:56.709665 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706d51a-d694-4401-b85c-b7a97c5c7c81 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:56.710210 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706d51a-d694-4401-b85c-b7a97c5c7c81 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:56.712599 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 686/1373] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:26:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:56.719960 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf345f-d22f-430b-9979-21c9e0f61174 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:56.720702 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf345f-d22f-430b-9979-21c9e0f61174 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:56.721345 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf345f-d22f-430b-9979-21c9e0f61174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:56.837019 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5cdf345f-d22f-430b-9979-21c9e0f61174 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:56.839215 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5cdf345f-d22f-430b-9979-21c9e0f61174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:56.881611 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a994bed-29dd-41f3-86a7-5c143b44e73d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:56.932402 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:56.995476 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 687/1374] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:57.005533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7eed9-c5f0-4ca3-a0a4-71fc7c56ae8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:57.006605 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7eed9-c5f0-4ca3-a0a4-71fc7c56ae8d service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:57.007102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7eed9-c5f0-4ca3-a0a4-71fc7c56ae8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:57.007581 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7eed9-c5f0-4ca3-a0a4-71fc7c56ae8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:57.010928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ebe7eed9-c5f0-4ca3-a0a4-71fc7c56ae8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:57.277827 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7eed9-c5f0-4ca3-a0a4-71fc7c56ae8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:57.281197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7eed9-c5f0-4ca3-a0a4-71fc7c56ae8d service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:57.315626 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 688/1375] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:26:57.327616 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf345f-d22f-430b-9979-21c9e0f61174 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:57.329701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5cdf345f-d22f-430b-9979-21c9e0f61174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:57.451177 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:57.752600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf345f-d22f-430b-9979-21c9e0f61174 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:26:57.910588 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90857a13-ab38-42e3-bc7c-8b1d1fdb259f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:26:57.911368 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90857a13-ab38-42e3-bc7c-8b1d1fdb259f service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:57.911656 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90857a13-ab38-42e3-bc7c-8b1d1fdb259f service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:57.912013 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90857a13-ab38-42e3-bc7c-8b1d1fdb259f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:57.914205 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-90857a13-ab38-42e3-bc7c-8b1d1fdb259f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:57.983524 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:58.042715 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90857a13-ab38-42e3-bc7c-8b1d1fdb259f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:26:58.044646 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90857a13-ab38-42e3-bc7c-8b1d1fdb259f service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:26:58.069483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 688/1376] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 744 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:27:00.214703 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbfa5a-9c1b-4a7d-a3b9-cdba632a22ba None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:00.215252 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbfa5a-9c1b-4a7d-a3b9-cdba632a22ba None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:00.215589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbfa5a-9c1b-4a7d-a3b9-cdba632a22ba None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:00.217692 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 689/1377] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:27:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:00.224107 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a9e1a-17df-4582-af48-bdfcba55f60a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:00.224679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a9e1a-17df-4582-af48-bdfcba55f60a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:00.224679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a9e1a-17df-4582-af48-bdfcba55f60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:00.317215 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-719a9e1a-17df-4582-af48-bdfcba55f60a None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:00.318538 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-719a9e1a-17df-4582-af48-bdfcba55f60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:00.449924 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 689/1378] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:00.771489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbfa5a-9c1b-4a7d-a3b9-cdba632a22ba None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:00.773123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-babbfa5a-9c1b-4a7d-a3b9-cdba632a22ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:00.898601 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:01.025976 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbfa5a-9c1b-4a7d-a3b9-cdba632a22ba None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:01.257193 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73c187-530b-40b3-a128-fdb4c4762b1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:01.258234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73c187-530b-40b3-a128-fdb4c4762b1f service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:01.258571 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73c187-530b-40b3-a128-fdb4c4762b1f service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:01.258973 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73c187-530b-40b3-a128-fdb4c4762b1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:01.261596 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1f73c187-530b-40b3-a128-fdb4c4762b1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:01.324223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:01.409570 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73c187-530b-40b3-a128-fdb4c4762b1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:01.411261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73c187-530b-40b3-a128-fdb4c4762b1f service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:01.434281 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 690/1379] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:27:03.640899 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6fe85-47e3-4dea-9555-1fcf2bd6f378 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:03.641471 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6fe85-47e3-4dea-9555-1fcf2bd6f378 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:03.641814 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6fe85-47e3-4dea-9555-1fcf2bd6f378 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:03.644647 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 690/1380] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:27:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:03.652584 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984a1ed-bd67-4775-ae1a-3f3df17af182 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:03.653396 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984a1ed-bd67-4775-ae1a-3f3df17af182 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:03.653396 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984a1ed-bd67-4775-ae1a-3f3df17af182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:03.741096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9984a1ed-bd67-4775-ae1a-3f3df17af182 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:03.741096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9984a1ed-bd67-4775-ae1a-3f3df17af182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:03.888321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 691/1381] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:04.207672 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6fe85-47e3-4dea-9555-1fcf2bd6f378 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:04.209506 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8dd6fe85-47e3-4dea-9555-1fcf2bd6f378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:04.242157 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:04.440505 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6fe85-47e3-4dea-9555-1fcf2bd6f378 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:04.674337 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:04.730516 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73623e2a-9cee-430f-b102-98b3fa3214a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:04.732560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73623e2a-9cee-430f-b102-98b3fa3214a4 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:04.732560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73623e2a-9cee-430f-b102-98b3fa3214a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:04.732560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73623e2a-9cee-430f-b102-98b3fa3214a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:04.744307 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-73623e2a-9cee-430f-b102-98b3fa3214a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:04.935923 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73623e2a-9cee-430f-b102-98b3fa3214a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:04.938922 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73623e2a-9cee-430f-b102-98b3fa3214a4 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:04.979266 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 691/1382] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 772 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:07.632076 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a226f3-2382-4599-bb0c-7f09897b9500 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:07.632976 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a226f3-2382-4599-bb0c-7f09897b9500 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:07.632976 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a226f3-2382-4599-bb0c-7f09897b9500 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:07.634207 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 692/1383] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:07.644161 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb75e76-1e5d-4c80-aca4-786cc7e73d8a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:07.644893 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb75e76-1e5d-4c80-aca4-786cc7e73d8a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:07.644893 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb75e76-1e5d-4c80-aca4-786cc7e73d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:07.729552 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-cbb75e76-1e5d-4c80-aca4-786cc7e73d8a None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:07.730798 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cbb75e76-1e5d-4c80-aca4-786cc7e73d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:07.805422 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:07.863904 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 692/1384] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:08.342019 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a226f3-2382-4599-bb0c-7f09897b9500 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:08.344504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f8a226f3-2382-4599-bb0c-7f09897b9500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:08.362841 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:08.644957 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a226f3-2382-4599-bb0c-7f09897b9500 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:08.781848 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:08.827069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09717d12-7eed-44bb-a953-bdad3c5ded4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:08.828932 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09717d12-7eed-44bb-a953-bdad3c5ded4e service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:08.829321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09717d12-7eed-44bb-a953-bdad3c5ded4e service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:08.829645 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09717d12-7eed-44bb-a953-bdad3c5ded4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:08.831982 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-09717d12-7eed-44bb-a953-bdad3c5ded4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:08.981124 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09717d12-7eed-44bb-a953-bdad3c5ded4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:08.983133 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09717d12-7eed-44bb-a953-bdad3c5ded4e service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:09.009558 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 693/1385] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:11.467692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd201f-ab00-41dd-a2e9-f92bd35123ec None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:11.468556 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd201f-ab00-41dd-a2e9-f92bd35123ec None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:11.469249 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd201f-ab00-41dd-a2e9-f92bd35123ec None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:11.471523 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 693/1386] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:27:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:11.477868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a155453-8423-4252-990c-0e00e1af0401 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:11.478570 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a155453-8423-4252-990c-0e00e1af0401 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:11.478570 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a155453-8423-4252-990c-0e00e1af0401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:11.564668 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8a155453-8423-4252-990c-0e00e1af0401 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:11.566267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8a155453-8423-4252-990c-0e00e1af0401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:11.632274 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:11.699641 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 694/1387] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:27:12.025453 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd201f-ab00-41dd-a2e9-f92bd35123ec None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:12.027477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7abd201f-ab00-41dd-a2e9-f92bd35123ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:12.282991 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd201f-ab00-41dd-a2e9-f92bd35123ec None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:12.345961 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:12.471707 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf40806-b17b-4896-8532-fcbf9a0f8d2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:12.472683 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf40806-b17b-4896-8532-fcbf9a0f8d2b service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:12.472683 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf40806-b17b-4896-8532-fcbf9a0f8d2b service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:12.472991 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf40806-b17b-4896-8532-fcbf9a0f8d2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:12.475034 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fdf40806-b17b-4896-8532-fcbf9a0f8d2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:12.636355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf40806-b17b-4896-8532-fcbf9a0f8d2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:12.637998 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf40806-b17b-4896-8532-fcbf9a0f8d2b service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:12.660415 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 694/1388] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:14.966513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31653ffa-dc61-4d4c-8951-6d52472558c3 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:14.967252 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31653ffa-dc61-4d4c-8951-6d52472558c3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:14.967252 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31653ffa-dc61-4d4c-8951-6d52472558c3 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:14.969367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 695/1389] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:27:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:27:14.976787 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfb3f9-8d65-4c59-9cdf-d5b5a73a49d9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:14.977615 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfb3f9-8d65-4c59-9cdf-d5b5a73a49d9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:14.977615 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfb3f9-8d65-4c59-9cdf-d5b5a73a49d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:15.087626 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:15.099531 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-92dfb3f9-8d65-4c59-9cdf-d5b5a73a49d9 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:15.100868 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-92dfb3f9-8d65-4c59-9cdf-d5b5a73a49d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:15.244519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 695/1390] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:15.564493 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31653ffa-dc61-4d4c-8951-6d52472558c3 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:15.566595 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-31653ffa-dc61-4d4c-8951-6d52472558c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:15.782763 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31653ffa-dc61-4d4c-8951-6d52472558c3 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:15.832224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:15.974438 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4beb6d-9264-4ade-9683-ff0c9ffe1b13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:15.975465 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4beb6d-9264-4ade-9683-ff0c9ffe1b13 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:15.975911 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4beb6d-9264-4ade-9683-ff0c9ffe1b13 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:15.976311 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4beb6d-9264-4ade-9683-ff0c9ffe1b13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:15.978751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3c4beb6d-9264-4ade-9683-ff0c9ffe1b13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:16.128184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4beb6d-9264-4ade-9683-ff0c9ffe1b13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:16.131362 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4beb6d-9264-4ade-9683-ff0c9ffe1b13 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:16.170978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 696/1391] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:18.320398 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcf18a-547d-4837-b1c1-5c5068149da1 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:18.321173 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcf18a-547d-4837-b1c1-5c5068149da1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:18.321770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcf18a-547d-4837-b1c1-5c5068149da1 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:18.324659 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 696/1392] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:27:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:18.331224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93dc9af-2a93-40fd-9196-47a432f19908 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:18.332073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93dc9af-2a93-40fd-9196-47a432f19908 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:18.332073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93dc9af-2a93-40fd-9196-47a432f19908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:18.399724 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:18.439201 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b93dc9af-2a93-40fd-9196-47a432f19908 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:18.441337 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b93dc9af-2a93-40fd-9196-47a432f19908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:18.621285 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 697/1393] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:27:18.953981 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcf18a-547d-4837-b1c1-5c5068149da1 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:18.957147 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b1fcf18a-547d-4837-b1c1-5c5068149da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:19.135168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:19.171241 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcf18a-547d-4837-b1c1-5c5068149da1 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:19.358960 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590932c5-4820-42e2-b778-e850b683c0a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:19.360004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590932c5-4820-42e2-b778-e850b683c0a4 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:19.361098 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590932c5-4820-42e2-b778-e850b683c0a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:19.361604 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590932c5-4820-42e2-b778-e850b683c0a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:19.365101 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-590932c5-4820-42e2-b778-e850b683c0a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:19.513637 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:19.516076 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590932c5-4820-42e2-b778-e850b683c0a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:19.517887 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590932c5-4820-42e2-b778-e850b683c0a4 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:19.556746 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 697/1394] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:27:19.880009 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7383b7d-5ccf-47ec-af18-620dbae66281 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:19.880673 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7383b7d-5ccf-47ec-af18-620dbae66281 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:19.880856 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7383b7d-5ccf-47ec-af18-620dbae66281 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:19.883331 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 698/1395] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:27:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:19.892896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d6e85-6a18-465b-bd1f-f4249feee4cc None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:19.893303 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d6e85-6a18-465b-bd1f-f4249feee4cc None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:19.893677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d6e85-6a18-465b-bd1f-f4249feee4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:20.009466 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8c7d6e85-6a18-465b-bd1f-f4249feee4cc None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:20.011660 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8c7d6e85-6a18-465b-bd1f-f4249feee4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:20.191149 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 698/1396] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:20.543640 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add8ea0-8ca5-4a78-9aa8-4915515f101d None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:20.543971 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add8ea0-8ca5-4a78-9aa8-4915515f101d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:20.544292 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add8ea0-8ca5-4a78-9aa8-4915515f101d None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:20.546066 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 699/1397] 10.222.0.52 () {54 vars in 967 bytes} [Thu Sep 1 16:27:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:27:20.552939 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f520a88-8636-4c0c-ab97-ef50a89e0e48 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:20.553800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f520a88-8636-4c0c-ab97-ef50a89e0e48 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:20.554019 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f520a88-8636-4c0c-ab97-ef50a89e0e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:20.665179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9f520a88-8636-4c0c-ab97-ef50a89e0e48 None None] MFA Rules not processed for user `c2feb3132ad9497aaae8720ed170ef3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:20.666444 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9f520a88-8636-4c0c-ab97-ef50a89e0e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:20.675709 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:20.792520 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 699/1398] 10.222.0.52 () {58 vars in 1064 bytes} [Thu Sep 1 16:27:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:20.802322 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add8ea0-8ca5-4a78-9aa8-4915515f101d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:20.804223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1add8ea0-8ca5-4a78-9aa8-4915515f101d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:20.980726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add8ea0-8ca5-4a78-9aa8-4915515f101d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:20.997145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:21.087003 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48f108-7e28-4725-939d-d13f90d83db8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2feb3132ad9497aaae8720ed170ef3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:21.087953 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48f108-7e28-4725-939d-d13f90d83db8 service glance] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:21.088406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48f108-7e28-4725-939d-d13f90d83db8 service glance] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:21.088836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48f108-7e28-4725-939d-d13f90d83db8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:21.090859 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fe48f108-7e28-4725-939d-d13f90d83db8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:21.245323 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48f108-7e28-4725-939d-d13f90d83db8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:21.246907 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48f108-7e28-4725-939d-d13f90d83db8 service glance] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:21.269950 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 700/1399] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:27:22.116968 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e6b97-825d-4721-9d46-6dd107b82e15 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:22.117655 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e6b97-825d-4721-9d46-6dd107b82e15 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:22.117655 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e6b97-825d-4721-9d46-6dd107b82e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:22.212078 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-412e6b97-825d-4721-9d46-6dd107b82e15 None None] MFA Rules not processed for user `3c001a902faf4b3c8d8f23f2e017c706`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:22.213533 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-412e6b97-825d-4721-9d46-6dd107b82e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:22.334520 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 700/1400] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 1 16:27:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:22.387237 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ac9e6-a621-40dc-b0bf-939ab08cd46c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:22.388034 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ac9e6-a621-40dc-b0bf-939ab08cd46c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:22.388034 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ac9e6-a621-40dc-b0bf-939ab08cd46c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:22.389411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 701/1401] 10.222.0.52 () {54 vars in 943 bytes} [Thu Sep 1 16:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:22.396594 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26b295-5475-41d9-bbaf-632ae774c295 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:22.396978 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26b295-5475-41d9-bbaf-632ae774c295 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:22.397223 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26b295-5475-41d9-bbaf-632ae774c295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:22.428683 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:22.494519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1d26b295-5475-41d9-bbaf-632ae774c295 None None] MFA Rules not processed for user `748e35d9a1534920860b2234d45f6724`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:22.495815 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1d26b295-5475-41d9-bbaf-632ae774c295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:22.549233 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277f5b4-46d5-44e6-9841-367cbc917c05 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:22.549679 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277f5b4-46d5-44e6-9841-367cbc917c05 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:22.550159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277f5b4-46d5-44e6-9841-367cbc917c05 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:22.552613 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 702/1402] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:27:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:27:22.560289 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b72fe-911a-4754-be93-8509a6d8e2e2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:22.560793 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b72fe-911a-4754-be93-8509a6d8e2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:22.561261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b72fe-911a-4754-be93-8509a6d8e2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:22.633763 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:22.646248 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 701/1403] 10.222.0.52 () {58 vars in 1040 bytes} [Thu Sep 1 16:27:22 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:27:22.655558 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-488b72fe-911a-4754-be93-8509a6d8e2e2 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:22.657186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-488b72fe-911a-4754-be93-8509a6d8e2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:22.658556 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26b295-5475-41d9-bbaf-632ae774c295 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:22.670712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26b295-5475-41d9-bbaf-632ae774c295 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:22.787795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:22.821931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 703/1404] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:22.839887 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7907e3-98ba-4d43-973f-494443608508 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748e35d9a1534920860b2234d45f6724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:22.840679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7907e3-98ba-4d43-973f-494443608508 service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:22.841180 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7907e3-98ba-4d43-973f-494443608508 service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:22.841595 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7907e3-98ba-4d43-973f-494443608508 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:22.844044 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9d7907e3-98ba-4d43-973f-494443608508 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:22.977001 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7907e3-98ba-4d43-973f-494443608508 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:22.979534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7907e3-98ba-4d43-973f-494443608508 service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:22.995501 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 702/1405] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 1 16:27:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 16:27:23.178338 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b72fe-911a-4754-be93-8509a6d8e2e2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:23.180853 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-488b72fe-911a-4754-be93-8509a6d8e2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:23.408917 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b72fe-911a-4754-be93-8509a6d8e2e2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:23.437243 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:23.632851 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01e673-9533-4ba8-9277-5199b99fbc2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:23.634120 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01e673-9533-4ba8-9277-5199b99fbc2d service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:23.634520 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01e673-9533-4ba8-9277-5199b99fbc2d service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:23.634937 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01e673-9533-4ba8-9277-5199b99fbc2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:23.638129 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4a01e673-9533-4ba8-9277-5199b99fbc2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:23.834622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a01e673-9533-4ba8-9277-5199b99fbc2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:23.836832 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a01e673-9533-4ba8-9277-5199b99fbc2d service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:23.860528 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 704/1406] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:26.569379 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92e9a0-ef32-4663-b752-b216895c0117 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:26.571952 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92e9a0-ef32-4663-b752-b216895c0117 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:26.572916 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92e9a0-ef32-4663-b752-b216895c0117 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:26.576067 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 703/1407] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:27:26 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:26.583284 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899d442-05bf-4889-87f9-d0467d88f44d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:26.584792 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899d442-05bf-4889-87f9-d0467d88f44d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:26.585622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899d442-05bf-4889-87f9-d0467d88f44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:26.626691 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:26.708576 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a899d442-05bf-4889-87f9-d0467d88f44d None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:26.709937 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a899d442-05bf-4889-87f9-d0467d88f44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:26.886041 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 705/1408] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:27.220008 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92e9a0-ef32-4663-b752-b216895c0117 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:27.221748 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-bf92e9a0-ef32-4663-b752-b216895c0117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:27.418206 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:27.503252 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92e9a0-ef32-4663-b752-b216895c0117 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:27.694690 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e523050-5ab9-4bc8-b4a9-e9855c4e0568 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:27.696291 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e523050-5ab9-4bc8-b4a9-e9855c4e0568 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:27.696894 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e523050-5ab9-4bc8-b4a9-e9855c4e0568 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:27.697126 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e523050-5ab9-4bc8-b4a9-e9855c4e0568 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:27.698921 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0e523050-5ab9-4bc8-b4a9-e9855c4e0568 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:27.793063 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:27.817342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e523050-5ab9-4bc8-b4a9-e9855c4e0568 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:27.819100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e523050-5ab9-4bc8-b4a9-e9855c4e0568 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:27.852929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 704/1409] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:36.883731 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=58 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:37.839236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=14 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:48.960015 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3eb54-494b-455b-9a52-271aa4a7229f None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:48.960576 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3eb54-494b-455b-9a52-271aa4a7229f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:48.960576 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3eb54-494b-455b-9a52-271aa4a7229f None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:48.962005 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 706/1410] 10.222.0.52 () {54 vars in 918 bytes} [Thu Sep 1 16:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:48.967948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e3441-d56c-47ce-a5da-fcb05a824f5c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:48.968521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e3441-d56c-47ce-a5da-fcb05a824f5c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:48.968521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e3441-d56c-47ce-a5da-fcb05a824f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:49.062332 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-304e3441-d56c-47ce-a5da-fcb05a824f5c None None] MFA Rules not processed for user `d64fc190fac540259444a531cdbb8d53`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:49.063616 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-304e3441-d56c-47ce-a5da-fcb05a824f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:49.194177 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 705/1411] 10.222.0.52 () {58 vars in 1015 bytes} [Thu Sep 1 16:27:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:49.210626 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcc85c-db24-43ee-b181-3171946a0bed None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:49.210913 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcc85c-db24-43ee-b181-3171946a0bed None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:49.211197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcc85c-db24-43ee-b181-3171946a0bed None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:49.212598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 707/1412] 10.222.0.52 () {54 vars in 918 bytes} [Thu Sep 1 16:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:49.218400 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbccc98-9ee1-4c63-b646-2b38c038f444 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:49.218723 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbccc98-9ee1-4c63-b646-2b38c038f444 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:49.219001 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbccc98-9ee1-4c63-b646-2b38c038f444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:49.312194 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:49.315253 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-bbbccc98-9ee1-4c63-b646-2b38c038f444 None None] MFA Rules not processed for user `55f389ab3ea046008b44f129113de995`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:49.317978 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-bbbccc98-9ee1-4c63-b646-2b38c038f444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:49.451928 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 706/1413] 10.222.0.52 () {58 vars in 1015 bytes} [Thu Sep 1 16:27:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:53.328239 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37b161-7725-43ea-a0b8-6f8c10d8e180 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:53.328876 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37b161-7725-43ea-a0b8-6f8c10d8e180 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:53.328876 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37b161-7725-43ea-a0b8-6f8c10d8e180 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:53.330166 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:53.337140 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d548c7b-0b42-48a0-9b90-8ba73a6e06c4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:53.337933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d548c7b-0b42-48a0-9b90-8ba73a6e06c4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:53.337933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d548c7b-0b42-48a0-9b90-8ba73a6e06c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:53.418735 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9d548c7b-0b42-48a0-9b90-8ba73a6e06c4 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:53.419986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9d548c7b-0b42-48a0-9b90-8ba73a6e06c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:53.486432 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:53.536220 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:53.838393 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37b161-7725-43ea-a0b8-6f8c10d8e180 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:53.841741 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4e37b161-7725-43ea-a0b8-6f8c10d8e180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:54.072307 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37b161-7725-43ea-a0b8-6f8c10d8e180 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:54.170004 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:54.221344 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52950d-6c4c-44dc-be0b-c7fe30ef3048 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:54.221978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52950d-6c4c-44dc-be0b-c7fe30ef3048 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:54.222259 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52950d-6c4c-44dc-be0b-c7fe30ef3048 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:54.223065 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52950d-6c4c-44dc-be0b-c7fe30ef3048 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:54.224870 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fe52950d-6c4c-44dc-be0b-c7fe30ef3048 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:54.336144 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe52950d-6c4c-44dc-be0b-c7fe30ef3048 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:54.337826 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe52950d-6c4c-44dc-be0b-c7fe30ef3048 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:54.360040 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 709/1416] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:27:55.625107 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5f1d4-ed7e-4e35-9b7b-2c453ab817da None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:55.625858 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5f1d4-ed7e-4e35-9b7b-2c453ab817da None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:55.625858 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5f1d4-ed7e-4e35-9b7b-2c453ab817da None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:55.627151 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:27:55.633700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa935e-27ce-416e-952e-28fcf47561d6 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:55.634792 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa935e-27ce-416e-952e-28fcf47561d6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:55.634792 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa935e-27ce-416e-952e-28fcf47561d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:55.724868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-92fa935e-27ce-416e-952e-28fcf47561d6 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:55.726144 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-92fa935e-27ce-416e-952e-28fcf47561d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:55.760531 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:55.851604 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:27:56.012918 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5f1d4-ed7e-4e35-9b7b-2c453ab817da None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:56.014607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-92a5f1d4-ed7e-4e35-9b7b-2c453ab817da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:56.193882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5f1d4-ed7e-4e35-9b7b-2c453ab817da None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:56.241704 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:56.371672 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b3f3b-2e19-4772-a32e-72b3aa4fa66f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:56.372592 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b3f3b-2e19-4772-a32e-72b3aa4fa66f service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:56.373120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b3f3b-2e19-4772-a32e-72b3aa4fa66f service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:56.373593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b3f3b-2e19-4772-a32e-72b3aa4fa66f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:56.376806 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-469b3f3b-2e19-4772-a32e-72b3aa4fa66f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:56.512671 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b3f3b-2e19-4772-a32e-72b3aa4fa66f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:56.514473 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b3f3b-2e19-4772-a32e-72b3aa4fa66f service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:56.536484 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 709/1419] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:57.789806 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeadae8-0eef-45c0-98f6-a9f2ac5c1da5 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:57.790672 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeadae8-0eef-45c0-98f6-a9f2ac5c1da5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:57.790672 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeadae8-0eef-45c0-98f6-a9f2ac5c1da5 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:57.791741 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:27:57.797642 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ad084-5340-414d-8b68-1b61c058147b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:57.798389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ad084-5340-414d-8b68-1b61c058147b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:57.798389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ad084-5340-414d-8b68-1b61c058147b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:57.863361 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:57.891046 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-486ad084-5340-414d-8b68-1b61c058147b None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:57.892514 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-486ad084-5340-414d-8b68-1b61c058147b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:58.037500 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:27:58.308009 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeadae8-0eef-45c0-98f6-a9f2ac5c1da5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:58.309845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cdeadae8-0eef-45c0-98f6-a9f2ac5c1da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:58.580335 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeadae8-0eef-45c0-98f6-a9f2ac5c1da5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:58.605074 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:58.749205 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065473b-5e51-45e2-8db8-d369009b1383 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:58.750040 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065473b-5e51-45e2-8db8-d369009b1383 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:58.750396 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065473b-5e51-45e2-8db8-d369009b1383 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:58.750777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065473b-5e51-45e2-8db8-d369009b1383 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:58.754871 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1065473b-5e51-45e2-8db8-d369009b1383 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:58.870574 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065473b-5e51-45e2-8db8-d369009b1383 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:58.872132 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065473b-5e51-45e2-8db8-d369009b1383 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:58.894587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 712/1422] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:59.869923 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82199399-e0ed-4645-9cdf-b71d4e7dcda4 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:59.870819 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82199399-e0ed-4645-9cdf-b71d4e7dcda4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:59.870819 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82199399-e0ed-4645-9cdf-b71d4e7dcda4 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:59.871948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:27:59.877920 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb559f-ddc9-4e31-bf5f-82da40cd5052 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:59.878511 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb559f-ddc9-4e31-bf5f-82da40cd5052 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:59.878511 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb559f-ddc9-4e31-bf5f-82da40cd5052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:59.901866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:59.970477 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-cecb559f-ddc9-4e31-bf5f-82da40cd5052 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:59.971736 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cecb559f-ddc9-4e31-bf5f-82da40cd5052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:00.095006 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:28:00.253136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82199399-e0ed-4645-9cdf-b71d4e7dcda4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:00.255131 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-82199399-e0ed-4645-9cdf-b71d4e7dcda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:00.393543 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:00.439918 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82199399-e0ed-4645-9cdf-b71d4e7dcda4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:00.584987 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627034d-16ba-41e6-b5b6-53ecd2b09c38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:00.585649 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627034d-16ba-41e6-b5b6-53ecd2b09c38 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:00.585971 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627034d-16ba-41e6-b5b6-53ecd2b09c38 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:00.586283 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627034d-16ba-41e6-b5b6-53ecd2b09c38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:00.588168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5627034d-16ba-41e6-b5b6-53ecd2b09c38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:00.686928 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:00.703783 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627034d-16ba-41e6-b5b6-53ecd2b09c38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:00.705583 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627034d-16ba-41e6-b5b6-53ecd2b09c38 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:00.728362 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 712/1425] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:28:01.665029 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfae839-9c95-4e7a-a1e3-a64f982cc1de None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:01.665680 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfae839-9c95-4e7a-a1e3-a64f982cc1de None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:01.665680 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfae839-9c95-4e7a-a1e3-a64f982cc1de None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:01.667206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:01.673144 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9366c2-8839-4f3f-80a5-6983faccf33c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:01.673739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9366c2-8839-4f3f-80a5-6983faccf33c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:01.673739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9366c2-8839-4f3f-80a5-6983faccf33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:01.770457 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-7e9366c2-8839-4f3f-80a5-6983faccf33c None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:01.771758 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7e9366c2-8839-4f3f-80a5-6983faccf33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:01.903404 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:02.069289 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfae839-9c95-4e7a-a1e3-a64f982cc1de None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:02.070988 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cdfae839-9c95-4e7a-a1e3-a64f982cc1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:02.175715 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:02.250921 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfae839-9c95-4e7a-a1e3-a64f982cc1de None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:02.387008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54d38a-1d70-4f84-b9ee-94bdc8af3c84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:02.387540 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54d38a-1d70-4f84-b9ee-94bdc8af3c84 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:02.387821 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54d38a-1d70-4f84-b9ee-94bdc8af3c84 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:02.388105 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54d38a-1d70-4f84-b9ee-94bdc8af3c84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:02.389850 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ee54d38a-1d70-4f84-b9ee-94bdc8af3c84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:02.448808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:02.500244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54d38a-1d70-4f84-b9ee-94bdc8af3c84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:02.501934 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54d38a-1d70-4f84-b9ee-94bdc8af3c84 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:02.523737 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 715/1428] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:28:03.415201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6435f-8ae8-465a-ad7d-3dc4a5bcc690 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:03.416015 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6435f-8ae8-465a-ad7d-3dc4a5bcc690 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:03.416015 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6435f-8ae8-465a-ad7d-3dc4a5bcc690 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:03.418004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:28:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:03.425338 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff6b41-1743-4b7a-8cb5-ce192567efa9 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:03.425936 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff6b41-1743-4b7a-8cb5-ce192567efa9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:03.426084 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff6b41-1743-4b7a-8cb5-ce192567efa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:03.512854 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5fff6b41-1743-4b7a-8cb5-ce192567efa9 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:03.514123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5fff6b41-1743-4b7a-8cb5-ce192567efa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:03.624829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:03.784546 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6435f-8ae8-465a-ad7d-3dc4a5bcc690 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:03.786896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c6e6435f-8ae8-465a-ad7d-3dc4a5bcc690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:03.842844 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:03.956019 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6435f-8ae8-465a-ad7d-3dc4a5bcc690 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:04.104081 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5074d-e2ef-44ba-8c15-d986dcc5d27c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:04.104809 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5074d-e2ef-44ba-8c15-d986dcc5d27c service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:04.105144 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5074d-e2ef-44ba-8c15-d986dcc5d27c service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:04.105459 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5074d-e2ef-44ba-8c15-d986dcc5d27c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:04.107193 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5fa5074d-e2ef-44ba-8c15-d986dcc5d27c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:04.115745 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:04.217381 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5074d-e2ef-44ba-8c15-d986dcc5d27c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:04.219014 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5074d-e2ef-44ba-8c15-d986dcc5d27c service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:04.240818 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 715/1431] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:28:05.128025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01259fc1-098b-44fa-9b18-688dda48641f None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:05.128660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01259fc1-098b-44fa-9b18-688dda48641f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:05.128660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01259fc1-098b-44fa-9b18-688dda48641f None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:05.130424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:05.136248 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2913350-ed61-46ce-b275-5b3974994f1d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:05.136862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2913350-ed61-46ce-b275-5b3974994f1d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:05.136862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2913350-ed61-46ce-b275-5b3974994f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:05.228506 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b2913350-ed61-46ce-b275-5b3974994f1d None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:05.229994 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b2913350-ed61-46ce-b275-5b3974994f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:05.310469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:05.347238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:05.504412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01259fc1-098b-44fa-9b18-688dda48641f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:05.506270 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-01259fc1-098b-44fa-9b18-688dda48641f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:05.525779 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:05.687944 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01259fc1-098b-44fa-9b18-688dda48641f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:05.787855 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:05.828013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb48b1-2446-4420-9f1b-dd17cff0c836 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:05.828888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb48b1-2446-4420-9f1b-dd17cff0c836 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:05.829340 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb48b1-2446-4420-9f1b-dd17cff0c836 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:05.829706 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb48b1-2446-4420-9f1b-dd17cff0c836 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:05.831712 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-edeb48b1-2446-4420-9f1b-dd17cff0c836 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:05.950528 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb48b1-2446-4420-9f1b-dd17cff0c836 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:05.952070 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb48b1-2446-4420-9f1b-dd17cff0c836 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:05.973265 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 718/1434] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:28:06.822844 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1f430-8d39-44c3-b6d2-6fe027287294 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:06.823533 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1f430-8d39-44c3-b6d2-6fe027287294 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:06.823533 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1f430-8d39-44c3-b6d2-6fe027287294 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:06.824964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:06.830967 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e857f13-26bb-43b3-a821-0d5130b54182 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:06.831534 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e857f13-26bb-43b3-a821-0d5130b54182 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:06.831814 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e857f13-26bb-43b3-a821-0d5130b54182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:06.929012 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5e857f13-26bb-43b3-a821-0d5130b54182 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:06.930634 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5e857f13-26bb-43b3-a821-0d5130b54182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:06.980751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:07.048151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:28:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:07.205869 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1f430-8d39-44c3-b6d2-6fe027287294 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:07.207413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-77f1f430-8d39-44c3-b6d2-6fe027287294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:07.388466 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1f430-8d39-44c3-b6d2-6fe027287294 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:07.458183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:07.529448 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fb541-c69e-4b0f-ad04-047d1443cb74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:07.530067 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fb541-c69e-4b0f-ad04-047d1443cb74 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:07.530374 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fb541-c69e-4b0f-ad04-047d1443cb74 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:07.530641 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fb541-c69e-4b0f-ad04-047d1443cb74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:07.532306 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-925fb541-c69e-4b0f-ad04-047d1443cb74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:07.642760 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fb541-c69e-4b0f-ad04-047d1443cb74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:07.644494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fb541-c69e-4b0f-ad04-047d1443cb74 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:07.667298 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 718/1437] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:28:08.542172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62075c5c-c643-43da-a8f0-81bf2465d1af None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:08.542863 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62075c5c-c643-43da-a8f0-81bf2465d1af None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:08.542863 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62075c5c-c643-43da-a8f0-81bf2465d1af None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:08.544121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:08.549777 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f0632-698e-4ae4-bf84-a87ee74ec558 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:08.550660 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f0632-698e-4ae4-bf84-a87ee74ec558 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:08.550660 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f0632-698e-4ae4-bf84-a87ee74ec558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:08.640975 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5d5f0632-698e-4ae4-bf84-a87ee74ec558 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:08.642336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5d5f0632-698e-4ae4-bf84-a87ee74ec558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:08.644999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:08.762430 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:08.920162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62075c5c-c643-43da-a8f0-81bf2465d1af None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:08.921727 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-62075c5c-c643-43da-a8f0-81bf2465d1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:09.099844 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62075c5c-c643-43da-a8f0-81bf2465d1af None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:09.133175 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:09.239546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab66bd6-6f5b-46f4-8012-90df2826a1d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:09.240170 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab66bd6-6f5b-46f4-8012-90df2826a1d6 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:09.240515 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab66bd6-6f5b-46f4-8012-90df2826a1d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:09.240770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab66bd6-6f5b-46f4-8012-90df2826a1d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:09.242657 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cab66bd6-6f5b-46f4-8012-90df2826a1d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:09.354142 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab66bd6-6f5b-46f4-8012-90df2826a1d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:09.355797 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab66bd6-6f5b-46f4-8012-90df2826a1d6 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:09.377513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 721/1440] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:28:11.335117 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cb864-0264-4584-b34a-c1da87a9610d None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:11.335785 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cb864-0264-4584-b34a-c1da87a9610d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:11.335911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cb864-0264-4584-b34a-c1da87a9610d None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:11.338495 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:28:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:11.344973 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab455726-2c16-4be2-bcc2-4505569e6213 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:11.346042 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab455726-2c16-4be2-bcc2-4505569e6213 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:11.346042 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab455726-2c16-4be2-bcc2-4505569e6213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:11.396528 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:11.429770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ab455726-2c16-4be2-bcc2-4505569e6213 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:11.431059 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ab455726-2c16-4be2-bcc2-4505569e6213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:11.559589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:11.851945 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91cb864-0264-4584-b34a-c1da87a9610d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:11.854882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e91cb864-0264-4584-b34a-c1da87a9610d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:12.023663 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91cb864-0264-4584-b34a-c1da87a9610d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:12.074848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:12.126795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421b0de-8101-4d4b-9906-8f7d8468046c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:12.127472 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421b0de-8101-4d4b-9906-8f7d8468046c service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:12.127795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421b0de-8101-4d4b-9906-8f7d8468046c service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:12.128112 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421b0de-8101-4d4b-9906-8f7d8468046c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:12.130217 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4421b0de-8101-4d4b-9906-8f7d8468046c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:12.264474 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421b0de-8101-4d4b-9906-8f7d8468046c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:12.265991 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421b0de-8101-4d4b-9906-8f7d8468046c service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:12.289361 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 721/1443] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:28:14.578701 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17836331-a931-4670-8f7d-4f60a56dabb7 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:14.579257 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17836331-a931-4670-8f7d-4f60a56dabb7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:14.579681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17836331-a931-4670-8f7d-4f60a56dabb7 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:14.582248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:28:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:14.589335 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116c346-761b-40e5-9bce-5e197325bbd7 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:14.590147 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116c346-761b-40e5-9bce-5e197325bbd7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:14.590335 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116c346-761b-40e5-9bce-5e197325bbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:14.673897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-7116c346-761b-40e5-9bce-5e197325bbd7 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:14.675199 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7116c346-761b-40e5-9bce-5e197325bbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:14.691510 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:14.795194 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:15.092739 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17836331-a931-4670-8f7d-4f60a56dabb7 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:15.094546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-17836331-a931-4670-8f7d-4f60a56dabb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:15.235547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17836331-a931-4670-8f7d-4f60a56dabb7 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:15.252823 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:15.331611 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3229679-ea91-49be-ac43-51cd1b78d0ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:15.332130 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3229679-ea91-49be-ac43-51cd1b78d0ee service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:15.332407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3229679-ea91-49be-ac43-51cd1b78d0ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:15.332708 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3229679-ea91-49be-ac43-51cd1b78d0ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:15.335017 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b3229679-ea91-49be-ac43-51cd1b78d0ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:15.475730 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3229679-ea91-49be-ac43-51cd1b78d0ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:15.477255 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3229679-ea91-49be-ac43-51cd1b78d0ee service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:15.499323 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 724/1446] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:28:18.230911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea6b76-87fe-4145-89cc-73297a51070b None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:18.231502 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea6b76-87fe-4145-89cc-73297a51070b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:18.231502 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea6b76-87fe-4145-89cc-73297a51070b None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:18.232916 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:18.239035 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c610f05-62e3-4dea-a54a-69beee67febc None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:18.239620 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c610f05-62e3-4dea-a54a-69beee67febc None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:18.239799 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c610f05-62e3-4dea-a54a-69beee67febc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:18.303788 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:18.326003 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0c610f05-62e3-4dea-a54a-69beee67febc None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:18.327281 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0c610f05-62e3-4dea-a54a-69beee67febc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:18.448978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:18.760345 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea6b76-87fe-4145-89cc-73297a51070b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:18.761957 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-92ea6b76-87fe-4145-89cc-73297a51070b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:18.891415 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea6b76-87fe-4145-89cc-73297a51070b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:18.939367 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:18.999252 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709332ac-1df9-4ab5-9296-7f78266ed166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:19.000286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709332ac-1df9-4ab5-9296-7f78266ed166 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:19.000842 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709332ac-1df9-4ab5-9296-7f78266ed166 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:19.001329 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709332ac-1df9-4ab5-9296-7f78266ed166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:19.004692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-709332ac-1df9-4ab5-9296-7f78266ed166 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:19.161893 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709332ac-1df9-4ab5-9296-7f78266ed166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:19.163582 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709332ac-1df9-4ab5-9296-7f78266ed166 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:19.187195 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 724/1449] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:28:21.373720 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9a664-c4d0-4a1d-a05e-d49b4b8680b6 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:21.374560 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9a664-c4d0-4a1d-a05e-d49b4b8680b6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:21.374560 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9a664-c4d0-4a1d-a05e-d49b4b8680b6 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:21.375533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:21.382440 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c3a5e-481f-48a4-be77-4f4f6d40f9c9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:21.382980 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c3a5e-481f-48a4-be77-4f4f6d40f9c9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:21.383098 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c3a5e-481f-48a4-be77-4f4f6d40f9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:21.457721 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-113c3a5e-481f-48a4-be77-4f4f6d40f9c9 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:21.459486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-113c3a5e-481f-48a4-be77-4f4f6d40f9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:21.483475 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:21.580840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:28:21.879029 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9a664-c4d0-4a1d-a05e-d49b4b8680b6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:21.881439 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fab9a664-c4d0-4a1d-a05e-d49b4b8680b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:22.038367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9a664-c4d0-4a1d-a05e-d49b4b8680b6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:22.082979 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:22.156511 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a196f5-28b5-4c37-b070-7f5689f60e8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:22.157034 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a196f5-28b5-4c37-b070-7f5689f60e8c service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:22.157314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a196f5-28b5-4c37-b070-7f5689f60e8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:22.157585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a196f5-28b5-4c37-b070-7f5689f60e8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:22.159321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b6a196f5-28b5-4c37-b070-7f5689f60e8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:22.293361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a196f5-28b5-4c37-b070-7f5689f60e8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:22.294947 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a196f5-28b5-4c37-b070-7f5689f60e8c service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:22.317066 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 727/1452] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:28:24.718809 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838466a-e4d9-41ff-825c-486415475b86 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:24.719499 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838466a-e4d9-41ff-825c-486415475b86 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:24.719499 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838466a-e4d9-41ff-825c-486415475b86 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:24.720818 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:28:24.727663 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc533e-ae69-43ea-b71d-81e3c3c4016e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:24.728268 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc533e-ae69-43ea-b71d-81e3c3c4016e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:24.728268 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc533e-ae69-43ea-b71d-81e3c3c4016e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:24.806699 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:24.810825 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-07bc533e-ae69-43ea-b71d-81e3c3c4016e None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:24.812321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-07bc533e-ae69-43ea-b71d-81e3c3c4016e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:24.935773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:25.447926 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838466a-e4d9-41ff-825c-486415475b86 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:25.449858 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6838466a-e4d9-41ff-825c-486415475b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:25.576542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838466a-e4d9-41ff-825c-486415475b86 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:25.638696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:25.671434 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d04ab1-faa2-4033-b866-3d8ebe22b11c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:25.672130 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d04ab1-faa2-4033-b866-3d8ebe22b11c service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:25.672448 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d04ab1-faa2-4033-b866-3d8ebe22b11c service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:25.672846 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d04ab1-faa2-4033-b866-3d8ebe22b11c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:25.674682 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e8d04ab1-faa2-4033-b866-3d8ebe22b11c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:25.816401 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d04ab1-faa2-4033-b866-3d8ebe22b11c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:25.818422 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d04ab1-faa2-4033-b866-3d8ebe22b11c service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:25.841190 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 727/1455] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:28:28.013420 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e4de9-452a-4dbc-84ac-ec26faee190f None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:28.014002 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e4de9-452a-4dbc-84ac-ec26faee190f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:28.014002 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e4de9-452a-4dbc-84ac-ec26faee190f None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:28.015339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:28.021203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd72ae-3792-4825-bc8c-a7a97fca662a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:28.021748 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd72ae-3792-4825-bc8c-a7a97fca662a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:28.021748 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd72ae-3792-4825-bc8c-a7a97fca662a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:28.100455 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-82fd72ae-3792-4825-bc8c-a7a97fca662a None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:28.101739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-82fd72ae-3792-4825-bc8c-a7a97fca662a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:28.136569 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:28.214920 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:28.513525 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e4de9-452a-4dbc-84ac-ec26faee190f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:28.515146 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3a4e4de9-452a-4dbc-84ac-ec26faee190f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:28.635858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e4de9-452a-4dbc-84ac-ec26faee190f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:28.668329 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:28.722009 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a886a-d8ec-445c-927f-c9be8a02a65d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:28.722677 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a886a-d8ec-445c-927f-c9be8a02a65d service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:28.722960 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a886a-d8ec-445c-927f-c9be8a02a65d service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:28.723236 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a886a-d8ec-445c-927f-c9be8a02a65d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:28.725891 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-991a886a-d8ec-445c-927f-c9be8a02a65d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:28.865135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a886a-d8ec-445c-927f-c9be8a02a65d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:28.866641 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a886a-d8ec-445c-927f-c9be8a02a65d service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:28.888454 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 730/1458] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:28:31.020236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfb8e2-a03b-498e-afc4-339d09f8cbf7 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:31.021165 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfb8e2-a03b-498e-afc4-339d09f8cbf7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:31.021165 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfb8e2-a03b-498e-afc4-339d09f8cbf7 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:31.022824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:28:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:31.028997 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb2298-d760-4637-b3c6-d5764784786a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:31.029606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb2298-d760-4637-b3c6-d5764784786a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:31.029606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb2298-d760-4637-b3c6-d5764784786a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:31.115669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-93bb2298-d760-4637-b3c6-d5764784786a None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:31.117020 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-93bb2298-d760-4637-b3c6-d5764784786a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:31.127569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:31.240075 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:31.534593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cfb8e2-a03b-498e-afc4-339d09f8cbf7 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:31.536335 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-35cfb8e2-a03b-498e-afc4-339d09f8cbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:31.664303 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cfb8e2-a03b-498e-afc4-339d09f8cbf7 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:31.731480 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:31.759632 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e19be-41f0-4fa7-baa7-a23a0f2f1946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:31.760807 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e19be-41f0-4fa7-baa7-a23a0f2f1946 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:31.761261 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e19be-41f0-4fa7-baa7-a23a0f2f1946 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:31.762917 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e19be-41f0-4fa7-baa7-a23a0f2f1946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:31.765684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-820e19be-41f0-4fa7-baa7-a23a0f2f1946 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:31.912895 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e19be-41f0-4fa7-baa7-a23a0f2f1946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:31.914376 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e19be-41f0-4fa7-baa7-a23a0f2f1946 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:31.936291 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 730/1461] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:28:34.156600 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af9bd7-da54-44d8-bcff-cc6ade21550b None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:34.157279 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af9bd7-da54-44d8-bcff-cc6ade21550b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:34.157432 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af9bd7-da54-44d8-bcff-cc6ade21550b None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:34.159163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:28:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:34.166612 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1f4da-4857-482d-9b22-ae6408e7c6f3 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:34.167229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1f4da-4857-482d-9b22-ae6408e7c6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:34.167229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1f4da-4857-482d-9b22-ae6408e7c6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:34.249255 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-99f1f4da-4857-482d-9b22-ae6408e7c6f3 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:34.250537 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-99f1f4da-4857-482d-9b22-ae6408e7c6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:34.298225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:34.373181 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:34.685867 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af9bd7-da54-44d8-bcff-cc6ade21550b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:34.688460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-16af9bd7-da54-44d8-bcff-cc6ade21550b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:34.811966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af9bd7-da54-44d8-bcff-cc6ade21550b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:34.857891 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:34.902238 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e14434-27a0-4eaa-9227-1d7af8604da0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:34.902854 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e14434-27a0-4eaa-9227-1d7af8604da0 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:34.903135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e14434-27a0-4eaa-9227-1d7af8604da0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:34.903406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e14434-27a0-4eaa-9227-1d7af8604da0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:34.905135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-74e14434-27a0-4eaa-9227-1d7af8604da0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:35.056128 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e14434-27a0-4eaa-9227-1d7af8604da0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:35.057660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e14434-27a0-4eaa-9227-1d7af8604da0 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:35.081628 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 733/1464] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:28:37.246825 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad24c2-8ca1-447c-ac84-906c18c49c91 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:37.247665 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad24c2-8ca1-447c-ac84-906c18c49c91 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:37.247665 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad24c2-8ca1-447c-ac84-906c18c49c91 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:37.248984 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:28:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:28:37.255883 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674888b9-edf1-48ec-96ce-96dbe5d46907 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:37.256580 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674888b9-edf1-48ec-96ce-96dbe5d46907 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:37.256580 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674888b9-edf1-48ec-96ce-96dbe5d46907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:37.345280 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-674888b9-edf1-48ec-96ce-96dbe5d46907 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:37.346741 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-674888b9-edf1-48ec-96ce-96dbe5d46907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:37.371703 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:37.474726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:28:37.771255 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad24c2-8ca1-447c-ac84-906c18c49c91 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:37.773088 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-35ad24c2-8ca1-447c-ac84-906c18c49c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:37.914354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad24c2-8ca1-447c-ac84-906c18c49c91 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:38.001292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:38.012948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0a16b-b305-4d0e-a7a3-b46f4a0c227b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:38.013621 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0a16b-b305-4d0e-a7a3-b46f4a0c227b service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:38.013945 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0a16b-b305-4d0e-a7a3-b46f4a0c227b service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:38.014298 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0a16b-b305-4d0e-a7a3-b46f4a0c227b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:38.016170 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-bdf0a16b-b305-4d0e-a7a3-b46f4a0c227b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:38.179795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0a16b-b305-4d0e-a7a3-b46f4a0c227b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:38.181558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0a16b-b305-4d0e-a7a3-b46f4a0c227b service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:38.203495 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 733/1467] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:28:40.274431 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ed268-b5ca-496b-a860-41307c2ff50f None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:40.275244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ed268-b5ca-496b-a860-41307c2ff50f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:40.275244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ed268-b5ca-496b-a860-41307c2ff50f None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:40.277159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:28:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:40.284180 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df5405-ec05-4551-bdde-be37cb8c2fac None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:40.284801 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df5405-ec05-4551-bdde-be37cb8c2fac None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:40.285109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df5405-ec05-4551-bdde-be37cb8c2fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:40.382362 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-37df5405-ec05-4551-bdde-be37cb8c2fac None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:40.384522 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-37df5405-ec05-4551-bdde-be37cb8c2fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:40.481184 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:40.547335 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:40.843996 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ed268-b5ca-496b-a860-41307c2ff50f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:40.845687 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-845ed268-b5ca-496b-a860-41307c2ff50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:41.001739 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ed268-b5ca-496b-a860-41307c2ff50f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:41.072087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:41.109230 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9baf4-31de-4d83-99cd-0329b87a262b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:41.109846 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9baf4-31de-4d83-99cd-0329b87a262b service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:41.110160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9baf4-31de-4d83-99cd-0329b87a262b service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:41.110424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9baf4-31de-4d83-99cd-0329b87a262b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:41.112140 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c0a9baf4-31de-4d83-99cd-0329b87a262b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:41.252277 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9baf4-31de-4d83-99cd-0329b87a262b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:41.253987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9baf4-31de-4d83-99cd-0329b87a262b service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:41.277893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 736/1470] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:28:50.544797 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=22 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:51.275318 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=66 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:02.867152 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac47300-b20d-4d60-8d6d-6c04938decd0 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:02.867834 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac47300-b20d-4d60-8d6d-6c04938decd0 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:02.867834 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac47300-b20d-4d60-8d6d-6c04938decd0 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:02.869136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 735/1471] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:29:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:29:02.875060 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e3816-d956-4855-b9d9-5e635c0f8e6f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:02.875669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e3816-d956-4855-b9d9-5e635c0f8e6f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:02.875669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e3816-d956-4855-b9d9-5e635c0f8e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:02.962473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2a8e3816-d956-4855-b9d9-5e635c0f8e6f None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:29:02.964648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2a8e3816-d956-4855-b9d9-5e635c0f8e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:03.092737 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 737/1472] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:29:03.591161 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6052e-a302-48b7-a64c-d0eb1cda5508 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:03.591620 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6052e-a302-48b7-a64c-d0eb1cda5508 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:03.592054 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6052e-a302-48b7-a64c-d0eb1cda5508 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:03.594474 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 736/1473] 10.222.0.52 () {54 vars in 967 bytes} [Thu Sep 1 16:29:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:29:03.601107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d05ca-a917-4339-92d6-ece0d6a00f9b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:03.601412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d05ca-a917-4339-92d6-ece0d6a00f9b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:03.601647 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d05ca-a917-4339-92d6-ece0d6a00f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:03.705432 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-908d05ca-a917-4339-92d6-ece0d6a00f9b None None] MFA Rules not processed for user `c2feb3132ad9497aaae8720ed170ef3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:29:03.706738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-908d05ca-a917-4339-92d6-ece0d6a00f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:03.734073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:03.810071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 738/1474] 10.222.0.52 () {58 vars in 1064 bytes} [Thu Sep 1 16:29:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:29:03.818208 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6052e-a302-48b7-a64c-d0eb1cda5508 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:03.820193 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cda6052e-a302-48b7-a64c-d0eb1cda5508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:03.954892 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6052e-a302-48b7-a64c-d0eb1cda5508 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:04.078087 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dd9f0-d1a0-4a82-9476-e343df28b580 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2feb3132ad9497aaae8720ed170ef3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:04.085169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dd9f0-d1a0-4a82-9476-e343df28b580 service glance] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:04.085169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dd9f0-d1a0-4a82-9476-e343df28b580 service glance] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:04.085169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dd9f0-d1a0-4a82-9476-e343df28b580 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:04.085169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-311dd9f0-d1a0-4a82-9476-e343df28b580 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:04.152738 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:04.231798 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dd9f0-d1a0-4a82-9476-e343df28b580 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:04.233293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dd9f0-d1a0-4a82-9476-e343df28b580 service glance] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:04.256978 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 737/1475] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:29:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:29:06.495094 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960b260-54bb-4c0a-9c71-342b38fc31ee None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:06.495981 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960b260-54bb-4c0a-9c71-342b38fc31ee None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:06.495981 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960b260-54bb-4c0a-9c71-342b38fc31ee None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:06.497609 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 739/1476] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:29:06.504910 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f29993-5801-4022-8922-64f56a042c89 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:06.505533 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f29993-5801-4022-8922-64f56a042c89 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:06.505840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f29993-5801-4022-8922-64f56a042c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:06.602043 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-72f29993-5801-4022-8922-64f56a042c89 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:29:06.603454 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-72f29993-5801-4022-8922-64f56a042c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:06.721086 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 738/1477] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:29:07.273404 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960b260-54bb-4c0a-9c71-342b38fc31ee None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:07.275077 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5960b260-54bb-4c0a-9c71-342b38fc31ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:07.435375 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960b260-54bb-4c0a-9c71-342b38fc31ee None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:07.495251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:07.552016 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3e4d1-81e2-4777-8194-c70caec5b650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:07.553234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3e4d1-81e2-4777-8194-c70caec5b650 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:07.553559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3e4d1-81e2-4777-8194-c70caec5b650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:07.553885 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3e4d1-81e2-4777-8194-c70caec5b650 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:07.554604 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3e4d1-81e2-4777-8194-c70caec5b650 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:07.556711 dv-cinder-852209-10-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-2af3e4d1-81e2-4777-8194-c70caec5b650 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:29:07.556711 dv-cinder-852209-10-smb devstack@keystone.service[81459]: warnings.warn(msg) Sep 01 16:29:07.556711 dv-cinder-852209-10-smb devstack@keystone.service[81459]: Sep 01 16:29:07.558035 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3e4d1-81e2-4777-8194-c70caec5b650 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:07.581700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 740/1478] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 1 16:29:07 2022] GET /identity/v3/projects => generated 2553 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:29:09.945535 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda82296-f667-4d94-a1e5-244f1174cc63 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:09.946359 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda82296-f667-4d94-a1e5-244f1174cc63 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:09.946359 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda82296-f667-4d94-a1e5-244f1174cc63 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:09.947971 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 739/1479] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:29:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:29:09.955894 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85391f-7ed6-4f53-92be-291d23229217 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:09.956579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85391f-7ed6-4f53-92be-291d23229217 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:09.957024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85391f-7ed6-4f53-92be-291d23229217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:10.077571 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5e85391f-7ed6-4f53-92be-291d23229217 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:29:10.078869 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5e85391f-7ed6-4f53-92be-291d23229217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:10.199321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 741/1480] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:29:10.535763 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda82296-f667-4d94-a1e5-244f1174cc63 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:10.538079 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-eda82296-f667-4d94-a1e5-244f1174cc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:10.550534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:10.769731 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda82296-f667-4d94-a1e5-244f1174cc63 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:10.903629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:10.948014 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d8220-fd2d-468e-bafc-93e8d09a55b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:10.948812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d8220-fd2d-468e-bafc-93e8d09a55b2 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:10.948959 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d8220-fd2d-468e-bafc-93e8d09a55b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:10.949204 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d8220-fd2d-468e-bafc-93e8d09a55b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:10.951163 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c88d8220-fd2d-468e-bafc-93e8d09a55b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:11.084525 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d8220-fd2d-468e-bafc-93e8d09a55b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:11.086446 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d8220-fd2d-468e-bafc-93e8d09a55b2 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:11.115992 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 740/1481] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:29:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:29:13.485384 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223df5cb-beac-4911-9dbd-20b0016581b2 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:13.486322 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223df5cb-beac-4911-9dbd-20b0016581b2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:13.486322 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223df5cb-beac-4911-9dbd-20b0016581b2 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:13.487861 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 742/1482] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:29:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:29:13.494968 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f89e9-2365-463e-8704-b284e94ea1bd None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:13.495644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f89e9-2365-463e-8704-b284e94ea1bd None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:13.495644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f89e9-2365-463e-8704-b284e94ea1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:13.577542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-d66f89e9-2365-463e-8704-b284e94ea1bd None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:29:13.578817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d66f89e9-2365-463e-8704-b284e94ea1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:13.637552 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:13.699085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 741/1483] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:29:14.003974 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223df5cb-beac-4911-9dbd-20b0016581b2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:14.006226 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-223df5cb-beac-4911-9dbd-20b0016581b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:14.033562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:14.137049 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223df5cb-beac-4911-9dbd-20b0016581b2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:14.229428 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362c22e-4e87-4844-93ae-931c504886c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:14.230056 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362c22e-4e87-4844-93ae-931c504886c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:14.230338 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362c22e-4e87-4844-93ae-931c504886c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:14.230614 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362c22e-4e87-4844-93ae-931c504886c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:14.232382 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6362c22e-4e87-4844-93ae-931c504886c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:14.364407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:14.412772 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362c22e-4e87-4844-93ae-931c504886c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:14.414336 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362c22e-4e87-4844-93ae-931c504886c2 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:14.439744 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 743/1484] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:29:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:29:16.691750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8e10d-4591-4580-a1e3-683f225e2613 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:16.692390 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8e10d-4591-4580-a1e3-683f225e2613 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:16.692390 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8e10d-4591-4580-a1e3-683f225e2613 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:16.694311 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 742/1485] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:29:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:29:16.700442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d938051-5655-4853-b660-4781fb6b0107 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:16.701327 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d938051-5655-4853-b660-4781fb6b0107 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:16.701501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d938051-5655-4853-b660-4781fb6b0107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:16.785162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1d938051-5655-4853-b660-4781fb6b0107 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:29:16.786319 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1d938051-5655-4853-b660-4781fb6b0107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:16.911602 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 744/1486] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:29:17.205807 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8e10d-4591-4580-a1e3-683f225e2613 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:17.207419 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-36d8e10d-4591-4580-a1e3-683f225e2613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:17.336401 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8e10d-4591-4580-a1e3-683f225e2613 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:17.429989 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:17.432401 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b4281-bf9e-4b2a-a884-8119ca4a9e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:17.433073 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b4281-bf9e-4b2a-a884-8119ca4a9e90 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:17.433638 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b4281-bf9e-4b2a-a884-8119ca4a9e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:17.433980 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b4281-bf9e-4b2a-a884-8119ca4a9e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:17.436306 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-dc3b4281-bf9e-4b2a-a884-8119ca4a9e90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:17.584260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b4281-bf9e-4b2a-a884-8119ca4a9e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:17.585785 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b4281-bf9e-4b2a-a884-8119ca4a9e90 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:17.612611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 743/1487] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:29:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:29:19.971410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c5df1-2b14-42d0-a37d-4f9159c94d5a None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:19.972281 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c5df1-2b14-42d0-a37d-4f9159c94d5a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:19.972281 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c5df1-2b14-42d0-a37d-4f9159c94d5a None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:19.977394 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 745/1488] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:29:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:29:19.983630 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e0c9f-b4ad-46bd-8236-3b2887ed97ea None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:19.984481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e0c9f-b4ad-46bd-8236-3b2887ed97ea None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:19.984709 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e0c9f-b4ad-46bd-8236-3b2887ed97ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:20.075768 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-291e0c9f-b4ad-46bd-8236-3b2887ed97ea None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:29:20.077313 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-291e0c9f-b4ad-46bd-8236-3b2887ed97ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:20.154291 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:20.233731 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 744/1489] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:29:20.585198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c5df1-2b14-42d0-a37d-4f9159c94d5a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:20.587015 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-aa6c5df1-2b14-42d0-a37d-4f9159c94d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:20.637378 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:20.730295 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c5df1-2b14-42d0-a37d-4f9159c94d5a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:20.832183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591a76a-0753-43e4-9200-a60d6f97829d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:20.832750 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591a76a-0753-43e4-9200-a60d6f97829d service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:20.833037 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591a76a-0753-43e4-9200-a60d6f97829d service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:20.833311 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591a76a-0753-43e4-9200-a60d6f97829d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:20.835028 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1591a76a-0753-43e4-9200-a60d6f97829d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:20.940099 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:20.979089 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591a76a-0753-43e4-9200-a60d6f97829d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:20.983701 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591a76a-0753-43e4-9200-a60d6f97829d service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:21.011157 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 746/1490] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:29:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:29:23.569486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1450fd8-213b-4c92-9325-7a5909372315 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:23.570296 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1450fd8-213b-4c92-9325-7a5909372315 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:23.570296 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1450fd8-213b-4c92-9325-7a5909372315 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:23.571454 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 745/1491] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 1 16:29:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:29:23.578497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63483a-1ac2-46f7-b22a-7191123d1378 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:23.579158 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63483a-1ac2-46f7-b22a-7191123d1378 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:23.579327 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63483a-1ac2-46f7-b22a-7191123d1378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:23.708138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6b63483a-1ac2-46f7-b22a-7191123d1378 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:29:23.710322 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6b63483a-1ac2-46f7-b22a-7191123d1378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:23.840533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 747/1492] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 1 16:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:29:24.148458 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1450fd8-213b-4c92-9325-7a5909372315 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:24.150190 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d1450fd8-213b-4c92-9325-7a5909372315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:24.291527 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1450fd8-213b-4c92-9325-7a5909372315 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:24.394471 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f3dfc-2ea7-447a-a7f2-f0aedfd51c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:24.395221 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f3dfc-2ea7-447a-a7f2-f0aedfd51c56 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:24.395595 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f3dfc-2ea7-447a-a7f2-f0aedfd51c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:24.395968 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f3dfc-2ea7-447a-a7f2-f0aedfd51c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:24.398082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b18f3dfc-2ea7-447a-a7f2-f0aedfd51c56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:24.410290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:24.566900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f3dfc-2ea7-447a-a7f2-f0aedfd51c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:24.568816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f3dfc-2ea7-447a-a7f2-f0aedfd51c56 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:24.590730 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 746/1493] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:29:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:29:33.838405 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=82 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:34.588149 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=50 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:49.536036 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62f708-2109-4c85-b436-22d0fd8566e6 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:49.537735 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62f708-2109-4c85-b436-22d0fd8566e6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:49.537735 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62f708-2109-4c85-b436-22d0fd8566e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:49.643802 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6c62f708-2109-4c85-b436-22d0fd8566e6 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:49.647410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6c62f708-2109-4c85-b436-22d0fd8566e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:49.783019 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 748/1494] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:30:49.792112 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5be462-bd9c-4396-8151-d2216a32a8b3 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:49.792791 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5be462-bd9c-4396-8151-d2216a32a8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:49.792974 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5be462-bd9c-4396-8151-d2216a32a8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:49.816679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8b5be462-bd9c-4396-8151-d2216a32a8b3 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:49.817922 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8b5be462-bd9c-4396-8151-d2216a32a8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:49.828510 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 747/1495] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:30:49.834129 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62f708-2109-4c85-b436-22d0fd8566e6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:49.846869 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62f708-2109-4c85-b436-22d0fd8566e6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:49.853043 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191483e2-f734-44c5-8069-6f54da623710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:49.853670 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191483e2-f734-44c5-8069-6f54da623710 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:49.853952 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191483e2-f734-44c5-8069-6f54da623710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:49.854225 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191483e2-f734-44c5-8069-6f54da623710 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:49.854895 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191483e2-f734-44c5-8069-6f54da623710 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:30:49.855200 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191483e2-f734-44c5-8069-6f54da623710 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:49.856245 dv-cinder-852209-10-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-191483e2-f734-44c5-8069-6f54da623710 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:30:49.856245 dv-cinder-852209-10-smb devstack@keystone.service[81459]: warnings.warn(msg) Sep 01 16:30:49.856245 dv-cinder-852209-10-smb devstack@keystone.service[81459]: Sep 01 16:30:49.857189 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191483e2-f734-44c5-8069-6f54da623710 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:49.870998 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 749/1496] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:30:49.881803 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5be462-bd9c-4396-8151-d2216a32a8b3 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:49.897486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5be462-bd9c-4396-8151-d2216a32a8b3 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:49.902447 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71631f5e-bcc2-4a79-979d-d3ed3f49a23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:49.903062 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71631f5e-bcc2-4a79-979d-d3ed3f49a23f admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:49.903335 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71631f5e-bcc2-4a79-979d-d3ed3f49a23f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:49.903601 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71631f5e-bcc2-4a79-979d-d3ed3f49a23f admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:49.904255 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71631f5e-bcc2-4a79-979d-d3ed3f49a23f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:49.906099 dv-cinder-852209-10-smb devstack@keystone.service[81460]: WARNING py.warnings [None req-71631f5e-bcc2-4a79-979d-d3ed3f49a23f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:30:49.906099 dv-cinder-852209-10-smb devstack@keystone.service[81460]: warnings.warn(msg) Sep 01 16:30:49.906099 dv-cinder-852209-10-smb devstack@keystone.service[81460]: Sep 01 16:30:49.907381 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71631f5e-bcc2-4a79-979d-d3ed3f49a23f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:49.963376 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 748/1497] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:30:49 2022] POST /identity/v3/projects => generated 377 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:30:49.969575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191483e2-f734-44c5-8069-6f54da623710 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:49.982187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191483e2-f734-44c5-8069-6f54da623710 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:50.048840 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:50.058053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b70c46-a511-4a2e-a714-9ba5bdd0c65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:50.058728 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b70c46-a511-4a2e-a714-9ba5bdd0c65b admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:50.059052 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b70c46-a511-4a2e-a714-9ba5bdd0c65b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:50.059414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b70c46-a511-4a2e-a714-9ba5bdd0c65b admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:50.060348 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b70c46-a511-4a2e-a714-9ba5bdd0c65b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:50.061562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-e1b70c46-a511-4a2e-a714-9ba5bdd0c65b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:30:50.061562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: warnings.warn(msg) Sep 01 16:30:50.061562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: Sep 01 16:30:50.063795 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b70c46-a511-4a2e-a714-9ba5bdd0c65b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:50.091680 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 750/1498] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:30:49 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:30:50.096515 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71631f5e-bcc2-4a79-979d-d3ed3f49a23f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:50.109133 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71631f5e-bcc2-4a79-979d-d3ed3f49a23f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:50.115669 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d56e1e-dd89-4337-8702-a55de0252c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:50.116383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d56e1e-dd89-4337-8702-a55de0252c2a admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:50.116812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d56e1e-dd89-4337-8702-a55de0252c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:50.117133 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d56e1e-dd89-4337-8702-a55de0252c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:50.117854 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d56e1e-dd89-4337-8702-a55de0252c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:50.119020 dv-cinder-852209-10-smb devstack@keystone.service[81460]: WARNING py.warnings [None req-36d56e1e-dd89-4337-8702-a55de0252c2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:30:50.119020 dv-cinder-852209-10-smb devstack@keystone.service[81460]: warnings.warn(msg) Sep 01 16:30:50.119020 dv-cinder-852209-10-smb devstack@keystone.service[81460]: Sep 01 16:30:50.120077 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d56e1e-dd89-4337-8702-a55de0252c2a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:50.135121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 749/1499] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:30:50.140881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b70c46-a511-4a2e-a714-9ba5bdd0c65b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:50.155413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b70c46-a511-4a2e-a714-9ba5bdd0c65b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:50.162524 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7573439-7325-4960-95a5-a70bd9be8928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:50.163158 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7573439-7325-4960-95a5-a70bd9be8928 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:50.163436 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7573439-7325-4960-95a5-a70bd9be8928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:50.163713 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7573439-7325-4960-95a5-a70bd9be8928 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:50.164902 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7573439-7325-4960-95a5-a70bd9be8928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:50.166815 dv-cinder-852209-10-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-f7573439-7325-4960-95a5-a70bd9be8928 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:30:50.166815 dv-cinder-852209-10-smb devstack@keystone.service[81459]: warnings.warn(msg) Sep 01 16:30:50.166815 dv-cinder-852209-10-smb devstack@keystone.service[81459]: Sep 01 16:30:50.168561 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7573439-7325-4960-95a5-a70bd9be8928 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:50.197902 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 751/1500] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:30:50.202795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d56e1e-dd89-4337-8702-a55de0252c2a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:50.214803 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d56e1e-dd89-4337-8702-a55de0252c2a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:50.220132 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae799c42-1362-4707-802d-05c13bfd76a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:50.221071 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae799c42-1362-4707-802d-05c13bfd76a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:50.221397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae799c42-1362-4707-802d-05c13bfd76a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:50.221716 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae799c42-1362-4707-802d-05c13bfd76a4 admin admin] PATH_INFO: `/v3/projects/14198c171f9e4178a677ed49d133a3cb/users/13c10a78900e4fc58f2a547785157c0d/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:50.242626 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae799c42-1362-4707-802d-05c13bfd76a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14198c171f9e4178a677ed49d133a3cb, user_id=13c10a78900e4fc58f2a547785157c0d, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:50.244031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: WARNING py.warnings [None req-ae799c42-1362-4707-802d-05c13bfd76a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:30:50.244031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: warnings.warn(msg) Sep 01 16:30:50.244031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: Sep 01 16:30:50.246681 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae799c42-1362-4707-802d-05c13bfd76a4 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:50.263023 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 750/1501] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:30:50 2022] PUT /identity/v3/projects/14198c171f9e4178a677ed49d133a3cb/users/13c10a78900e4fc58f2a547785157c0d/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:30:50.276820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64382dfe-0628-423b-b7ab-7539a7434db7 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:50.277232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64382dfe-0628-423b-b7ab-7539a7434db7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:50.277411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64382dfe-0628-423b-b7ab-7539a7434db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:50.311755 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-64382dfe-0628-423b-b7ab-7539a7434db7 None None] MFA Rules not processed for user `13c10a78900e4fc58f2a547785157c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:50.313082 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-64382dfe-0628-423b-b7ab-7539a7434db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:50.395674 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 752/1502] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:30:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:30:50.415149 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf569d3-a3a1-44f3-b4c2-0e424783cd91 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:50.415452 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf569d3-a3a1-44f3-b4c2-0e424783cd91 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:50.415693 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf569d3-a3a1-44f3-b4c2-0e424783cd91 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:50.417222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 751/1503] 10.222.0.52 () {54 vars in 964 bytes} [Thu Sep 1 16:30:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:30:50.423797 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0852c00-21b1-409f-bfac-b3047abac938 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:50.424104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0852c00-21b1-409f-bfac-b3047abac938 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:50.424351 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0852c00-21b1-409f-bfac-b3047abac938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:50.507260 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b0852c00-21b1-409f-bfac-b3047abac938 None None] MFA Rules not processed for user `80a92eaeb5c54414864deef3052bd8f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:50.508737 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b0852c00-21b1-409f-bfac-b3047abac938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:50.609540 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 753/1504] 10.222.0.52 () {58 vars in 1061 bytes} [Thu Sep 1 16:30:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:30:50.617745 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf569d3-a3a1-44f3-b4c2-0e424783cd91 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:50.629830 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf569d3-a3a1-44f3-b4c2-0e424783cd91 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:50.634167 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2defb4ad-7273-41bd-8868-e9b212b2dd7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:50.634826 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defb4ad-7273-41bd-8868-e9b212b2dd7c service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:50.635145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defb4ad-7273-41bd-8868-e9b212b2dd7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:50.635456 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defb4ad-7273-41bd-8868-e9b212b2dd7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:50.645449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2defb4ad-7273-41bd-8868-e9b212b2dd7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:50.647114 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2defb4ad-7273-41bd-8868-e9b212b2dd7c service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:50.658044 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 752/1505] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:30:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:30:50.730967 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48a751-f10c-4a8c-af89-d022f675807a None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:50.731246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48a751-f10c-4a8c-af89-d022f675807a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:50.731511 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48a751-f10c-4a8c-af89-d022f675807a None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:50.732923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 754/1506] 10.222.0.52 () {52 vars in 830 bytes} [Thu Sep 1 16:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:30:50.737570 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2defb4ad-7273-41bd-8868-e9b212b2dd7c service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:50.813286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2defb4ad-7273-41bd-8868-e9b212b2dd7c service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:50.819042 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b4d3e-8f10-4138-bdc1-cab72d724a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:50.819703 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b4d3e-8f10-4138-bdc1-cab72d724a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:50.820016 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b4d3e-8f10-4138-bdc1-cab72d724a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:50.820289 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b4d3e-8f10-4138-bdc1-cab72d724a56 admin admin] PATH_INFO: `/v3/users/13c10a78900e4fc58f2a547785157c0d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:50.821618 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b4d3e-8f10-4138-bdc1-cab72d724a56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13c10a78900e4fc58f2a547785157c0d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:50.822686 dv-cinder-852209-10-smb devstack@keystone.service[81460]: WARNING py.warnings [None req-044b4d3e-8f10-4138-bdc1-cab72d724a56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:30:50.822686 dv-cinder-852209-10-smb devstack@keystone.service[81460]: warnings.warn(msg) Sep 01 16:30:50.822686 dv-cinder-852209-10-smb devstack@keystone.service[81460]: Sep 01 16:30:50.824008 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b4d3e-8f10-4138-bdc1-cab72d724a56 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:50.909085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-044b4d3e-8f10-4138-bdc1-cab72d724a56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13c10a78900e4fc58f2a547785157c0d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:30:50.941699 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-044b4d3e-8f10-4138-bdc1-cab72d724a56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13c10a78900e4fc58f2a547785157c0d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:30:50.942586 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-044b4d3e-8f10-4138-bdc1-cab72d724a56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13c10a78900e4fc58f2a547785157c0d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:30:50.943422 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-044b4d3e-8f10-4138-bdc1-cab72d724a56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13c10a78900e4fc58f2a547785157c0d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:30:50.962567 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-044b4d3e-8f10-4138-bdc1-cab72d724a56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13c10a78900e4fc58f2a547785157c0d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:30:50.968373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:50.986266 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 753/1507] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:30:50 2022] DELETE /identity/v3/users/13c10a78900e4fc58f2a547785157c0d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:30:50.993402 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400ffbc-3555-41ec-a535-ec7624734e90 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:50.993834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400ffbc-3555-41ec-a535-ec7624734e90 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:50.994211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400ffbc-3555-41ec-a535-ec7624734e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:51.016653 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8400ffbc-3555-41ec-a535-ec7624734e90 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:51.017896 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8400ffbc-3555-41ec-a535-ec7624734e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:51.028552 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:51.100498 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 755/1508] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:30:51.111056 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b4d3e-8f10-4138-bdc1-cab72d724a56 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:51.112669 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-044b4d3e-8f10-4138-bdc1-cab72d724a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:51.207956 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b4d3e-8f10-4138-bdc1-cab72d724a56 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:51.212102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c6112-3091-49d4-b2a1-7a275bc2fc4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:51.212890 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c6112-3091-49d4-b2a1-7a275bc2fc4b service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:51.213208 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c6112-3091-49d4-b2a1-7a275bc2fc4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:51.213552 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c6112-3091-49d4-b2a1-7a275bc2fc4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:51.223870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c6112-3091-49d4-b2a1-7a275bc2fc4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:51.225455 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c6112-3091-49d4-b2a1-7a275bc2fc4b service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:51.236581 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 754/1509] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:30:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:30:51.646430 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400ffbc-3555-41ec-a535-ec7624734e90 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:51.648548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8400ffbc-3555-41ec-a535-ec7624734e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:51.665795 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400ffbc-3555-41ec-a535-ec7624734e90 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:51.672586 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0e6f3-6b70-4027-a38e-9dfbf1523257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:51.673834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0e6f3-6b70-4027-a38e-9dfbf1523257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:51.674406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0e6f3-6b70-4027-a38e-9dfbf1523257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:51.674845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0e6f3-6b70-4027-a38e-9dfbf1523257 admin admin] PATH_INFO: `/v3/projects/14198c171f9e4178a677ed49d133a3cb` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:51.676506 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0e6f3-6b70-4027-a38e-9dfbf1523257 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14198c171f9e4178a677ed49d133a3cb)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:51.678161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-8ea0e6f3-6b70-4027-a38e-9dfbf1523257 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:30:51.678161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: warnings.warn(msg) Sep 01 16:30:51.678161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: Sep 01 16:30:51.679901 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0e6f3-6b70-4027-a38e-9dfbf1523257 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:51.767547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8ea0e6f3-6b70-4027-a38e-9dfbf1523257 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14198c171f9e4178a677ed49d133a3cb', 'request_id': 'req-8ea0e6f3-6b70-4027-a38e-9dfbf1523257'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:30:51.784070 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8ea0e6f3-6b70-4027-a38e-9dfbf1523257 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14198c171f9e4178a677ed49d133a3cb', 'request_id': 'req-8ea0e6f3-6b70-4027-a38e-9dfbf1523257'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:30:51.799355 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8ea0e6f3-6b70-4027-a38e-9dfbf1523257 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14198c171f9e4178a677ed49d133a3cb', 'request_id': 'req-8ea0e6f3-6b70-4027-a38e-9dfbf1523257'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:30:51.814282 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8ea0e6f3-6b70-4027-a38e-9dfbf1523257 admin admin] The token cache is being invalidate because project 14198c171f9e4178a677ed49d133a3cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:30:51.814626 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8ea0e6f3-6b70-4027-a38e-9dfbf1523257 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:30:51.815398 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8ea0e6f3-6b70-4027-a38e-9dfbf1523257 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:30:51.817536 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 756/1510] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:30:51 2022] DELETE /identity/v3/projects/14198c171f9e4178a677ed49d133a3cb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:31:01.231711 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:01.810714 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:45.110278 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab58e1f-9ec1-408b-9eee-b08be81d9f4c None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:45.110888 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab58e1f-9ec1-408b-9eee-b08be81d9f4c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:45.110888 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab58e1f-9ec1-408b-9eee-b08be81d9f4c None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:45.112261 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:32:45.118623 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38698737-7390-4abc-9b5c-babf2f8b2e59 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:45.119286 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38698737-7390-4abc-9b5c-babf2f8b2e59 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:45.119286 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38698737-7390-4abc-9b5c-babf2f8b2e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:45.141892 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-38698737-7390-4abc-9b5c-babf2f8b2e59 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:45.143131 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-38698737-7390-4abc-9b5c-babf2f8b2e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:45.247868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:45.411493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab58e1f-9ec1-408b-9eee-b08be81d9f4c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:45.413667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-bab58e1f-9ec1-408b-9eee-b08be81d9f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:45.541734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab58e1f-9ec1-408b-9eee-b08be81d9f4c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:45.548402 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f3e35-4754-4c77-8d0d-01b4372b5e6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:45.549082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f3e35-4754-4c77-8d0d-01b4372b5e6b service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:45.549368 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f3e35-4754-4c77-8d0d-01b4372b5e6b service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:45.549639 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f3e35-4754-4c77-8d0d-01b4372b5e6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:45.559499 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f3e35-4754-4c77-8d0d-01b4372b5e6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:45.561397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f3e35-4754-4c77-8d0d-01b4372b5e6b service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:45.572875 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 756/1513] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:32:46.186791 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40b588-9fc7-444e-ab68-fcee2d016b44 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:46.187741 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40b588-9fc7-444e-ab68-fcee2d016b44 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:46.187741 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40b588-9fc7-444e-ab68-fcee2d016b44 None None] PATH_INFO: `/v3` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:46.189718 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 758/1514] 10.222.0.75 () {54 vars in 925 bytes} [Thu Sep 1 16:32:46 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:32:46.197420 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc9674-7edf-495b-ab7e-875904a46f39 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:46.198223 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc9674-7edf-495b-ab7e-875904a46f39 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:46.198387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc9674-7edf-495b-ab7e-875904a46f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:46.265186 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f3bc9674-7edf-495b-ab7e-875904a46f39 None None] MFA Rules not processed for user `d64fc190fac540259444a531cdbb8d53`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:46.266740 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f3bc9674-7edf-495b-ab7e-875904a46f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:46.430799 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 757/1515] 10.222.0.75 () {58 vars in 1015 bytes} [Thu Sep 1 16:32:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:32:46.544549 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ebe1c-0d47-43a9-88c1-9968d1e318f3 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:46.544873 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ebe1c-0d47-43a9-88c1-9968d1e318f3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:46.545133 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ebe1c-0d47-43a9-88c1-9968d1e318f3 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:46.546543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 759/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:32:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:32:46.552671 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c170539-7667-4e97-be9d-6b41774f329c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:46.553057 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c170539-7667-4e97-be9d-6b41774f329c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:46.553481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c170539-7667-4e97-be9d-6b41774f329c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:46.579853 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-0c170539-7667-4e97-be9d-6b41774f329c None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:46.581136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0c170539-7667-4e97-be9d-6b41774f329c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:46.590131 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 758/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:46.748476 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ebe1c-0d47-43a9-88c1-9968d1e318f3 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:46.764449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ebe1c-0d47-43a9-88c1-9968d1e318f3 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:46.771048 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2f2bb-15d3-498d-b06f-8320c6fd1eaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:46.771994 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2f2bb-15d3-498d-b06f-8320c6fd1eaa service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:46.772452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2f2bb-15d3-498d-b06f-8320c6fd1eaa service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:46.772912 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2f2bb-15d3-498d-b06f-8320c6fd1eaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:46.783448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2f2bb-15d3-498d-b06f-8320c6fd1eaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:46.785161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2f2bb-15d3-498d-b06f-8320c6fd1eaa service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:46.796983 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 760/1518] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:55.513955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bc86f-ca77-46ae-802a-53701f1a6ea5 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:55.514528 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bc86f-ca77-46ae-802a-53701f1a6ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:55.514528 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bc86f-ca77-46ae-802a-53701f1a6ea5 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:55.516134 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 759/1519] 10.222.0.52 () {54 vars in 961 bytes} [Thu Sep 1 16:32:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:32:55.524434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bec334-a9a9-4793-a888-2ce6b0b46fad None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:55.525055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bec334-a9a9-4793-a888-2ce6b0b46fad None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:55.525438 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bec334-a9a9-4793-a888-2ce6b0b46fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:55.562242 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-89bec334-a9a9-4793-a888-2ce6b0b46fad None None] MFA Rules not processed for user `d64fc190fac540259444a531cdbb8d53`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:55.564400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-89bec334-a9a9-4793-a888-2ce6b0b46fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:55.580111 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 761/1520] 10.222.0.52 () {58 vars in 1058 bytes} [Thu Sep 1 16:32:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:55.588820 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bc86f-ca77-46ae-802a-53701f1a6ea5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:55.603518 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bc86f-ca77-46ae-802a-53701f1a6ea5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:55.610636 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce56c7-2e26-4e54-8bbc-6d4d2e0c70da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64fc190fac540259444a531cdbb8d53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:55.611691 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce56c7-2e26-4e54-8bbc-6d4d2e0c70da service placement] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:55.612194 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce56c7-2e26-4e54-8bbc-6d4d2e0c70da service placement] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:55.612726 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce56c7-2e26-4e54-8bbc-6d4d2e0c70da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:55.624269 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce56c7-2e26-4e54-8bbc-6d4d2e0c70da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:55.625926 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce56c7-2e26-4e54-8bbc-6d4d2e0c70da service placement] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:55.639649 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 760/1521] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:32:58.089315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16175545-9dbc-4e4a-9b61-a02f6c50f959 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:58.090061 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16175545-9dbc-4e4a-9b61-a02f6c50f959 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:58.090221 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16175545-9dbc-4e4a-9b61-a02f6c50f959 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:58.092192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:32:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:32:58.097675 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c940a8-2682-49d5-8815-9f3d1922f320 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:58.098199 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c940a8-2682-49d5-8815-9f3d1922f320 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:58.098199 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c940a8-2682-49d5-8815-9f3d1922f320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:58.106160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:58.120854 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-82c940a8-2682-49d5-8815-9f3d1922f320 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:58.123387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-82c940a8-2682-49d5-8815-9f3d1922f320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:58.137973 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:58.303004 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16175545-9dbc-4e4a-9b61-a02f6c50f959 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:58.325193 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16175545-9dbc-4e4a-9b61-a02f6c50f959 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:58.334639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb0b14-2c17-4999-a283-c5aeaca81bb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:58.335656 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb0b14-2c17-4999-a283-c5aeaca81bb3 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:58.336150 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb0b14-2c17-4999-a283-c5aeaca81bb3 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:58.336686 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb0b14-2c17-4999-a283-c5aeaca81bb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:58.353732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb0b14-2c17-4999-a283-c5aeaca81bb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:58.356903 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb0b14-2c17-4999-a283-c5aeaca81bb3 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:58.375613 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 763/1524] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:32:59.235287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ec0f5-bcc8-4c45-abc6-6e29198d19d2 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:59.235924 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ec0f5-bcc8-4c45-abc6-6e29198d19d2 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:59.235924 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ec0f5-bcc8-4c45-abc6-6e29198d19d2 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:59.237577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:32:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:32:59.243352 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4afb46-a2f0-463f-b5ac-097ac63b6337 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:59.244108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4afb46-a2f0-463f-b5ac-097ac63b6337 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:59.244108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4afb46-a2f0-463f-b5ac-097ac63b6337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:59.265764 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ae4afb46-a2f0-463f-b5ac-097ac63b6337 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:32:59.267000 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ae4afb46-a2f0-463f-b5ac-097ac63b6337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:32:59.275048 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:32:59.432109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ec0f5-bcc8-4c45-abc6-6e29198d19d2 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:32:59.448342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ec0f5-bcc8-4c45-abc6-6e29198d19d2 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:32:59.454906 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf26dd-9f4c-4804-ab5d-32821157133a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:32:59.455535 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf26dd-9f4c-4804-ab5d-32821157133a service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:32:59.455822 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf26dd-9f4c-4804-ab5d-32821157133a service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:32:59.456087 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf26dd-9f4c-4804-ab5d-32821157133a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:32:59.466445 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf26dd-9f4c-4804-ab5d-32821157133a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:32:59.468132 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf26dd-9f4c-4804-ab5d-32821157133a service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:32:59.478902 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 763/1527] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:32:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:33:03.901718 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8679a46-e63c-457d-9a08-f1c6b857b8d9 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:03.902935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8679a46-e63c-457d-9a08-f1c6b857b8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:03.902935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8679a46-e63c-457d-9a08-f1c6b857b8d9 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:03.904316 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:33:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:33:03.910610 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe34a8-4768-4378-976c-9fc0a9113802 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:03.911554 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe34a8-4768-4378-976c-9fc0a9113802 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:03.911554 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe34a8-4768-4378-976c-9fc0a9113802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:03.934709 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-25fe34a8-4768-4378-976c-9fc0a9113802 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:03.936055 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-25fe34a8-4768-4378-976c-9fc0a9113802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:03.945014 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:04.252206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8679a46-e63c-457d-9a08-f1c6b857b8d9 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:04.254058 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d8679a46-e63c-457d-9a08-f1c6b857b8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:04.333568 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8679a46-e63c-457d-9a08-f1c6b857b8d9 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:04.339397 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebb041-f3c8-486e-9af1-d9aaea954f43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:04.341577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebb041-f3c8-486e-9af1-d9aaea954f43 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:04.342057 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebb041-f3c8-486e-9af1-d9aaea954f43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:04.342539 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebb041-f3c8-486e-9af1-d9aaea954f43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:04.359717 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebb041-f3c8-486e-9af1-d9aaea954f43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:04.362548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebb041-f3c8-486e-9af1-d9aaea954f43 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:04.377899 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 766/1530] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:07.115184 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87fffe-aa46-4835-b12f-519ce45aee8e None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:07.115945 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87fffe-aa46-4835-b12f-519ce45aee8e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:07.115945 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87fffe-aa46-4835-b12f-519ce45aee8e None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:07.117196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:33:07.124795 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1f92d-6c3e-4db8-9449-bf7c7a25e8e0 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:07.125686 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1f92d-6c3e-4db8-9449-bf7c7a25e8e0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:07.125686 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1f92d-6c3e-4db8-9449-bf7c7a25e8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:07.157574 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c9f1f92d-6c3e-4db8-9449-bf7c7a25e8e0 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:07.159668 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c9f1f92d-6c3e-4db8-9449-bf7c7a25e8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:07.173288 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:07.470248 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87fffe-aa46-4835-b12f-519ce45aee8e None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:07.484470 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87fffe-aa46-4835-b12f-519ce45aee8e None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:07.488101 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07415506-2fcc-4c17-aa87-2d5f9da7f6f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:07.488740 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07415506-2fcc-4c17-aa87-2d5f9da7f6f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:07.489025 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07415506-2fcc-4c17-aa87-2d5f9da7f6f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:07.489293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07415506-2fcc-4c17-aa87-2d5f9da7f6f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:07.499920 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07415506-2fcc-4c17-aa87-2d5f9da7f6f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:07.501442 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07415506-2fcc-4c17-aa87-2d5f9da7f6f9 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:07.512394 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 766/1533] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:11.747761 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afba42-e42e-4ec6-b77c-cac12f703646 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:11.748451 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afba42-e42e-4ec6-b77c-cac12f703646 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:11.748451 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afba42-e42e-4ec6-b77c-cac12f703646 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:11.749778 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:33:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:33:11.757247 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3b44c-7cad-4ac5-9fe1-bdffbc32bc7f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:11.757755 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3b44c-7cad-4ac5-9fe1-bdffbc32bc7f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:11.758300 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3b44c-7cad-4ac5-9fe1-bdffbc32bc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:11.793674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-bfe3b44c-7cad-4ac5-9fe1-bdffbc32bc7f None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:11.795886 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-bfe3b44c-7cad-4ac5-9fe1-bdffbc32bc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:11.810968 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:12.391419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afba42-e42e-4ec6-b77c-cac12f703646 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:12.393239 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-95afba42-e42e-4ec6-b77c-cac12f703646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:12.399381 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=75 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:12.458318 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afba42-e42e-4ec6-b77c-cac12f703646 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:12.462258 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c09161-850d-4cbe-85ab-f91bbb8daf7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:12.462893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c09161-850d-4cbe-85ab-f91bbb8daf7c service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:12.463176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c09161-850d-4cbe-85ab-f91bbb8daf7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:12.463479 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c09161-850d-4cbe-85ab-f91bbb8daf7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:12.475182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c09161-850d-4cbe-85ab-f91bbb8daf7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:12.477215 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c09161-850d-4cbe-85ab-f91bbb8daf7c service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:12.489205 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 769/1536] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:14.616328 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf2190-97f5-4c43-bb6e-a187afa9aa5b None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:14.616949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf2190-97f5-4c43-bb6e-a187afa9aa5b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:14.617054 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf2190-97f5-4c43-bb6e-a187afa9aa5b None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:14.618573 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:33:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:33:14.628734 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9648499-8141-4a93-be94-ec220d033bfc None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:14.629270 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9648499-8141-4a93-be94-ec220d033bfc None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:14.629667 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9648499-8141-4a93-be94-ec220d033bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:14.663772 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b9648499-8141-4a93-be94-ec220d033bfc None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:14.665862 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b9648499-8141-4a93-be94-ec220d033bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:14.680301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:15.249917 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf2190-97f5-4c43-bb6e-a187afa9aa5b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:15.251732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-58bf2190-97f5-4c43-bb6e-a187afa9aa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:15.265894 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf2190-97f5-4c43-bb6e-a187afa9aa5b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:15.269625 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a36d28-2e63-4a41-ad9e-ad7095fdfec6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:15.270250 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a36d28-2e63-4a41-ad9e-ad7095fdfec6 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:15.270532 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a36d28-2e63-4a41-ad9e-ad7095fdfec6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:15.270804 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a36d28-2e63-4a41-ad9e-ad7095fdfec6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:15.282175 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a36d28-2e63-4a41-ad9e-ad7095fdfec6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:15.283808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a36d28-2e63-4a41-ad9e-ad7095fdfec6 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:15.301237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 769/1539] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:33:24.655079 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=28 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:25.292865 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=26 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:52.917956 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e59b42-9a94-402d-bf38-af56d0ae78e1 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:52.923246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e59b42-9a94-402d-bf38-af56d0ae78e1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:52.923246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e59b42-9a94-402d-bf38-af56d0ae78e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:52.953840 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-01e59b42-9a94-402d-bf38-af56d0ae78e1 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:52.955140 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-01e59b42-9a94-402d-bf38-af56d0ae78e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:52.969033 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 771/1540] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:52.996532 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d069ae-dea7-46ff-ab94-4ab91e7d2185 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:52.997449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d069ae-dea7-46ff-ab94-4ab91e7d2185 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:52.997612 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d069ae-dea7-46ff-ab94-4ab91e7d2185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:53.044117 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fc87f-1b45-4adb-8a62-224e5db53daa None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:53.044467 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fc87f-1b45-4adb-8a62-224e5db53daa None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:53.044677 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fc87f-1b45-4adb-8a62-224e5db53daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:53.045565 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-15d069ae-dea7-46ff-ab94-4ab91e7d2185 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:53.052743 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-15d069ae-dea7-46ff-ab94-4ab91e7d2185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:53.069713 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 770/1541] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:34:53.082506 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d069ae-dea7-46ff-ab94-4ab91e7d2185 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:53.090095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f38fc87f-1b45-4adb-8a62-224e5db53daa None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:53.091348 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f38fc87f-1b45-4adb-8a62-224e5db53daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:53.113316 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d069ae-dea7-46ff-ab94-4ab91e7d2185 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:53.123307 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 772/1542] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:53.125733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4046e-f220-45e7-a594-cdbb34508255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:53.126782 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4046e-f220-45e7-a594-cdbb34508255 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:53.127241 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4046e-f220-45e7-a594-cdbb34508255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:53.127751 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4046e-f220-45e7-a594-cdbb34508255 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:53.128906 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4046e-f220-45e7-a594-cdbb34508255 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:34:53.129426 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4046e-f220-45e7-a594-cdbb34508255 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:53.131469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: WARNING py.warnings [None req-f8d4046e-f220-45e7-a594-cdbb34508255 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:34:53.131469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: warnings.warn(msg) Sep 01 16:34:53.131469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: Sep 01 16:34:53.137710 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4046e-f220-45e7-a594-cdbb34508255 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:53.143387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c48e2a-bdc4-4139-8b36-fbc0f1b4c962 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:53.143886 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c48e2a-bdc4-4139-8b36-fbc0f1b4c962 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:53.144397 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c48e2a-bdc4-4139-8b36-fbc0f1b4c962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:53.177372 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 771/1543] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:34:53.186967 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4046e-f220-45e7-a594-cdbb34508255 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:53.206776 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e2c48e2a-bdc4-4139-8b36-fbc0f1b4c962 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:53.209143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e2c48e2a-bdc4-4139-8b36-fbc0f1b4c962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:53.230229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4046e-f220-45e7-a594-cdbb34508255 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:53.248279 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 773/1544] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:53.254027 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c48e2a-bdc4-4139-8b36-fbc0f1b4c962 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:53.255955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78d6cc-084f-4833-ae4c-bf629214d09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:53.257022 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78d6cc-084f-4833-ae4c-bf629214d09f admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:53.257766 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78d6cc-084f-4833-ae4c-bf629214d09f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:53.258221 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78d6cc-084f-4833-ae4c-bf629214d09f admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:53.259289 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78d6cc-084f-4833-ae4c-bf629214d09f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:53.270086 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c48e2a-bdc4-4139-8b36-fbc0f1b4c962 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:53.271660 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78d6cc-084f-4833-ae4c-bf629214d09f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:53.294389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e91b29-100b-4ad2-ab7b-fd3cbc2c470d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:53.295037 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e91b29-100b-4ad2-ab7b-fd3cbc2c470d admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:53.295323 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e91b29-100b-4ad2-ab7b-fd3cbc2c470d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:53.295612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e91b29-100b-4ad2-ab7b-fd3cbc2c470d admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:53.301509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e91b29-100b-4ad2-ab7b-fd3cbc2c470d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:34:53.302222 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e91b29-100b-4ad2-ab7b-fd3cbc2c470d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:53.304270 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e91b29-100b-4ad2-ab7b-fd3cbc2c470d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:53.338300 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 774/1545] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:34:53.340543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf276920-7d31-4b8d-bd31-0126a2141404 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:53.348118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 772/1546] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:34:53 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:34:53.348556 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf276920-7d31-4b8d-bd31-0126a2141404 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:53.349183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf276920-7d31-4b8d-bd31-0126a2141404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:53.357053 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78d6cc-084f-4833-ae4c-bf629214d09f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:53.417070 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-bf276920-7d31-4b8d-bd31-0126a2141404 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:53.422481 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bf276920-7d31-4b8d-bd31-0126a2141404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:53.523374 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78d6cc-084f-4833-ae4c-bf629214d09f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:53.536305 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c04d5c-a880-44d9-a4bb-f77cd1ad6e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:53.537385 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c04d5c-a880-44d9-a4bb-f77cd1ad6e45 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:53.537909 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c04d5c-a880-44d9-a4bb-f77cd1ad6e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:53.538402 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c04d5c-a880-44d9-a4bb-f77cd1ad6e45 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:53.539307 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c04d5c-a880-44d9-a4bb-f77cd1ad6e45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:53.540834 dv-cinder-852209-10-smb devstack@keystone.service[81460]: WARNING py.warnings [None req-c8c04d5c-a880-44d9-a4bb-f77cd1ad6e45 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:34:53.540834 dv-cinder-852209-10-smb devstack@keystone.service[81460]: warnings.warn(msg) Sep 01 16:34:53.540834 dv-cinder-852209-10-smb devstack@keystone.service[81460]: Sep 01 16:34:53.543159 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c04d5c-a880-44d9-a4bb-f77cd1ad6e45 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:53.583559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 775/1547] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:53.587467 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf276920-7d31-4b8d-bd31-0126a2141404 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:53.589529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 773/1548] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:34:53 2022] POST /identity/v3/users => generated 292 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:34:53.592132 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13596f-4ec1-4ec9-af35-1acaad7e3109 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:53.593221 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13596f-4ec1-4ec9-af35-1acaad7e3109 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:53.593514 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13596f-4ec1-4ec9-af35-1acaad7e3109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:53.609506 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf276920-7d31-4b8d-bd31-0126a2141404 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:53.618602 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd30e62-1d87-4eaa-a2c1-9c9aa2ee728a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:53.621675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd30e62-1d87-4eaa-a2c1-9c9aa2ee728a admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:53.622935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd30e62-1d87-4eaa-a2c1-9c9aa2ee728a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:53.623478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd30e62-1d87-4eaa-a2c1-9c9aa2ee728a admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:53.624435 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd30e62-1d87-4eaa-a2c1-9c9aa2ee728a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:53.629641 dv-cinder-852209-10-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-dbd30e62-1d87-4eaa-a2c1-9c9aa2ee728a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:34:53.629641 dv-cinder-852209-10-smb devstack@keystone.service[81459]: warnings.warn(msg) Sep 01 16:34:53.629641 dv-cinder-852209-10-smb devstack@keystone.service[81459]: Sep 01 16:34:53.632172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd30e62-1d87-4eaa-a2c1-9c9aa2ee728a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:53.648572 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-de13596f-4ec1-4ec9-af35-1acaad7e3109 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:53.654556 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-de13596f-4ec1-4ec9-af35-1acaad7e3109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:53.668549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 774/1549] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:53.671091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ac665-61a1-4dcd-90e0-7ce7a3703db4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:53.671340 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ac665-61a1-4dcd-90e0-7ce7a3703db4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:53.671658 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ac665-61a1-4dcd-90e0-7ce7a3703db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:53.694373 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 776/1550] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:34:53 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:53.696153 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab2100-7d0d-47b0-b792-58393db4f124 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:53.696689 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab2100-7d0d-47b0-b792-58393db4f124 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:53.697257 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab2100-7d0d-47b0-b792-58393db4f124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:53.722405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9e9ac665-61a1-4dcd-90e0-7ce7a3703db4 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:53.724071 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9e9ac665-61a1-4dcd-90e0-7ce7a3703db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:53.827582 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 775/1551] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:53.828349 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ac665-61a1-4dcd-90e0-7ce7a3703db4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:53.847957 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ac665-61a1-4dcd-90e0-7ce7a3703db4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:53.854646 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1ce6f-6b46-40a7-98d4-1a89afe88839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:53.855412 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1ce6f-6b46-40a7-98d4-1a89afe88839 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:53.855800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1ce6f-6b46-40a7-98d4-1a89afe88839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:53.856175 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1ce6f-6b46-40a7-98d4-1a89afe88839 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:53.857144 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1ce6f-6b46-40a7-98d4-1a89afe88839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:53.859368 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1ce6f-6b46-40a7-98d4-1a89afe88839 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:53.860562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d1ab2100-7d0d-47b0-b792-58393db4f124 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:53.862011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d1ab2100-7d0d-47b0-b792-58393db4f124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:53.871086 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 777/1552] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:53.871998 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 776/1553] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:53.872260 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2751b-a117-441e-bd2e-ce4c432e9bd8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:53.872546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2751b-a117-441e-bd2e-ce4c432e9bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:53.872844 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2751b-a117-441e-bd2e-ce4c432e9bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:53.876296 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c3126-2d45-4d42-905b-578a5f520008 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:53.876583 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c3126-2d45-4d42-905b-578a5f520008 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:53.876865 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c3126-2d45-4d42-905b-578a5f520008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:53.895131 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-91a2751b-a117-441e-bd2e-ce4c432e9bd8 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:53.896255 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-91a2751b-a117-441e-bd2e-ce4c432e9bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:53.899969 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-bf6c3126-2d45-4d42-905b-578a5f520008 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:53.901940 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-bf6c3126-2d45-4d42-905b-578a5f520008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:53.905293 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 778/1554] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:53.905876 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2751b-a117-441e-bd2e-ce4c432e9bd8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:53.914846 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 777/1555] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:53.916175 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2751b-a117-441e-bd2e-ce4c432e9bd8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:53.917292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ca007-40d0-4ff6-b591-675bb164ca6b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:53.917822 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ca007-40d0-4ff6-b591-675bb164ca6b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:53.918523 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ca007-40d0-4ff6-b591-675bb164ca6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:53.921881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51431e-85a5-4261-ac9f-b79b316576b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:53.922638 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51431e-85a5-4261-ac9f-b79b316576b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:53.922952 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51431e-85a5-4261-ac9f-b79b316576b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:53.923291 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51431e-85a5-4261-ac9f-b79b316576b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:53.923939 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51431e-85a5-4261-ac9f-b79b316576b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:53.925960 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51431e-85a5-4261-ac9f-b79b316576b0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:53.941430 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-d56ca007-40d0-4ff6-b591-675bb164ca6b None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:53.942734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d56ca007-40d0-4ff6-b591-675bb164ca6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:53.950251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 779/1556] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:34:53 2022] POST /identity/v3/users => generated 282 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:53.951397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 778/1557] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:53.951592 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bb4e2-318e-46b9-92de-acb383000ffc None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:53.951909 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bb4e2-318e-46b9-92de-acb383000ffc None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:53.952186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bb4e2-318e-46b9-92de-acb383000ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:53.952520 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294a8c4-e334-4b20-b988-6650a4f5f3e8 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:53.953317 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294a8c4-e334-4b20-b988-6650a4f5f3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:53.953317 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294a8c4-e334-4b20-b988-6650a4f5f3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:53.975233 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-fb4bb4e2-318e-46b9-92de-acb383000ffc None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:53.976472 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fb4bb4e2-318e-46b9-92de-acb383000ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:53.980741 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1294a8c4-e334-4b20-b988-6650a4f5f3e8 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:53.981906 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1294a8c4-e334-4b20-b988-6650a4f5f3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:53.990475 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 779/1558] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:53.991289 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 780/1559] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:53.991416 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294a8c4-e334-4b20-b988-6650a4f5f3e8 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:53.992852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bb4e2-318e-46b9-92de-acb383000ffc None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:54.002732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294a8c4-e334-4b20-b988-6650a4f5f3e8 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:54.009045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c60fcb-96e5-4a1c-a04a-0e22ea8ece67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:54.009669 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c60fcb-96e5-4a1c-a04a-0e22ea8ece67 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:54.009947 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c60fcb-96e5-4a1c-a04a-0e22ea8ece67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:54.010266 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c60fcb-96e5-4a1c-a04a-0e22ea8ece67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:54.010920 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c60fcb-96e5-4a1c-a04a-0e22ea8ece67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:54.012614 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c60fcb-96e5-4a1c-a04a-0e22ea8ece67 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:54.012921 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bb4e2-318e-46b9-92de-acb383000ffc None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:54.019259 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:54.020955 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50a601-0b9b-489d-9928-ba12568dca2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:54.021601 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50a601-0b9b-489d-9928-ba12568dca2b admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:54.022005 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50a601-0b9b-489d-9928-ba12568dca2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:54.022194 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50a601-0b9b-489d-9928-ba12568dca2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:54.022854 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50a601-0b9b-489d-9928-ba12568dca2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:34:54.023160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50a601-0b9b-489d-9928-ba12568dca2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:54.024893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50a601-0b9b-489d-9928-ba12568dca2b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:54.027949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 780/1560] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:54.029876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a3297-41cc-4d18-859f-088be40c921f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:54.030478 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a3297-41cc-4d18-859f-088be40c921f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:54.031270 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a3297-41cc-4d18-859f-088be40c921f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:54.044433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 781/1561] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:34:54.046277 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50a601-0b9b-489d-9928-ba12568dca2b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:54.057711 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-785a3297-41cc-4d18-859f-088be40c921f None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:54.059273 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-785a3297-41cc-4d18-859f-088be40c921f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:54.067042 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50a601-0b9b-489d-9928-ba12568dca2b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:54.067706 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 781/1562] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:54.068573 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a3297-41cc-4d18-859f-088be40c921f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:54.075350 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e847364-840c-4bc6-b94a-91fd562e7585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:54.076237 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e847364-840c-4bc6-b94a-91fd562e7585 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:54.076723 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e847364-840c-4bc6-b94a-91fd562e7585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:54.077753 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e847364-840c-4bc6-b94a-91fd562e7585 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:54.078495 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e847364-840c-4bc6-b94a-91fd562e7585 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:34:54.079869 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a3297-41cc-4d18-859f-088be40c921f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:54.080775 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e847364-840c-4bc6-b94a-91fd562e7585 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:54.083615 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e847364-840c-4bc6-b94a-91fd562e7585 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:54.090845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a473db-c19f-4344-89a7-823f474fcba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:54.091945 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a473db-c19f-4344-89a7-823f474fcba5 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:54.092449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a473db-c19f-4344-89a7-823f474fcba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:54.092981 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a473db-c19f-4344-89a7-823f474fcba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:54.094374 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a473db-c19f-4344-89a7-823f474fcba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:54.097599 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a473db-c19f-4344-89a7-823f474fcba5 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:54.099081 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 782/1563] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:34:54.100367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66756b3-b5e3-4ba6-a363-e2bc6154c2d5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:54.100684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66756b3-b5e3-4ba6-a363-e2bc6154c2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:54.100962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66756b3-b5e3-4ba6-a363-e2bc6154c2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:54.115345 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 782/1564] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:54.116422 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a473db-c19f-4344-89a7-823f474fcba5 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:54.124553 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a66756b3-b5e3-4ba6-a363-e2bc6154c2d5 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:54.126774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a66756b3-b5e3-4ba6-a363-e2bc6154c2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:54.128153 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a473db-c19f-4344-89a7-823f474fcba5 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:54.133194 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e32372-a8e1-4079-8f6b-4594b27997fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:54.133756 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e32372-a8e1-4079-8f6b-4594b27997fc admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:54.134029 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e32372-a8e1-4079-8f6b-4594b27997fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:54.134293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e32372-a8e1-4079-8f6b-4594b27997fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:54.134943 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e32372-a8e1-4079-8f6b-4594b27997fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:34:54.135805 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e32372-a8e1-4079-8f6b-4594b27997fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:54.137481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e32372-a8e1-4079-8f6b-4594b27997fc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:54.141821 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 783/1565] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:54.144072 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a745e7a-44d2-4e31-9546-4fd193f389ca None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:54.144579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a745e7a-44d2-4e31-9546-4fd193f389ca None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:54.145122 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a745e7a-44d2-4e31-9546-4fd193f389ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:54.155439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 783/1566] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:34:54.158121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e32372-a8e1-4079-8f6b-4594b27997fc admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:54.170206 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e32372-a8e1-4079-8f6b-4594b27997fc admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:54.171522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3a745e7a-44d2-4e31-9546-4fd193f389ca None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:54.173680 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3a745e7a-44d2-4e31-9546-4fd193f389ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:54.175723 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae9205-bb8c-4365-bb02-8e6d45028805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:54.176456 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae9205-bb8c-4365-bb02-8e6d45028805 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:54.176761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae9205-bb8c-4365-bb02-8e6d45028805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:54.177027 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae9205-bb8c-4365-bb02-8e6d45028805 admin admin] PATH_INFO: `/v3/projects/0a2c9ab7783944ad9657663f22960220/users/054b27e46b8648979d8777e90748722d/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:54.187855 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 784/1567] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:54.189571 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a745e7a-44d2-4e31-9546-4fd193f389ca None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:54.194068 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae9205-bb8c-4365-bb02-8e6d45028805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a2c9ab7783944ad9657663f22960220, user_id=054b27e46b8648979d8777e90748722d, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:54.196954 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae9205-bb8c-4365-bb02-8e6d45028805 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:54.203089 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a745e7a-44d2-4e31-9546-4fd193f389ca None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:54.208986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a6a4a-3305-49b5-a4ab-3b84346fb2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:54.210015 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a6a4a-3305-49b5-a4ab-3b84346fb2c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:54.210499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a6a4a-3305-49b5-a4ab-3b84346fb2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:54.210986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a6a4a-3305-49b5-a4ab-3b84346fb2c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:54.212099 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a6a4a-3305-49b5-a4ab-3b84346fb2c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:54.216352 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a6a4a-3305-49b5-a4ab-3b84346fb2c8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:54.217543 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 784/1568] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:54 2022] PUT /identity/v3/projects/0a2c9ab7783944ad9657663f22960220/users/054b27e46b8648979d8777e90748722d/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:54.219050 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae9205-bb8c-4365-bb02-8e6d45028805 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:54.255179 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 785/1569] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:34:54 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:54.256110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a6a4a-3305-49b5-a4ab-3b84346fb2c8 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:54.267117 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:54.321370 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae9205-bb8c-4365-bb02-8e6d45028805 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:54.344881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a6a4a-3305-49b5-a4ab-3b84346fb2c8 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:54.353311 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6500cd-e30c-4515-bb1a-ccde815db638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:54.354887 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6500cd-e30c-4515-bb1a-ccde815db638 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:54.355848 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6500cd-e30c-4515-bb1a-ccde815db638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:54.355848 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6500cd-e30c-4515-bb1a-ccde815db638 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:54.357104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6500cd-e30c-4515-bb1a-ccde815db638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:54.361048 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6500cd-e30c-4515-bb1a-ccde815db638 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:54.399597 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 786/1570] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:34:54 2022] POST /identity/v3/projects => generated 405 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:54.400557 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6500cd-e30c-4515-bb1a-ccde815db638 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:54.411496 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d91f0-f8c0-48ca-bbaa-0b991d54d99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:54.412233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d91f0-f8c0-48ca-bbaa-0b991d54d99f admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:54.412644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d91f0-f8c0-48ca-bbaa-0b991d54d99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:54.412988 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d91f0-f8c0-48ca-bbaa-0b991d54d99f admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:54.413667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d91f0-f8c0-48ca-bbaa-0b991d54d99f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:34:54.414138 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d91f0-f8c0-48ca-bbaa-0b991d54d99f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:54.415836 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d91f0-f8c0-48ca-bbaa-0b991d54d99f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:54.433874 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 785/1571] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:34:54.435421 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d91f0-f8c0-48ca-bbaa-0b991d54d99f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:54.452151 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d91f0-f8c0-48ca-bbaa-0b991d54d99f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:54.485627 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6500cd-e30c-4515-bb1a-ccde815db638 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:54.491132 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaee92f-c5c3-476f-bdb2-f1e7eb890d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:54.491775 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaee92f-c5c3-476f-bdb2-f1e7eb890d8d admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:54.492050 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaee92f-c5c3-476f-bdb2-f1e7eb890d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:54.492324 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaee92f-c5c3-476f-bdb2-f1e7eb890d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:54.493069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaee92f-c5c3-476f-bdb2-f1e7eb890d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:54.495229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaee92f-c5c3-476f-bdb2-f1e7eb890d8d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:54.514193 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 787/1572] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:54.515521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaee92f-c5c3-476f-bdb2-f1e7eb890d8d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:54.533096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaee92f-c5c3-476f-bdb2-f1e7eb890d8d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:54.541095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea57ae3-9d1f-4505-9a97-25fbd370f603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:54.542120 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea57ae3-9d1f-4505-9a97-25fbd370f603 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:54.542571 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea57ae3-9d1f-4505-9a97-25fbd370f603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:54.543033 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea57ae3-9d1f-4505-9a97-25fbd370f603 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:54.543374 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:54.544029 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea57ae3-9d1f-4505-9a97-25fbd370f603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:54.547527 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea57ae3-9d1f-4505-9a97-25fbd370f603 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:54.567972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bdb9b-dc1d-4af7-8439-5056a4bf8730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:54.568843 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bdb9b-dc1d-4af7-8439-5056a4bf8730 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:54.569192 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bdb9b-dc1d-4af7-8439-5056a4bf8730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:54.569644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bdb9b-dc1d-4af7-8439-5056a4bf8730 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:54.570757 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bdb9b-dc1d-4af7-8439-5056a4bf8730 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:34:54.571258 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bdb9b-dc1d-4af7-8439-5056a4bf8730 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:54.575015 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bdb9b-dc1d-4af7-8439-5056a4bf8730 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:54.608787 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 786/1573] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:34:54.608787 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bdb9b-dc1d-4af7-8439-5056a4bf8730 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:54.609149 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 788/1574] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:34:54 2022] POST /identity/v3/projects => generated 379 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:54.609149 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce6eb8-dd7c-4b45-a3e5-f03efe70d49c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:54.609149 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce6eb8-dd7c-4b45-a3e5-f03efe70d49c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:54.609149 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce6eb8-dd7c-4b45-a3e5-f03efe70d49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:54.623609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bdb9b-dc1d-4af7-8439-5056a4bf8730 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:54.627370 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-38ce6eb8-dd7c-4b45-a3e5-f03efe70d49c None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:54.628690 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-38ce6eb8-dd7c-4b45-a3e5-f03efe70d49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:54.711774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da961c3-d22e-4e40-a41e-eda4cd829dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:54.712794 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da961c3-d22e-4e40-a41e-eda4cd829dbb admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:54.713286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da961c3-d22e-4e40-a41e-eda4cd829dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:54.714250 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da961c3-d22e-4e40-a41e-eda4cd829dbb admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:54.715342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da961c3-d22e-4e40-a41e-eda4cd829dbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:34:54.715839 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da961c3-d22e-4e40-a41e-eda4cd829dbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:54.718654 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da961c3-d22e-4e40-a41e-eda4cd829dbb admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:54.730390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 789/1575] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:54.731844 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce6eb8-dd7c-4b45-a3e5-f03efe70d49c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:54.740217 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 787/1576] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:34:54.741844 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da961c3-d22e-4e40-a41e-eda4cd829dbb admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:54.748513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce6eb8-dd7c-4b45-a3e5-f03efe70d49c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:54.754950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da961c3-d22e-4e40-a41e-eda4cd829dbb admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:54.756161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790fc2e-490a-451a-94f4-db746bcf3f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:54.757081 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790fc2e-490a-451a-94f4-db746bcf3f01 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:54.757720 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790fc2e-490a-451a-94f4-db746bcf3f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:54.758119 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790fc2e-490a-451a-94f4-db746bcf3f01 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:54.758888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790fc2e-490a-451a-94f4-db746bcf3f01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:54.761484 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f2fd5-3974-4c53-a465-92c6187375e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:54.761904 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790fc2e-490a-451a-94f4-db746bcf3f01 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:54.762291 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f2fd5-3974-4c53-a465-92c6187375e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:54.762639 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f2fd5-3974-4c53-a465-92c6187375e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:54.762976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f2fd5-3974-4c53-a465-92c6187375e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:54.763701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f2fd5-3974-4c53-a465-92c6187375e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:54.765873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f2fd5-3974-4c53-a465-92c6187375e6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:54.771749 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:54.793054 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 790/1577] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:34:54 2022] POST /identity/v3/users => generated 286 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:54.793966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790fc2e-490a-451a-94f4-db746bcf3f01 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:54.804009 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 788/1578] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:34:54 2022] POST /identity/v3/users => generated 303 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:54.805214 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790fc2e-490a-451a-94f4-db746bcf3f01 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:54.805429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f2fd5-3974-4c53-a465-92c6187375e6 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:54.811462 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b6c2a-f6fe-4349-ba7c-2e7655492ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:54.812090 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b6c2a-f6fe-4349-ba7c-2e7655492ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:54.812358 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b6c2a-f6fe-4349-ba7c-2e7655492ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:54.812746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b6c2a-f6fe-4349-ba7c-2e7655492ca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:54.813314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b6c2a-f6fe-4349-ba7c-2e7655492ca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:54.815271 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b6c2a-f6fe-4349-ba7c-2e7655492ca5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:54.825676 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f2fd5-3974-4c53-a465-92c6187375e6 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:54.834897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b32dcb-8205-415b-ad88-6abe96acdf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:54.836269 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b32dcb-8205-415b-ad88-6abe96acdf93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:54.837017 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b32dcb-8205-415b-ad88-6abe96acdf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:54.837795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b32dcb-8205-415b-ad88-6abe96acdf93 admin admin] PATH_INFO: `/v3/projects/50d013642ae346e5a3abf982fe2bac3c/users/4305a714bc114044878092cbed5d4e3c/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:54.849485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 791/1579] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:34:54 2022] POST /identity/v3/projects => generated 389 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:54.850472 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b6c2a-f6fe-4349-ba7c-2e7655492ca5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:54.878182 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b32dcb-8205-415b-ad88-6abe96acdf93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50d013642ae346e5a3abf982fe2bac3c, user_id=4305a714bc114044878092cbed5d4e3c, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:54.884057 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b32dcb-8205-415b-ad88-6abe96acdf93 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:54.908403 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 789/1580] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:54 2022] PUT /identity/v3/projects/50d013642ae346e5a3abf982fe2bac3c/users/4305a714bc114044878092cbed5d4e3c/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:54.909978 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b32dcb-8205-415b-ad88-6abe96acdf93 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:54.943579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b6c2a-f6fe-4349-ba7c-2e7655492ca5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:55.002154 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b32dcb-8205-415b-ad88-6abe96acdf93 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:55.010880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63f871-8c70-4164-9b32-704a0efef60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:55.011923 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63f871-8c70-4164-9b32-704a0efef60e admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:55.012525 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63f871-8c70-4164-9b32-704a0efef60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:55.013062 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63f871-8c70-4164-9b32-704a0efef60e admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:55.014233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63f871-8c70-4164-9b32-704a0efef60e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:55.018249 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63f871-8c70-4164-9b32-704a0efef60e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:55.050490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9397bda-978f-4dab-96b9-265636c9bb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:55.051403 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9397bda-978f-4dab-96b9-265636c9bb40 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:55.051998 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9397bda-978f-4dab-96b9-265636c9bb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:55.052401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9397bda-978f-4dab-96b9-265636c9bb40 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:55.053488 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9397bda-978f-4dab-96b9-265636c9bb40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:55.058027 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9397bda-978f-4dab-96b9-265636c9bb40 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:55.060169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 790/1581] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:34:54 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:55.064661 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63f871-8c70-4164-9b32-704a0efef60e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:55.094007 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 792/1582] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:34:54 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:55.094007 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9397bda-978f-4dab-96b9-265636c9bb40 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:55.097485 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:55.103708 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9397bda-978f-4dab-96b9-265636c9bb40 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:55.153999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63f871-8c70-4164-9b32-704a0efef60e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:55.159330 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4dc496-3515-44cf-960d-4a17f0616c27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:55.160267 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4dc496-3515-44cf-960d-4a17f0616c27 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:55.160656 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4dc496-3515-44cf-960d-4a17f0616c27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:55.161043 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4dc496-3515-44cf-960d-4a17f0616c27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:55.176792 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6d0e3-ceca-4f94-a10a-22a28cd22744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:55.177425 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6d0e3-ceca-4f94-a10a-22a28cd22744 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:55.177677 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6d0e3-ceca-4f94-a10a-22a28cd22744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:55.177958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6d0e3-ceca-4f94-a10a-22a28cd22744 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:55.178609 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6d0e3-ceca-4f94-a10a-22a28cd22744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:55.180560 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6d0e3-ceca-4f94-a10a-22a28cd22744 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:55.191500 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:55.217538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 793/1583] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:34:55 2022] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:55.218400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6d0e3-ceca-4f94-a10a-22a28cd22744 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:55.238527 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4dc496-3515-44cf-960d-4a17f0616c27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:55.240290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4dc496-3515-44cf-960d-4a17f0616c27 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:55.252607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 791/1584] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:55.253539 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4dc496-3515-44cf-960d-4a17f0616c27 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:55.265719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4dc496-3515-44cf-960d-4a17f0616c27 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:55.299890 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6d0e3-ceca-4f94-a10a-22a28cd22744 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:55.305790 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5400ff-7e0e-44e4-b24d-680e8ba3d013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:55.306692 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5400ff-7e0e-44e4-b24d-680e8ba3d013 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:55.307075 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5400ff-7e0e-44e4-b24d-680e8ba3d013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:55.307951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5400ff-7e0e-44e4-b24d-680e8ba3d013 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:55.308735 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5400ff-7e0e-44e4-b24d-680e8ba3d013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:55.310474 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5400ff-7e0e-44e4-b24d-680e8ba3d013 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:55.323250 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 794/1585] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:55.323756 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5400ff-7e0e-44e4-b24d-680e8ba3d013 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:55.339449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5400ff-7e0e-44e4-b24d-680e8ba3d013 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:55.348422 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b5426-cc09-4ba2-b18f-d7ebd2d56231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:55.349609 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b5426-cc09-4ba2-b18f-d7ebd2d56231 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:55.350115 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b5426-cc09-4ba2-b18f-d7ebd2d56231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:55.350572 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b5426-cc09-4ba2-b18f-d7ebd2d56231 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:55.351801 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b5426-cc09-4ba2-b18f-d7ebd2d56231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:55.354014 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b5426-cc09-4ba2-b18f-d7ebd2d56231 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:55.360201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795847f-61c4-43c6-b6da-549bcad02e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:55.361032 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795847f-61c4-43c6-b6da-549bcad02e4f admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:55.361473 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795847f-61c4-43c6-b6da-549bcad02e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:55.361840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795847f-61c4-43c6-b6da-549bcad02e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:55.362598 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795847f-61c4-43c6-b6da-549bcad02e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:55.364995 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795847f-61c4-43c6-b6da-549bcad02e4f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:55.378614 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 792/1586] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:55.380421 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7301b8-ae3f-4c6b-92f3-b3125cbcf756 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:55.380727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7301b8-ae3f-4c6b-92f3-b3125cbcf756 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:55.380999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7301b8-ae3f-4c6b-92f3-b3125cbcf756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:55.387031 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 795/1587] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:34:55 2022] POST /identity/v3/users => generated 295 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:55.388198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b5426-cc09-4ba2-b18f-d7ebd2d56231 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:55.402834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b5426-cc09-4ba2-b18f-d7ebd2d56231 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:55.408787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd26502-c15d-4cb5-986a-083575dadc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:55.409613 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd26502-c15d-4cb5-986a-083575dadc5b admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:55.410078 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd26502-c15d-4cb5-986a-083575dadc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:55.411226 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd26502-c15d-4cb5-986a-083575dadc5b admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:55.411886 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd26502-c15d-4cb5-986a-083575dadc5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:55.413979 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd26502-c15d-4cb5-986a-083575dadc5b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:55.421071 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-cd7301b8-ae3f-4c6b-92f3-b3125cbcf756 None None] MFA Rules not processed for user `4305a714bc114044878092cbed5d4e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:55.422486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cd7301b8-ae3f-4c6b-92f3-b3125cbcf756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:55.455699 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 796/1588] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:34:55 2022] POST /identity/v3/users => generated 289 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:55.457552 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd26502-c15d-4cb5-986a-083575dadc5b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:55.470698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd26502-c15d-4cb5-986a-083575dadc5b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:55.478178 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84bbc09-8639-44f6-b7c5-3afb656addbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:55.479147 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bbc09-8639-44f6-b7c5-3afb656addbc admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:55.479552 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bbc09-8639-44f6-b7c5-3afb656addbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:55.479899 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bbc09-8639-44f6-b7c5-3afb656addbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:55.480800 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84bbc09-8639-44f6-b7c5-3afb656addbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:55.482949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84bbc09-8639-44f6-b7c5-3afb656addbc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:55.497914 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 797/1589] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:55.501695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84bbc09-8639-44f6-b7c5-3afb656addbc admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:55.508026 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:55.515645 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84bbc09-8639-44f6-b7c5-3afb656addbc admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:55.531349 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 793/1590] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:34:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:55.533272 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c547c-3f64-44f9-905e-b69fb7e35473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:55.534003 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7301b8-ae3f-4c6b-92f3-b3125cbcf756 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:55.534334 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c547c-3f64-44f9-905e-b69fb7e35473 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:55.535141 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c547c-3f64-44f9-905e-b69fb7e35473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:55.535654 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c547c-3f64-44f9-905e-b69fb7e35473 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:55.537109 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c547c-3f64-44f9-905e-b69fb7e35473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:55.541114 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c547c-3f64-44f9-905e-b69fb7e35473 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:55.558362 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7301b8-ae3f-4c6b-92f3-b3125cbcf756 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:55.567642 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ae8e0-7b2c-4fcb-ab13-d3e5c1fe544d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:55.568804 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ae8e0-7b2c-4fcb-ab13-d3e5c1fe544d admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:55.569317 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ae8e0-7b2c-4fcb-ab13-d3e5c1fe544d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:55.569821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ae8e0-7b2c-4fcb-ab13-d3e5c1fe544d admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:55.570443 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 798/1591] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:34:55 2022] POST /identity/v3/users => generated 283 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:55.571071 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ae8e0-7b2c-4fcb-ab13-d3e5c1fe544d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:55.572074 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c547c-3f64-44f9-905e-b69fb7e35473 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:55.574599 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ae8e0-7b2c-4fcb-ab13-d3e5c1fe544d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:55.585717 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c547c-3f64-44f9-905e-b69fb7e35473 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:55.592946 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff38255-5486-4d12-816a-ac7d616e5ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:55.593689 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff38255-5486-4d12-816a-ac7d616e5ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:55.594023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff38255-5486-4d12-816a-ac7d616e5ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:55.594397 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff38255-5486-4d12-816a-ac7d616e5ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:55.595106 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff38255-5486-4d12-816a-ac7d616e5ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:55.596911 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff38255-5486-4d12-816a-ac7d616e5ea7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:55.598180 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 794/1592] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:55.599789 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ae8e0-7b2c-4fcb-ab13-d3e5c1fe544d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:55.611072 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 799/1593] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:55.614816 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff38255-5486-4d12-816a-ac7d616e5ea7 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:55.625655 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ae8e0-7b2c-4fcb-ab13-d3e5c1fe544d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:55.635159 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020b0d6-d4a6-46d2-a9fa-30bda2bd8457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:55.636324 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020b0d6-d4a6-46d2-a9fa-30bda2bd8457 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:55.636924 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020b0d6-d4a6-46d2-a9fa-30bda2bd8457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:55.637425 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020b0d6-d4a6-46d2-a9fa-30bda2bd8457 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:55.639390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff38255-5486-4d12-816a-ac7d616e5ea7 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:55.639583 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020b0d6-d4a6-46d2-a9fa-30bda2bd8457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:55.640795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020b0d6-d4a6-46d2-a9fa-30bda2bd8457 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:55.649705 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbdfbf4-2d30-4ccf-ad97-b9f2bb80d1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:55.651505 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdfbf4-2d30-4ccf-ad97-b9f2bb80d1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:55.652324 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdfbf4-2d30-4ccf-ad97-b9f2bb80d1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:55.653075 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdfbf4-2d30-4ccf-ad97-b9f2bb80d1f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:55.654020 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbdfbf4-2d30-4ccf-ad97-b9f2bb80d1f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:55.654366 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 795/1594] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:55.655254 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020b0d6-d4a6-46d2-a9fa-30bda2bd8457 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:55.657878 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbdfbf4-2d30-4ccf-ad97-b9f2bb80d1f2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:55.666569 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020b0d6-d4a6-46d2-a9fa-30bda2bd8457 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:55.674506 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35ac3c-532d-4105-b0fd-d68b0fb1f463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:55.675193 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35ac3c-532d-4105-b0fd-d68b0fb1f463 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:55.675468 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35ac3c-532d-4105-b0fd-d68b0fb1f463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:55.675748 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35ac3c-532d-4105-b0fd-d68b0fb1f463 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:55.676405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35ac3c-532d-4105-b0fd-d68b0fb1f463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:55.678167 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35ac3c-532d-4105-b0fd-d68b0fb1f463 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:55.685292 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 800/1595] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:55.687419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbdfbf4-2d30-4ccf-ad97-b9f2bb80d1f2 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:55.700226 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 796/1596] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:55.702039 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35ac3c-532d-4105-b0fd-d68b0fb1f463 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:55.706970 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbdfbf4-2d30-4ccf-ad97-b9f2bb80d1f2 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:55.712075 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e8ccd-a4da-4a76-bdd6-3db55407aa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:55.712756 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e8ccd-a4da-4a76-bdd6-3db55407aa09 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:55.713001 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e8ccd-a4da-4a76-bdd6-3db55407aa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:55.713315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e8ccd-a4da-4a76-bdd6-3db55407aa09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:55.714586 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35ac3c-532d-4105-b0fd-d68b0fb1f463 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:55.714751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e8ccd-a4da-4a76-bdd6-3db55407aa09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:55.716675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e8ccd-a4da-4a76-bdd6-3db55407aa09 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:55.721741 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca510dc-003d-4e2e-842a-719da0a68593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:55.722955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca510dc-003d-4e2e-842a-719da0a68593 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:55.730152 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca510dc-003d-4e2e-842a-719da0a68593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:55.731611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca510dc-003d-4e2e-842a-719da0a68593 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:55.733194 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca510dc-003d-4e2e-842a-719da0a68593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:55.738055 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca510dc-003d-4e2e-842a-719da0a68593 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:55.755187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 801/1597] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:34:55 2022] POST /identity/v3/projects => generated 363 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:55.755187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e8ccd-a4da-4a76-bdd6-3db55407aa09 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:55.762766 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 797/1598] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:55.764198 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca510dc-003d-4e2e-842a-719da0a68593 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:55.791948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca510dc-003d-4e2e-842a-719da0a68593 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:55.857413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:55.929811 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adeccee-fa90-4256-a11d-c9d2cb1fdbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:55.931083 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adeccee-fa90-4256-a11d-c9d2cb1fdbab admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:55.931694 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adeccee-fa90-4256-a11d-c9d2cb1fdbab admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:55.931990 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e8ccd-a4da-4a76-bdd6-3db55407aa09 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:55.933048 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adeccee-fa90-4256-a11d-c9d2cb1fdbab admin admin] PATH_INFO: `/v3/projects/6e79752d0b7844ba93ee263eb460f800/users/8ced84e972b54efdabcdefa487461f40/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:55.950736 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab3792-b367-4a85-ae58-abef29d59d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:55.952139 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab3792-b367-4a85-ae58-abef29d59d18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:55.953547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab3792-b367-4a85-ae58-abef29d59d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:55.954075 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab3792-b367-4a85-ae58-abef29d59d18 admin admin] PATH_INFO: `/v3/projects/6b01edc3f9ac46628b99394e925c34c4/users/9f1fb4b2451c44bdbe8900d11bccb4cc/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:55.966206 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adeccee-fa90-4256-a11d-c9d2cb1fdbab admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e79752d0b7844ba93ee263eb460f800, user_id=8ced84e972b54efdabcdefa487461f40, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:55.973211 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adeccee-fa90-4256-a11d-c9d2cb1fdbab admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:55.980681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab3792-b367-4a85-ae58-abef29d59d18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b01edc3f9ac46628b99394e925c34c4, user_id=9f1fb4b2451c44bdbe8900d11bccb4cc, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:55.982672 dv-cinder-852209-10-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-a0ab3792-b367-4a85-ae58-abef29d59d18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:34:55.982672 dv-cinder-852209-10-smb devstack@keystone.service[81459]: warnings.warn(msg) Sep 01 16:34:55.982672 dv-cinder-852209-10-smb devstack@keystone.service[81459]: Sep 01 16:34:55.986228 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab3792-b367-4a85-ae58-abef29d59d18 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:56.001803 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 798/1599] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:55 2022] PUT /identity/v3/projects/6e79752d0b7844ba93ee263eb460f800/users/8ced84e972b54efdabcdefa487461f40/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:56.003825 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adeccee-fa90-4256-a11d-c9d2cb1fdbab admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:56.010292 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 802/1600] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:55 2022] PUT /identity/v3/projects/6b01edc3f9ac46628b99394e925c34c4/users/9f1fb4b2451c44bdbe8900d11bccb4cc/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:56.011769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab3792-b367-4a85-ae58-abef29d59d18 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:56.133482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adeccee-fa90-4256-a11d-c9d2cb1fdbab admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:56.162254 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab3792-b367-4a85-ae58-abef29d59d18 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:56.171558 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383fcfa-d2a8-478a-9f35-d023d51beab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:56.172844 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383fcfa-d2a8-478a-9f35-d023d51beab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:56.173459 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383fcfa-d2a8-478a-9f35-d023d51beab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:56.174107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383fcfa-d2a8-478a-9f35-d023d51beab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:56.175506 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383fcfa-d2a8-478a-9f35-d023d51beab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:56.178897 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383fcfa-d2a8-478a-9f35-d023d51beab1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:56.195354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:56.207285 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 803/1601] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:56.209207 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383fcfa-d2a8-478a-9f35-d023d51beab1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:56.235842 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383fcfa-d2a8-478a-9f35-d023d51beab1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:56.246162 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20dba8-f7e6-4a59-8fc3-ac68b12e8cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:56.248221 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20dba8-f7e6-4a59-8fc3-ac68b12e8cdb admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:56.248501 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20dba8-f7e6-4a59-8fc3-ac68b12e8cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:56.248803 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20dba8-f7e6-4a59-8fc3-ac68b12e8cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:56.249476 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20dba8-f7e6-4a59-8fc3-ac68b12e8cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:56.251138 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20dba8-f7e6-4a59-8fc3-ac68b12e8cdb admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:56.253279 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126dbaf-732c-49a4-af63-7a932249b8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:56.253991 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126dbaf-732c-49a4-af63-7a932249b8d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:56.255039 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126dbaf-732c-49a4-af63-7a932249b8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:56.255039 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126dbaf-732c-49a4-af63-7a932249b8d3 admin admin] PATH_INFO: `/v3/projects/8d258cb405d2424da6fd606bafa774d0/users/071e0d407c6e4353b491c246700c3e41/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:56.271699 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 799/1602] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:56.271699 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20dba8-f7e6-4a59-8fc3-ac68b12e8cdb admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:56.284493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20dba8-f7e6-4a59-8fc3-ac68b12e8cdb admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:56.291979 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bd606-0ee0-4569-8a73-01830ce7a9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:56.294716 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126dbaf-732c-49a4-af63-7a932249b8d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d258cb405d2424da6fd606bafa774d0, user_id=071e0d407c6e4353b491c246700c3e41, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:56.297451 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bd606-0ee0-4569-8a73-01830ce7a9d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:56.298253 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126dbaf-732c-49a4-af63-7a932249b8d3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:56.298865 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bd606-0ee0-4569-8a73-01830ce7a9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:56.299718 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bd606-0ee0-4569-8a73-01830ce7a9d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:56.302127 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9bd606-0ee0-4569-8a73-01830ce7a9d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:56.307835 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9bd606-0ee0-4569-8a73-01830ce7a9d6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:56.322361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 804/1603] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:56 2022] PUT /identity/v3/projects/8d258cb405d2424da6fd606bafa774d0/users/071e0d407c6e4353b491c246700c3e41/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:56.324014 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126dbaf-732c-49a4-af63-7a932249b8d3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:56.353149 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 800/1604] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:34:56 2022] POST /identity/v3/users => generated 288 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:56.356157 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52c21a-99e9-4102-a356-e8c5e2c9b4d0 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:56.357297 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52c21a-99e9-4102-a356-e8c5e2c9b4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:56.358565 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52c21a-99e9-4102-a356-e8c5e2c9b4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:56.405085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8f52c21a-99e9-4102-a356-e8c5e2c9b4d0 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:56.408765 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8f52c21a-99e9-4102-a356-e8c5e2c9b4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:56.472124 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126dbaf-732c-49a4-af63-7a932249b8d3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:56.481735 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55596809-35e8-40e2-9222-7dabea6b3622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:56.482795 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55596809-35e8-40e2-9222-7dabea6b3622 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:56.483290 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55596809-35e8-40e2-9222-7dabea6b3622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:56.483785 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55596809-35e8-40e2-9222-7dabea6b3622 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:56.485059 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55596809-35e8-40e2-9222-7dabea6b3622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:56.487985 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55596809-35e8-40e2-9222-7dabea6b3622 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:56.502118 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 805/1605] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:56.503532 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f49ec-6f67-451e-9ba1-6767d36e2e77 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:56.503772 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f49ec-6f67-451e-9ba1-6767d36e2e77 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:56.504131 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f49ec-6f67-451e-9ba1-6767d36e2e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:56.551644 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d93f49ec-6f67-451e-9ba1-6767d36e2e77 None None] MFA Rules not processed for user `9f1fb4b2451c44bdbe8900d11bccb4cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:56.554318 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d93f49ec-6f67-451e-9ba1-6767d36e2e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:56.560793 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 801/1606] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:56.561877 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52c21a-99e9-4102-a356-e8c5e2c9b4d0 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:56.579136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52c21a-99e9-4102-a356-e8c5e2c9b4d0 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:56.585321 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165e700-f32d-4aae-ac61-3cb770a217c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:56.586074 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165e700-f32d-4aae-ac61-3cb770a217c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:56.586406 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165e700-f32d-4aae-ac61-3cb770a217c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:56.586685 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165e700-f32d-4aae-ac61-3cb770a217c8 admin admin] PATH_INFO: `/v3/projects/bf496edaad3447d4b46bca012a047180/users/3fb9d9c35c224ceabcb12fe5933e09c5/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:56.610359 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:56.612356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165e700-f32d-4aae-ac61-3cb770a217c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf496edaad3447d4b46bca012a047180, user_id=3fb9d9c35c224ceabcb12fe5933e09c5, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:56.620922 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165e700-f32d-4aae-ac61-3cb770a217c8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:56.664056 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 802/1607] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:56 2022] PUT /identity/v3/projects/bf496edaad3447d4b46bca012a047180/users/3fb9d9c35c224ceabcb12fe5933e09c5/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:56.666422 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165e700-f32d-4aae-ac61-3cb770a217c8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:56.741964 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 806/1608] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:34:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:56.744420 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eceebf-dc83-4593-b6d4-1d84e1c26dc3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:56.745606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eceebf-dc83-4593-b6d4-1d84e1c26dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:56.745991 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eceebf-dc83-4593-b6d4-1d84e1c26dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:56.798986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b6eceebf-dc83-4593-b6d4-1d84e1c26dc3 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:56.801545 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b6eceebf-dc83-4593-b6d4-1d84e1c26dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:56.811847 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165e700-f32d-4aae-ac61-3cb770a217c8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:56.821350 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc7a54-a59e-4078-ab77-7c0e5a7386d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:56.822809 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc7a54-a59e-4078-ab77-7c0e5a7386d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:56.824099 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc7a54-a59e-4078-ab77-7c0e5a7386d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:56.824099 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc7a54-a59e-4078-ab77-7c0e5a7386d8 admin admin] PATH_INFO: `/v3/projects/bf3125e6cbeb4630a46b29d03b780714/users/e08b6d367dc542f882cb821abd11cc34/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:56.832973 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 807/1609] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:56.834206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eceebf-dc83-4593-b6d4-1d84e1c26dc3 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:56.860139 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eceebf-dc83-4593-b6d4-1d84e1c26dc3 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:56.865816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc7a54-a59e-4078-ab77-7c0e5a7386d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf3125e6cbeb4630a46b29d03b780714, user_id=e08b6d367dc542f882cb821abd11cc34, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:56.869347 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23340749-81cc-4037-af2c-e531d27d9092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:56.870849 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23340749-81cc-4037-af2c-e531d27d9092 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:56.871286 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23340749-81cc-4037-af2c-e531d27d9092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:56.871724 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23340749-81cc-4037-af2c-e531d27d9092 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:56.872554 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23340749-81cc-4037-af2c-e531d27d9092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:56.873766 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc7a54-a59e-4078-ab77-7c0e5a7386d8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:56.875599 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23340749-81cc-4037-af2c-e531d27d9092 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:56.894029 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 808/1610] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:56.899840 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23340749-81cc-4037-af2c-e531d27d9092 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:56.909272 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 803/1611] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:56 2022] PUT /identity/v3/projects/bf3125e6cbeb4630a46b29d03b780714/users/e08b6d367dc542f882cb821abd11cc34/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:56.910669 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc7a54-a59e-4078-ab77-7c0e5a7386d8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:56.925147 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23340749-81cc-4037-af2c-e531d27d9092 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:56.938820 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:57.014531 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc7a54-a59e-4078-ab77-7c0e5a7386d8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:57.019278 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466a8ed-5774-4b58-9271-823a70492f1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:57.019927 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466a8ed-5774-4b58-9271-823a70492f1e service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:57.020594 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466a8ed-5774-4b58-9271-823a70492f1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:57.020914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466a8ed-5774-4b58-9271-823a70492f1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:57.049614 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724f3d4-7be8-4690-833f-c4476968b2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:57.050826 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724f3d4-7be8-4690-833f-c4476968b2b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:57.051316 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724f3d4-7be8-4690-833f-c4476968b2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:57.051803 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724f3d4-7be8-4690-833f-c4476968b2b4 admin admin] PATH_INFO: `/v3/projects/cb26f305b6c540aa9012cf9decf20f2b/users/00710e68e7bb4a2fa6d24e1963cdeecc/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:57.094842 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724f3d4-7be8-4690-833f-c4476968b2b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb26f305b6c540aa9012cf9decf20f2b, user_id=00710e68e7bb4a2fa6d24e1963cdeecc, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:57.100904 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724f3d4-7be8-4690-833f-c4476968b2b4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:57.131974 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 809/1612] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:56 2022] PUT /identity/v3/projects/cb26f305b6c540aa9012cf9decf20f2b/users/00710e68e7bb4a2fa6d24e1963cdeecc/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:57.134401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb712f3-1090-4abd-a4ee-3ed17936d9ff None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:57.137952 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb712f3-1090-4abd-a4ee-3ed17936d9ff None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:57.138355 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb712f3-1090-4abd-a4ee-3ed17936d9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:57.185048 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1cb712f3-1090-4abd-a4ee-3ed17936d9ff None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:57.186649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1cb712f3-1090-4abd-a4ee-3ed17936d9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:57.201260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466a8ed-5774-4b58-9271-823a70492f1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:57.207456 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466a8ed-5774-4b58-9271-823a70492f1e service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:57.247910 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 804/1613] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:57.265639 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49e93f-f843-4c96-abaa-278f617e244d None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:57.266090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49e93f-f843-4c96-abaa-278f617e244d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:57.266572 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49e93f-f843-4c96-abaa-278f617e244d None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:57.294036 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 805/1614] 10.222.0.52 () {54 vars in 962 bytes} [Thu Sep 1 16:34:57 2022] GET /identity => generated 270 bytes in 31 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:34:57.299558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49e93f-f843-4c96-abaa-278f617e244d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:57.325351 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 810/1615] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:57.325351 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb712f3-1090-4abd-a4ee-3ed17936d9ff None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:57.361374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb712f3-1090-4abd-a4ee-3ed17936d9ff None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:57.372056 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a57d25-e827-41fb-99dd-1e368141e6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:57.374012 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a57d25-e827-41fb-99dd-1e368141e6c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:57.374524 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a57d25-e827-41fb-99dd-1e368141e6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:57.375015 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a57d25-e827-41fb-99dd-1e368141e6c1 admin admin] PATH_INFO: `/v3/projects/89adb08031b049c4860e725a109cbf03/users/ce6f2f65c5324793bde69a2ae9916bc8/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:57.400692 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a57d25-e827-41fb-99dd-1e368141e6c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89adb08031b049c4860e725a109cbf03, user_id=ce6f2f65c5324793bde69a2ae9916bc8, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:57.407157 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a57d25-e827-41fb-99dd-1e368141e6c1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:57.422113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:57.446994 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 811/1616] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:57 2022] PUT /identity/v3/projects/89adb08031b049c4860e725a109cbf03/users/ce6f2f65c5324793bde69a2ae9916bc8/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:57.449603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41ac02-9fd7-4aaa-931f-beb4e361e2ec None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:57.449890 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41ac02-9fd7-4aaa-931f-beb4e361e2ec None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:57.450333 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41ac02-9fd7-4aaa-931f-beb4e361e2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:57.477574 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49e93f-f843-4c96-abaa-278f617e244d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:57.509330 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1a41ac02-9fd7-4aaa-931f-beb4e361e2ec None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:57.513754 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1a41ac02-9fd7-4aaa-931f-beb4e361e2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:57.648673 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 812/1617] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:57.649494 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c91481-4834-43fb-9281-d47f7b72975d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:57.649785 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c91481-4834-43fb-9281-d47f7b72975d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:57.650064 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c91481-4834-43fb-9281-d47f7b72975d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:57.671198 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831d492-1a5d-4f77-8f16-9453ff1088f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:57.672108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831d492-1a5d-4f77-8f16-9453ff1088f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:57.672543 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831d492-1a5d-4f77-8f16-9453ff1088f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:57.673591 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831d492-1a5d-4f77-8f16-9453ff1088f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:57.686145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831d492-1a5d-4f77-8f16-9453ff1088f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:57.687919 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831d492-1a5d-4f77-8f16-9453ff1088f6 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:57.702435 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 806/1618] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:57.703900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61003cbe-85d6-404e-9a78-8441bca5efd2 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:57.704190 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61003cbe-85d6-404e-9a78-8441bca5efd2 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:57.704466 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61003cbe-85d6-404e-9a78-8441bca5efd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:57.722681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e5c91481-4834-43fb-9281-d47f7b72975d None None] MFA Rules not processed for user `00710e68e7bb4a2fa6d24e1963cdeecc`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:57.725616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e5c91481-4834-43fb-9281-d47f7b72975d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:57.887040 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-61003cbe-85d6-404e-9a78-8441bca5efd2 None None] MFA Rules not processed for user `55f389ab3ea046008b44f129113de995`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:57.887040 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-61003cbe-85d6-404e-9a78-8441bca5efd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:57.887040 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:57.935584 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 813/1619] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:34:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:57.935584 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c91481-4834-43fb-9281-d47f7b72975d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:57.942648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e5c91481-4834-43fb-9281-d47f7b72975d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:57.974923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c91481-4834-43fb-9281-d47f7b72975d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:57.990320 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe78051-76e2-4e6e-85d3-6b092eb4da56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:57.991668 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe78051-76e2-4e6e-85d3-6b092eb4da56 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:57.992142 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe78051-76e2-4e6e-85d3-6b092eb4da56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:57.992465 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe78051-76e2-4e6e-85d3-6b092eb4da56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:58.025265 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe78051-76e2-4e6e-85d3-6b092eb4da56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:58.027394 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe78051-76e2-4e6e-85d3-6b092eb4da56 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:58.041403 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 807/1620] 10.222.0.52 () {58 vars in 1059 bytes} [Thu Sep 1 16:34:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:58.042765 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61003cbe-85d6-404e-9a78-8441bca5efd2 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:58.060829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 814/1621] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:58.061793 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe78051-76e2-4e6e-85d3-6b092eb4da56 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:58.063515 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61003cbe-85d6-404e-9a78-8441bca5efd2 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:58.082802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb002fdc-ac5d-4b0f-95c8-b9b996648dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:58.083483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb002fdc-ac5d-4b0f-95c8-b9b996648dee admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:58.087146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb002fdc-ac5d-4b0f-95c8-b9b996648dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:58.087497 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb002fdc-ac5d-4b0f-95c8-b9b996648dee admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:58.089930 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb002fdc-ac5d-4b0f-95c8-b9b996648dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:58.092228 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe78051-76e2-4e6e-85d3-6b092eb4da56 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:58.093745 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb002fdc-ac5d-4b0f-95c8-b9b996648dee admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:58.102600 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e04712-d2e7-40fb-a7fc-33512d14b23e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:58.103227 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e04712-d2e7-40fb-a7fc-33512d14b23e service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:58.103503 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e04712-d2e7-40fb-a7fc-33512d14b23e service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:58.103778 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e04712-d2e7-40fb-a7fc-33512d14b23e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:58.119271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 808/1622] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:58.128163 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb002fdc-ac5d-4b0f-95c8-b9b996648dee admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:58.139308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e04712-d2e7-40fb-a7fc-33512d14b23e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:58.140964 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e04712-d2e7-40fb-a7fc-33512d14b23e service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:58.153555 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb002fdc-ac5d-4b0f-95c8-b9b996648dee admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:58.160061 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 815/1623] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:58.161368 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e04712-d2e7-40fb-a7fc-33512d14b23e service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:58.165334 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d81707-c2f2-4ff5-a290-731ea4628673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:58.165965 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d81707-c2f2-4ff5-a290-731ea4628673 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:58.166240 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d81707-c2f2-4ff5-a290-731ea4628673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:58.166530 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d81707-c2f2-4ff5-a290-731ea4628673 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:58.167700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d81707-c2f2-4ff5-a290-731ea4628673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:58.176184 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d81707-c2f2-4ff5-a290-731ea4628673 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:58.180758 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e04712-d2e7-40fb-a7fc-33512d14b23e service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:58.187531 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568dd70-c490-4c26-b73d-07aa554d0fbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:58.188276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568dd70-c490-4c26-b73d-07aa554d0fbb service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:58.188599 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568dd70-c490-4c26-b73d-07aa554d0fbb service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:58.189290 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568dd70-c490-4c26-b73d-07aa554d0fbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:58.250877 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 809/1624] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:34:58 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:58.252580 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d81707-c2f2-4ff5-a290-731ea4628673 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:58.293665 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568dd70-c490-4c26-b73d-07aa554d0fbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:58.296035 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568dd70-c490-4c26-b73d-07aa554d0fbb service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:58.311438 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 816/1625] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:58.312927 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568dd70-c490-4c26-b73d-07aa554d0fbb service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:58.320015 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:58.330987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568dd70-c490-4c26-b73d-07aa554d0fbb service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:58.500349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df0cb5-b05d-48c5-908a-bbadb9279558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:58.501415 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df0cb5-b05d-48c5-908a-bbadb9279558 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:58.506408 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df0cb5-b05d-48c5-908a-bbadb9279558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:58.507274 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df0cb5-b05d-48c5-908a-bbadb9279558 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:58.508429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df0cb5-b05d-48c5-908a-bbadb9279558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:58.515781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df0cb5-b05d-48c5-908a-bbadb9279558 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:58.538021 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d81707-c2f2-4ff5-a290-731ea4628673 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:58.563074 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421ee33-20e0-4819-8029-77e533f17048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:58.569842 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421ee33-20e0-4819-8029-77e533f17048 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:58.570342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421ee33-20e0-4819-8029-77e533f17048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:58.570733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421ee33-20e0-4819-8029-77e533f17048 admin admin] PATH_INFO: `/v3/projects/89adb08031b049c4860e725a109cbf03/users/ce6f2f65c5324793bde69a2ae9916bc8/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:58.573212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421ee33-20e0-4819-8029-77e533f17048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89adb08031b049c4860e725a109cbf03, user_id=ce6f2f65c5324793bde69a2ae9916bc8, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:58.580876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421ee33-20e0-4819-8029-77e533f17048 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:58.594640 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 817/1626] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:34:58 2022] POST /identity/v3/users => generated 289 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:34:58.600831 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df0cb5-b05d-48c5-908a-bbadb9279558 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:58.621287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 810/1627] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:58 2022] PUT /identity/v3/projects/89adb08031b049c4860e725a109cbf03/users/ce6f2f65c5324793bde69a2ae9916bc8/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:58.633615 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d4606-11a8-48c9-b1c8-93a4c3c8c6e7 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:58.634017 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d4606-11a8-48c9-b1c8-93a4c3c8c6e7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:58.634398 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d4606-11a8-48c9-b1c8-93a4c3c8c6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:58.637311 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df0cb5-b05d-48c5-908a-bbadb9279558 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:58.734310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ac7d4606-11a8-48c9-b1c8-93a4c3c8c6e7 None None] MFA Rules not processed for user `ce6f2f65c5324793bde69a2ae9916bc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:58.735833 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ac7d4606-11a8-48c9-b1c8-93a4c3c8c6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:58.756460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54693ca4-2401-47bb-bc5f-c19f34057e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:58.758143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54693ca4-2401-47bb-bc5f-c19f34057e88 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:58.758422 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54693ca4-2401-47bb-bc5f-c19f34057e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:58.758688 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54693ca4-2401-47bb-bc5f-c19f34057e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:58.759368 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54693ca4-2401-47bb-bc5f-c19f34057e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:58.766198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54693ca4-2401-47bb-bc5f-c19f34057e88 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:58.801066 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 818/1628] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:58.808062 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54693ca4-2401-47bb-bc5f-c19f34057e88 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:58.822101 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54693ca4-2401-47bb-bc5f-c19f34057e88 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:58.849227 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d468ff0-3d2a-4275-9a02-814143f90aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:58.851334 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d468ff0-3d2a-4275-9a02-814143f90aaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:58.852373 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d468ff0-3d2a-4275-9a02-814143f90aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:58.852733 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d468ff0-3d2a-4275-9a02-814143f90aaf admin admin] PATH_INFO: `/v3/projects/54052fe7cc3148c098e30e7702091e88/users/c34bad40caba4309b25f8cec92e29294/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:58.881508 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d468ff0-3d2a-4275-9a02-814143f90aaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=54052fe7cc3148c098e30e7702091e88, user_id=c34bad40caba4309b25f8cec92e29294, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:58.887064 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d468ff0-3d2a-4275-9a02-814143f90aaf admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:58.887885 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:58.930559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 819/1629] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:58 2022] PUT /identity/v3/projects/54052fe7cc3148c098e30e7702091e88/users/c34bad40caba4309b25f8cec92e29294/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:58.932498 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d468ff0-3d2a-4275-9a02-814143f90aaf admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:58.950441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 811/1630] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:34:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:58.972101 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d4606-11a8-48c9-b1c8-93a4c3c8c6e7 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:59.046098 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d468ff0-3d2a-4275-9a02-814143f90aaf admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:59.060842 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69cc119-048d-464d-9373-72a1e405daf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:59.062257 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cc119-048d-464d-9373-72a1e405daf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:59.062663 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cc119-048d-464d-9373-72a1e405daf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:59.063126 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cc119-048d-464d-9373-72a1e405daf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:59.063930 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69cc119-048d-464d-9373-72a1e405daf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:59.066124 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69cc119-048d-464d-9373-72a1e405daf6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:59.074379 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:59.088384 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 820/1631] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:34:59.090829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddd60b-36ff-4e99-a98d-30fcd7eefd73 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:59.091284 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddd60b-36ff-4e99-a98d-30fcd7eefd73 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:59.091767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddd60b-36ff-4e99-a98d-30fcd7eefd73 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:59.106679 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 821/1632] 10.222.0.52 () {54 vars in 912 bytes} [Thu Sep 1 16:34:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:34:59.109233 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ddd60b-36ff-4e99-a98d-30fcd7eefd73 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:59.145031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d4606-11a8-48c9-b1c8-93a4c3c8c6e7 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:59.149867 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ddd60b-36ff-4e99-a98d-30fcd7eefd73 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:59.171511 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65ee77-d9f8-4d95-a5cb-b8e8870faba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:59.172349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65ee77-d9f8-4d95-a5cb-b8e8870faba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:59.173363 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65ee77-d9f8-4d95-a5cb-b8e8870faba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:59.174433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65ee77-d9f8-4d95-a5cb-b8e8870faba2 admin admin] PATH_INFO: `/v3/projects/54052fe7cc3148c098e30e7702091e88/users/c34bad40caba4309b25f8cec92e29294/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:59.180948 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65ee77-d9f8-4d95-a5cb-b8e8870faba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54052fe7cc3148c098e30e7702091e88, user_id=c34bad40caba4309b25f8cec92e29294, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:59.190686 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65ee77-d9f8-4d95-a5cb-b8e8870faba2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:59.227384 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 822/1633] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:34:59 2022] PUT /identity/v3/projects/54052fe7cc3148c098e30e7702091e88/users/c34bad40caba4309b25f8cec92e29294/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:34:59.230681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942dacf-593b-4fdf-8538-692be078ce1d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:59.234916 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942dacf-593b-4fdf-8538-692be078ce1d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:59.244462 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942dacf-593b-4fdf-8538-692be078ce1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:59.298751 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ce951-6c4a-4f8a-9aa1-fef9b9030af9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:59.299641 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ce951-6c4a-4f8a-9aa1-fef9b9030af9 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:59.299641 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ce951-6c4a-4f8a-9aa1-fef9b9030af9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:59.299938 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ce951-6c4a-4f8a-9aa1-fef9b9030af9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:59.301505 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b942dacf-593b-4fdf-8538-692be078ce1d None None] MFA Rules not processed for user `55f389ab3ea046008b44f129113de995`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:59.305257 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b942dacf-593b-4fdf-8538-692be078ce1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:59.399259 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ce951-6c4a-4f8a-9aa1-fef9b9030af9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:59.400856 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ce951-6c4a-4f8a-9aa1-fef9b9030af9 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:59.414732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 812/1634] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:59.416427 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc62aa2-c3e2-49a0-a433-b1f205843a4b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:59.417350 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc62aa2-c3e2-49a0-a433-b1f205843a4b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:59.417703 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc62aa2-c3e2-49a0-a433-b1f205843a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:59.457544 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-cbc62aa2-c3e2-49a0-a433-b1f205843a4b None None] MFA Rules not processed for user `c34bad40caba4309b25f8cec92e29294`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:59.458873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cbc62aa2-c3e2-49a0-a433-b1f205843a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:59.529077 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:59.547866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 823/1635] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 1 16:34:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:59.577209 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942dacf-593b-4fdf-8538-692be078ce1d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:59.584766 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 813/1636] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:34:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:59.623069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc62aa2-c3e2-49a0-a433-b1f205843a4b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:59.773723 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc62aa2-c3e2-49a0-a433-b1f205843a4b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:59.783459 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942dacf-593b-4fdf-8538-692be078ce1d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:59.786719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c4801-2b67-4feb-89e1-cd957f42a20d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:59.787616 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c4801-2b67-4feb-89e1-cd957f42a20d service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:59.787824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c4801-2b67-4feb-89e1-cd957f42a20d service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:59.789701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c4801-2b67-4feb-89e1-cd957f42a20d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:59.798607 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3c89e-8507-4703-8f07-b0a961cd91da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:59.799256 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3c89e-8507-4703-8f07-b0a961cd91da service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:59.799547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3c89e-8507-4703-8f07-b0a961cd91da service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:59.800197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3c89e-8507-4703-8f07-b0a961cd91da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:59.819612 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c4801-2b67-4feb-89e1-cd957f42a20d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:59.822378 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3c89e-8507-4703-8f07-b0a961cd91da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:59.822568 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c4801-2b67-4feb-89e1-cd957f42a20d service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:59.824940 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3c89e-8507-4703-8f07-b0a961cd91da service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:59.838105 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 824/1637] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:59.841318 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799542a-eea3-495b-89f2-5a28eb1b455d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:59.842007 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799542a-eea3-495b-89f2-5a28eb1b455d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:59.842741 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799542a-eea3-495b-89f2-5a28eb1b455d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:59.851911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 814/1638] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:59.919583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4799542a-eea3-495b-89f2-5a28eb1b455d None None] MFA Rules not processed for user `8ced84e972b54efdabcdefa487461f40`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:59.925553 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4799542a-eea3-495b-89f2-5a28eb1b455d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:00.116013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 825/1639] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:34:59 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:00.120467 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c4801-2b67-4feb-89e1-cd957f42a20d service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:00.153958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799542a-eea3-495b-89f2-5a28eb1b455d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:00.207082 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799542a-eea3-495b-89f2-5a28eb1b455d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:00.207082 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264309f-65fb-4353-8c56-508f694bb7a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:00.207082 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264309f-65fb-4353-8c56-508f694bb7a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:00.207082 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264309f-65fb-4353-8c56-508f694bb7a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:00.207790 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264309f-65fb-4353-8c56-508f694bb7a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:00.256929 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:00.359767 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c4801-2b67-4feb-89e1-cd957f42a20d service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:00.375015 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45feab65-54d2-4f1b-9298-cc8d5ee461f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:00.375676 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45feab65-54d2-4f1b-9298-cc8d5ee461f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:00.377196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45feab65-54d2-4f1b-9298-cc8d5ee461f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:00.377500 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45feab65-54d2-4f1b-9298-cc8d5ee461f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:00.380156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45feab65-54d2-4f1b-9298-cc8d5ee461f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:00.383285 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45feab65-54d2-4f1b-9298-cc8d5ee461f4 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:00.406741 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264309f-65fb-4353-8c56-508f694bb7a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:00.408350 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264309f-65fb-4353-8c56-508f694bb7a1 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:00.433689 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 826/1640] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:35:00.447197 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 815/1641] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:00 2022] POST /identity/v3/projects => generated 405 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:00.456746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264309f-65fb-4353-8c56-508f694bb7a1 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:00.470552 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264309f-65fb-4353-8c56-508f694bb7a1 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:00.674124 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d3379-67d6-4380-b9cc-1962654341ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:00.675187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d3379-67d6-4380-b9cc-1962654341ac admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:00.676454 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d3379-67d6-4380-b9cc-1962654341ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:00.676454 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d3379-67d6-4380-b9cc-1962654341ac admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:00.676935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d3379-67d6-4380-b9cc-1962654341ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:00.698157 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d3379-67d6-4380-b9cc-1962654341ac admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:00.806505 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 827/1642] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:00 2022] POST /identity/v3/users => generated 309 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:35:00.816403 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45feab65-54d2-4f1b-9298-cc8d5ee461f4 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:00.860390 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45feab65-54d2-4f1b-9298-cc8d5ee461f4 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:00.873998 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba97641-bd52-4c94-b54e-c35ea2c29f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:00.875960 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba97641-bd52-4c94-b54e-c35ea2c29f4e admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:00.878018 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba97641-bd52-4c94-b54e-c35ea2c29f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:00.878861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba97641-bd52-4c94-b54e-c35ea2c29f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:00.880299 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba97641-bd52-4c94-b54e-c35ea2c29f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:00.884217 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba97641-bd52-4c94-b54e-c35ea2c29f4e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:00.935812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 816/1643] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:00.940900 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d3379-67d6-4380-b9cc-1962654341ac admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:00.972296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d3379-67d6-4380-b9cc-1962654341ac admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:00.982627 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679c7ee-1e69-4d42-9ff8-70e440496f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:00.983877 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679c7ee-1e69-4d42-9ff8-70e440496f68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:00.984352 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679c7ee-1e69-4d42-9ff8-70e440496f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:00.986645 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679c7ee-1e69-4d42-9ff8-70e440496f68 admin admin] PATH_INFO: `/v3/projects/5cbff20d01b346f9b365ad05a74fb418/users/a788bc9c753d4be5adf2f152f5d4a34e/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:01.033101 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679c7ee-1e69-4d42-9ff8-70e440496f68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cbff20d01b346f9b365ad05a74fb418, user_id=a788bc9c753d4be5adf2f152f5d4a34e, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:01.039322 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679c7ee-1e69-4d42-9ff8-70e440496f68 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:01.074480 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 828/1644] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:00 2022] PUT /identity/v3/projects/5cbff20d01b346f9b365ad05a74fb418/users/a788bc9c753d4be5adf2f152f5d4a34e/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:01.082611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba97641-bd52-4c94-b54e-c35ea2c29f4e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:01.114407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba97641-bd52-4c94-b54e-c35ea2c29f4e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:01.278228 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459606b-deb9-4580-9e43-6c1563c34d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:01.279235 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459606b-deb9-4580-9e43-6c1563c34d60 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:01.284060 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459606b-deb9-4580-9e43-6c1563c34d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:01.284679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459606b-deb9-4580-9e43-6c1563c34d60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:01.287638 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459606b-deb9-4580-9e43-6c1563c34d60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:01.297373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459606b-deb9-4580-9e43-6c1563c34d60 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:01.312265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:01.357141 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 817/1645] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:01.358412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679c7ee-1e69-4d42-9ff8-70e440496f68 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:01.404559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679c7ee-1e69-4d42-9ff8-70e440496f68 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:01.444048 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181c76f-474b-45bc-b90e-4bb42711cb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:01.445569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181c76f-474b-45bc-b90e-4bb42711cb63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:01.446326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181c76f-474b-45bc-b90e-4bb42711cb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:01.446522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181c76f-474b-45bc-b90e-4bb42711cb63 admin admin] PATH_INFO: `/v3/projects/5cbff20d01b346f9b365ad05a74fb418/users/a788bc9c753d4be5adf2f152f5d4a34e/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:01.460517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181c76f-474b-45bc-b90e-4bb42711cb63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cbff20d01b346f9b365ad05a74fb418, user_id=a788bc9c753d4be5adf2f152f5d4a34e, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:01.479093 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181c76f-474b-45bc-b90e-4bb42711cb63 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:01.542919 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 829/1646] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:01 2022] PUT /identity/v3/projects/5cbff20d01b346f9b365ad05a74fb418/users/a788bc9c753d4be5adf2f152f5d4a34e/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:01.960558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827bd92-2bfc-46c8-ac8e-257dd8bf4b85 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:01.961724 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827bd92-2bfc-46c8-ac8e-257dd8bf4b85 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:01.961800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827bd92-2bfc-46c8-ac8e-257dd8bf4b85 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:01.965640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 818/1647] 10.222.0.52 () {54 vars in 962 bytes} [Thu Sep 1 16:35:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:35:01.992662 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56702e-dbbe-4392-a3b6-14ee0b6c32f1 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:01.993148 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56702e-dbbe-4392-a3b6-14ee0b6c32f1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:01.993641 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56702e-dbbe-4392-a3b6-14ee0b6c32f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:02.115203 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1b56702e-dbbe-4392-a3b6-14ee0b6c32f1 None None] MFA Rules not processed for user `55f389ab3ea046008b44f129113de995`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:02.129769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1b56702e-dbbe-4392-a3b6-14ee0b6c32f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:02.421004 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:02.476362 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 830/1648] 10.222.0.52 () {58 vars in 1059 bytes} [Thu Sep 1 16:35:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:02.478726 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad5318-7903-4195-ae44-86de93f2b603 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:02.479197 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad5318-7903-4195-ae44-86de93f2b603 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:02.480315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad5318-7903-4195-ae44-86de93f2b603 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:02.483677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 819/1649] 10.222.0.52 () {54 vars in 912 bytes} [Thu Sep 1 16:35:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:35:02.490200 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f261536-37ba-4296-9f99-0e79bdcf74ab None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:02.490484 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f261536-37ba-4296-9f99-0e79bdcf74ab None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:02.490878 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f261536-37ba-4296-9f99-0e79bdcf74ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:02.534901 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9f261536-37ba-4296-9f99-0e79bdcf74ab None None] MFA Rules not processed for user `55f389ab3ea046008b44f129113de995`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:02.536314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9f261536-37ba-4296-9f99-0e79bdcf74ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:02.558984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 831/1650] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 1 16:35:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:02.573875 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad5318-7903-4195-ae44-86de93f2b603 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:02.848990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad5318-7903-4195-ae44-86de93f2b603 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:02.864272 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c9a85-dcbf-4128-9a1a-5e0c5ff6d818 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:02.865605 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c9a85-dcbf-4128-9a1a-5e0c5ff6d818 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:02.865797 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c9a85-dcbf-4128-9a1a-5e0c5ff6d818 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:02.866217 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c9a85-dcbf-4128-9a1a-5e0c5ff6d818 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:02.916523 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c9a85-dcbf-4128-9a1a-5e0c5ff6d818 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:02.919945 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c9a85-dcbf-4128-9a1a-5e0c5ff6d818 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:02.969393 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 820/1651] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:03.137920 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f261536-37ba-4296-9f99-0e79bdcf74ab None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:03.297706 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f261536-37ba-4296-9f99-0e79bdcf74ab None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:03.313542 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242a00c-1207-4fa3-9ce3-640b877c02c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:03.320681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242a00c-1207-4fa3-9ce3-640b877c02c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:03.320681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242a00c-1207-4fa3-9ce3-640b877c02c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:03.320681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242a00c-1207-4fa3-9ce3-640b877c02c0 admin admin] PATH_INFO: `/v3/users/4305a714bc114044878092cbed5d4e3c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:03.327923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242a00c-1207-4fa3-9ce3-640b877c02c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4305a714bc114044878092cbed5d4e3c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:03.328150 dv-cinder-852209-10-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-7242a00c-1207-4fa3-9ce3-640b877c02c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:35:03.328150 dv-cinder-852209-10-smb devstack@keystone.service[81459]: warnings.warn(msg) Sep 01 16:35:03.328150 dv-cinder-852209-10-smb devstack@keystone.service[81459]: Sep 01 16:35:03.332579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242a00c-1207-4fa3-9ce3-640b877c02c0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:03.609860 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7242a00c-1207-4fa3-9ce3-640b877c02c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4305a714bc114044878092cbed5d4e3c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:03.669095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7242a00c-1207-4fa3-9ce3-640b877c02c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4305a714bc114044878092cbed5d4e3c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:03.674548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7242a00c-1207-4fa3-9ce3-640b877c02c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4305a714bc114044878092cbed5d4e3c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:03.732100 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7242a00c-1207-4fa3-9ce3-640b877c02c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4305a714bc114044878092cbed5d4e3c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:03.766046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7242a00c-1207-4fa3-9ce3-640b877c02c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4305a714bc114044878092cbed5d4e3c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:03.791309 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 832/1652] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:35:03 2022] DELETE /identity/v3/users/4305a714bc114044878092cbed5d4e3c => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:03.796406 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06345445-e684-4f44-b916-f90d44a680b0 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:03.797267 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06345445-e684-4f44-b916-f90d44a680b0 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:03.798024 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06345445-e684-4f44-b916-f90d44a680b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:03.889857 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-06345445-e684-4f44-b916-f90d44a680b0 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:03.901764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-06345445-e684-4f44-b916-f90d44a680b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:04.250755 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 821/1653] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:35:04.350619 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242a00c-1207-4fa3-9ce3-640b877c02c0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:04.352438 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7242a00c-1207-4fa3-9ce3-640b877c02c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:04.536899 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242a00c-1207-4fa3-9ce3-640b877c02c0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:04.545197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066ca98-b9fd-4023-830e-6adb55ae7fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:04.547167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066ca98-b9fd-4023-830e-6adb55ae7fca service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:04.548400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066ca98-b9fd-4023-830e-6adb55ae7fca service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:04.549732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066ca98-b9fd-4023-830e-6adb55ae7fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:04.579824 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066ca98-b9fd-4023-830e-6adb55ae7fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:04.582040 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066ca98-b9fd-4023-830e-6adb55ae7fca service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:04.610149 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 833/1654] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:05.025390 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06345445-e684-4f44-b916-f90d44a680b0 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:05.027891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-06345445-e684-4f44-b916-f90d44a680b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:05.076396 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06345445-e684-4f44-b916-f90d44a680b0 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:05.102294 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c390cae-ba83-4b5e-a701-e609ec6cca8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:05.104126 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c390cae-ba83-4b5e-a701-e609ec6cca8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:05.105353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c390cae-ba83-4b5e-a701-e609ec6cca8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:05.105634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c390cae-ba83-4b5e-a701-e609ec6cca8c admin admin] PATH_INFO: `/v3/users/9f1fb4b2451c44bdbe8900d11bccb4cc` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:05.111979 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c390cae-ba83-4b5e-a701-e609ec6cca8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f1fb4b2451c44bdbe8900d11bccb4cc)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:05.115313 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c390cae-ba83-4b5e-a701-e609ec6cca8c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:05.229011 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9c390cae-ba83-4b5e-a701-e609ec6cca8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f1fb4b2451c44bdbe8900d11bccb4cc'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:05.254248 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9c390cae-ba83-4b5e-a701-e609ec6cca8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f1fb4b2451c44bdbe8900d11bccb4cc'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:05.256689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9c390cae-ba83-4b5e-a701-e609ec6cca8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f1fb4b2451c44bdbe8900d11bccb4cc'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:05.257357 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9c390cae-ba83-4b5e-a701-e609ec6cca8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f1fb4b2451c44bdbe8900d11bccb4cc'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:05.270563 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9c390cae-ba83-4b5e-a701-e609ec6cca8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f1fb4b2451c44bdbe8900d11bccb4cc'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:05.304805 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f0e63-70d4-4378-9edc-8704224f45b4 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:05.305063 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 822/1655] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:35:05 2022] DELETE /identity/v3/users/9f1fb4b2451c44bdbe8900d11bccb4cc => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:05.305227 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f0e63-70d4-4378-9edc-8704224f45b4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:05.305478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f0e63-70d4-4378-9edc-8704224f45b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:05.345869 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1a4f0e63-70d4-4378-9edc-8704224f45b4 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:05.347834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1a4f0e63-70d4-4378-9edc-8704224f45b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:05.359100 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:05.387050 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa668ce-c019-4bae-abd7-cd47bba5acde None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:05.387608 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa668ce-c019-4bae-abd7-cd47bba5acde None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:05.388675 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa668ce-c019-4bae-abd7-cd47bba5acde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:05.523675 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:05.556037 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-cfa668ce-c019-4bae-abd7-cd47bba5acde None None] MFA Rules not processed for user `a788bc9c753d4be5adf2f152f5d4a34e`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:05.569985 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cfa668ce-c019-4bae-abd7-cd47bba5acde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:05.591158 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 834/1656] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:35:05.612685 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f0e63-70d4-4378-9edc-8704224f45b4 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:05.615105 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1a4f0e63-70d4-4378-9edc-8704224f45b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:05.804433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f0e63-70d4-4378-9edc-8704224f45b4 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:05.817581 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f471b-b941-4c2c-8c39-6bf70ef66236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:05.825730 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f471b-b941-4c2c-8c39-6bf70ef66236 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:05.826361 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 823/1657] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:05 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:05.827177 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f471b-b941-4c2c-8c39-6bf70ef66236 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:05.827663 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f471b-b941-4c2c-8c39-6bf70ef66236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:05.848589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f471b-b941-4c2c-8c39-6bf70ef66236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:05.851543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f471b-b941-4c2c-8c39-6bf70ef66236 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:05.875004 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 835/1658] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:07.063359 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa668ce-c019-4bae-abd7-cd47bba5acde None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:07.065826 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cfa668ce-c019-4bae-abd7-cd47bba5acde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:07.129827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa668ce-c019-4bae-abd7-cd47bba5acde None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:07.152610 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b9b55-1356-46b8-9597-80c9f8918f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:07.153671 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b9b55-1356-46b8-9597-80c9f8918f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:07.155229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b9b55-1356-46b8-9597-80c9f8918f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:07.157014 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b9b55-1356-46b8-9597-80c9f8918f36 admin admin] PATH_INFO: `/v3/projects/50d013642ae346e5a3abf982fe2bac3c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:07.164337 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b9b55-1356-46b8-9597-80c9f8918f36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50d013642ae346e5a3abf982fe2bac3c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:07.166078 dv-cinder-852209-10-smb devstack@keystone.service[81460]: WARNING py.warnings [None req-414b9b55-1356-46b8-9597-80c9f8918f36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:35:07.166078 dv-cinder-852209-10-smb devstack@keystone.service[81460]: warnings.warn(msg) Sep 01 16:35:07.166078 dv-cinder-852209-10-smb devstack@keystone.service[81460]: Sep 01 16:35:07.172316 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b9b55-1356-46b8-9597-80c9f8918f36 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:07.414120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-414b9b55-1356-46b8-9597-80c9f8918f36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50d013642ae346e5a3abf982fe2bac3c', 'request_id': 'req-414b9b55-1356-46b8-9597-80c9f8918f36'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:07.454194 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-414b9b55-1356-46b8-9597-80c9f8918f36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50d013642ae346e5a3abf982fe2bac3c', 'request_id': 'req-414b9b55-1356-46b8-9597-80c9f8918f36'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:07.486886 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-414b9b55-1356-46b8-9597-80c9f8918f36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50d013642ae346e5a3abf982fe2bac3c', 'request_id': 'req-414b9b55-1356-46b8-9597-80c9f8918f36'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:07.514443 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-414b9b55-1356-46b8-9597-80c9f8918f36 admin admin] The token cache is being invalidate because project 50d013642ae346e5a3abf982fe2bac3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:35:07.514907 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-414b9b55-1356-46b8-9597-80c9f8918f36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:07.515592 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-414b9b55-1356-46b8-9597-80c9f8918f36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:07.517356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 824/1659] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:35:07 2022] DELETE /identity/v3/projects/50d013642ae346e5a3abf982fe2bac3c => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:07.523016 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f471b-b941-4c2c-8c39-6bf70ef66236 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:07.534906 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f471b-b941-4c2c-8c39-6bf70ef66236 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:07.714624 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdd825-7121-4f5a-aaaa-2df2a7d28a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:07.715293 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdd825-7121-4f5a-aaaa-2df2a7d28a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:07.715578 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdd825-7121-4f5a-aaaa-2df2a7d28a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:07.715871 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdd825-7121-4f5a-aaaa-2df2a7d28a73 admin admin] PATH_INFO: `/v3/users/ce6f2f65c5324793bde69a2ae9916bc8` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:07.719239 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfdd825-7121-4f5a-aaaa-2df2a7d28a73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce6f2f65c5324793bde69a2ae9916bc8)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:07.721654 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfdd825-7121-4f5a-aaaa-2df2a7d28a73 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:07.862966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cbfdd825-7121-4f5a-aaaa-2df2a7d28a73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce6f2f65c5324793bde69a2ae9916bc8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:07.906662 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:07.987957 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cbfdd825-7121-4f5a-aaaa-2df2a7d28a73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce6f2f65c5324793bde69a2ae9916bc8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:07.988996 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cbfdd825-7121-4f5a-aaaa-2df2a7d28a73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce6f2f65c5324793bde69a2ae9916bc8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:08.016340 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cbfdd825-7121-4f5a-aaaa-2df2a7d28a73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce6f2f65c5324793bde69a2ae9916bc8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:08.038671 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cbfdd825-7121-4f5a-aaaa-2df2a7d28a73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce6f2f65c5324793bde69a2ae9916bc8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:08.057476 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 836/1660] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:35:07 2022] DELETE /identity/v3/users/ce6f2f65c5324793bde69a2ae9916bc8 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:09.420004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b9b55-1356-46b8-9597-80c9f8918f36 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:09.422776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-414b9b55-1356-46b8-9597-80c9f8918f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:09.460154 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b9b55-1356-46b8-9597-80c9f8918f36 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:09.718688 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e506a7-17a9-46d3-8f00-6013c700a7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:09.719911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e506a7-17a9-46d3-8f00-6013c700a7c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:09.720439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e506a7-17a9-46d3-8f00-6013c700a7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:09.720985 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e506a7-17a9-46d3-8f00-6013c700a7c0 admin admin] PATH_INFO: `/v3/projects/6b01edc3f9ac46628b99394e925c34c4` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:09.723186 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e506a7-17a9-46d3-8f00-6013c700a7c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b01edc3f9ac46628b99394e925c34c4)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:09.726290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e506a7-17a9-46d3-8f00-6013c700a7c0 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:09.764025 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:09.878874 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d0e506a7-17a9-46d3-8f00-6013c700a7c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b01edc3f9ac46628b99394e925c34c4', 'request_id': 'req-d0e506a7-17a9-46d3-8f00-6013c700a7c0'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:09.900484 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d0e506a7-17a9-46d3-8f00-6013c700a7c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b01edc3f9ac46628b99394e925c34c4', 'request_id': 'req-d0e506a7-17a9-46d3-8f00-6013c700a7c0'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:09.920869 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d0e506a7-17a9-46d3-8f00-6013c700a7c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b01edc3f9ac46628b99394e925c34c4', 'request_id': 'req-d0e506a7-17a9-46d3-8f00-6013c700a7c0'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:09.978938 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d0e506a7-17a9-46d3-8f00-6013c700a7c0 admin admin] The token cache is being invalidate because project 6b01edc3f9ac46628b99394e925c34c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:35:09.981002 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d0e506a7-17a9-46d3-8f00-6013c700a7c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:09.983416 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d0e506a7-17a9-46d3-8f00-6013c700a7c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:10.006390 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 825/1661] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:35:09 2022] DELETE /identity/v3/projects/6b01edc3f9ac46628b99394e925c34c4 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:10.010817 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc50d3a-32ac-41b2-b9ef-b781f4b83963 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:10.011878 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc50d3a-32ac-41b2-b9ef-b781f4b83963 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:10.011972 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc50d3a-32ac-41b2-b9ef-b781f4b83963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:10.054112 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ffc50d3a-32ac-41b2-b9ef-b781f4b83963 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:10.062707 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ffc50d3a-32ac-41b2-b9ef-b781f4b83963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:10.193713 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd965f80-44f3-4e79-8741-94fa1753433c None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:10.193994 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd965f80-44f3-4e79-8741-94fa1753433c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:10.194269 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd965f80-44f3-4e79-8741-94fa1753433c None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:10.195704 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 826/1662] 10.222.0.52 () {54 vars in 921 bytes} [Thu Sep 1 16:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:35:10.277488 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aff78a-97f7-4433-8119-9e9dea37fce7 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:10.277774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aff78a-97f7-4433-8119-9e9dea37fce7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:10.278065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aff78a-97f7-4433-8119-9e9dea37fce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:10.293731 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 837/1663] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:10.301049 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69a841-c79c-41fa-baa7-6aec1219acec None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:10.301338 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69a841-c79c-41fa-baa7-6aec1219acec None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:10.301619 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69a841-c79c-41fa-baa7-6aec1219acec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:10.349690 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-89aff78a-97f7-4433-8119-9e9dea37fce7 None None] MFA Rules not processed for user `d64fc190fac540259444a531cdbb8d53`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:10.358159 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-89aff78a-97f7-4433-8119-9e9dea37fce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:10.390269 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6a69a841-c79c-41fa-baa7-6aec1219acec None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:10.396264 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6a69a841-c79c-41fa-baa7-6aec1219acec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:10.440526 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 838/1664] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:10.442550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69a841-c79c-41fa-baa7-6aec1219acec None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:10.468493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 827/1665] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Sep 1 16:35:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:35:10.481827 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69a841-c79c-41fa-baa7-6aec1219acec None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:10.489983 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f2741-1d57-468b-8d68-17ef34713e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:10.490920 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f2741-1d57-468b-8d68-17ef34713e10 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:10.491288 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f2741-1d57-468b-8d68-17ef34713e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:10.492562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f2741-1d57-468b-8d68-17ef34713e10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:10.492752 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f2741-1d57-468b-8d68-17ef34713e10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:35:10.493262 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f2741-1d57-468b-8d68-17ef34713e10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:10.495869 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f2741-1d57-468b-8d68-17ef34713e10 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:10.512065 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 839/1666] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:35:10.516392 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aff78a-97f7-4433-8119-9e9dea37fce7 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:10.545120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aff78a-97f7-4433-8119-9e9dea37fce7 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:10.563250 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f2741-1d57-468b-8d68-17ef34713e10 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:10.565259 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fd0f2741-1d57-468b-8d68-17ef34713e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:10.575873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc04fc-2955-43c1-8c76-e1530fd72b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:10.581295 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc04fc-2955-43c1-8c76-e1530fd72b53 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:10.581295 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc04fc-2955-43c1-8c76-e1530fd72b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:10.596965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f2741-1d57-468b-8d68-17ef34713e10 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:10.599554 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc04fc-2955-43c1-8c76-e1530fd72b53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:10.601862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc04fc-2955-43c1-8c76-e1530fd72b53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:10.615802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc04fc-2955-43c1-8c76-e1530fd72b53 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:10.615978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c8bec-b089-41ae-bd01-0dc2941f865d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64fc190fac540259444a531cdbb8d53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:10.615978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c8bec-b089-41ae-bd01-0dc2941f865d service placement] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:10.615978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c8bec-b089-41ae-bd01-0dc2941f865d service placement] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:10.616489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c8bec-b089-41ae-bd01-0dc2941f865d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:10.638119 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c8bec-b089-41ae-bd01-0dc2941f865d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:10.639909 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c8bec-b089-41ae-bd01-0dc2941f865d service placement] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:10.679288 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 840/1667] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:10.772942 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 828/1668] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:10 2022] POST /identity/v3/projects => generated 403 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:10.774275 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c8bec-b089-41ae-bd01-0dc2941f865d service placement] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:10.795226 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c8bec-b089-41ae-bd01-0dc2941f865d service placement] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:10.998709 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73147b3f-9686-4da1-a0ca-f2cc91db79c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:11.001335 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73147b3f-9686-4da1-a0ca-f2cc91db79c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:11.003348 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73147b3f-9686-4da1-a0ca-f2cc91db79c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:11.005126 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73147b3f-9686-4da1-a0ca-f2cc91db79c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:11.007643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73147b3f-9686-4da1-a0ca-f2cc91db79c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:11.018534 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73147b3f-9686-4da1-a0ca-f2cc91db79c7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:11.044604 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc04fc-2955-43c1-8c76-e1530fd72b53 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:11.051014 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6dcc04fc-2955-43c1-8c76-e1530fd72b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:11.099796 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc04fc-2955-43c1-8c76-e1530fd72b53 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:11.127614 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208e764-b8eb-47a8-90d2-b4e3f39a767d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:11.128870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208e764-b8eb-47a8-90d2-b4e3f39a767d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:11.129362 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208e764-b8eb-47a8-90d2-b4e3f39a767d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:11.129939 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208e764-b8eb-47a8-90d2-b4e3f39a767d admin admin] PATH_INFO: `/v3/projects/89adb08031b049c4860e725a109cbf03` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:11.138651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 841/1669] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:10 2022] POST /identity/v3/users => generated 302 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:35:11.142633 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73147b3f-9686-4da1-a0ca-f2cc91db79c7 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:11.147752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208e764-b8eb-47a8-90d2-b4e3f39a767d admin admin] RBAC: Authorizing `identity:delete_project(project_id=89adb08031b049c4860e725a109cbf03)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:11.151161 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208e764-b8eb-47a8-90d2-b4e3f39a767d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:11.162093 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73147b3f-9686-4da1-a0ca-f2cc91db79c7 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:11.173665 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf234c-8659-4c98-9108-85f403cdb457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:11.174366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf234c-8659-4c98-9108-85f403cdb457 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:11.174643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf234c-8659-4c98-9108-85f403cdb457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:11.174914 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf234c-8659-4c98-9108-85f403cdb457 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:11.175658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf234c-8659-4c98-9108-85f403cdb457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:11.177401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf234c-8659-4c98-9108-85f403cdb457 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:11.203444 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 842/1670] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:35:11.207887 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf234c-8659-4c98-9108-85f403cdb457 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:11.244658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf234c-8659-4c98-9108-85f403cdb457 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:11.267120 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9575e14-ac25-4107-be66-cc1882a56e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:11.268112 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9575e14-ac25-4107-be66-cc1882a56e59 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:11.268112 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9575e14-ac25-4107-be66-cc1882a56e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:11.268317 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9575e14-ac25-4107-be66-cc1882a56e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:11.268991 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9575e14-ac25-4107-be66-cc1882a56e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:11.271352 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9575e14-ac25-4107-be66-cc1882a56e59 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:11.304990 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 843/1671] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:11.310488 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9575e14-ac25-4107-be66-cc1882a56e59 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:11.336135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9575e14-ac25-4107-be66-cc1882a56e59 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:11.360511 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b71291-c9a0-4bb4-b90a-33aaf5c9943b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:11.364840 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b71291-c9a0-4bb4-b90a-33aaf5c9943b admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:11.365806 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b71291-c9a0-4bb4-b90a-33aaf5c9943b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:11.366384 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b71291-c9a0-4bb4-b90a-33aaf5c9943b admin admin] PATH_INFO: `/v3/projects/64ea4652b0df426b8a1de567c0a74516/users/77301e3dffc34a83aa1f71893a9c68d0/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:11.383607 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:11.424664 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b71291-c9a0-4bb4-b90a-33aaf5c9943b admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ea4652b0df426b8a1de567c0a74516, user_id=77301e3dffc34a83aa1f71893a9c68d0, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:11.427732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b71291-c9a0-4bb4-b90a-33aaf5c9943b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:11.444563 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f208e764-b8eb-47a8-90d2-b4e3f39a767d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89adb08031b049c4860e725a109cbf03', 'request_id': 'req-f208e764-b8eb-47a8-90d2-b4e3f39a767d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:11.466046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 844/1672] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:11 2022] PUT /identity/v3/projects/64ea4652b0df426b8a1de567c0a74516/users/77301e3dffc34a83aa1f71893a9c68d0/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:35:11.477983 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059df14a-4141-46c8-b8e9-d5bb1ae623cf None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:11.478631 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059df14a-4141-46c8-b8e9-d5bb1ae623cf None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:11.479114 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059df14a-4141-46c8-b8e9-d5bb1ae623cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:11.502170 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f208e764-b8eb-47a8-90d2-b4e3f39a767d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89adb08031b049c4860e725a109cbf03', 'request_id': 'req-f208e764-b8eb-47a8-90d2-b4e3f39a767d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:11.527949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f208e764-b8eb-47a8-90d2-b4e3f39a767d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89adb08031b049c4860e725a109cbf03', 'request_id': 'req-f208e764-b8eb-47a8-90d2-b4e3f39a767d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:11.541114 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-059df14a-4141-46c8-b8e9-d5bb1ae623cf None None] MFA Rules not processed for user `77301e3dffc34a83aa1f71893a9c68d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:11.545682 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-059df14a-4141-46c8-b8e9-d5bb1ae623cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:11.551542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f208e764-b8eb-47a8-90d2-b4e3f39a767d admin admin] The token cache is being invalidate because project 89adb08031b049c4860e725a109cbf03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:35:11.551847 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f208e764-b8eb-47a8-90d2-b4e3f39a767d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:11.554129 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f208e764-b8eb-47a8-90d2-b4e3f39a767d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:11.568973 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 829/1673] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:35:11 2022] DELETE /identity/v3/projects/89adb08031b049c4860e725a109cbf03 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:11.588873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2639dc-b742-4f16-bb76-32f96b0f1c62 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:11.590197 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2639dc-b742-4f16-bb76-32f96b0f1c62 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:11.590924 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2639dc-b742-4f16-bb76-32f96b0f1c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:11.635150 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:11.670592 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ef2639dc-b742-4f16-bb76-32f96b0f1c62 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:11.680856 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ef2639dc-b742-4f16-bb76-32f96b0f1c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:11.710885 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 845/1674] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:11 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:35:11.710885 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60a48b-4e9c-45c3-b2bc-357740fd3417 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:11.710885 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60a48b-4e9c-45c3-b2bc-357740fd3417 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:11.710885 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60a48b-4e9c-45c3-b2bc-357740fd3417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:11.768653 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7b60a48b-4e9c-45c3-b2bc-357740fd3417 None None] MFA Rules not processed for user `054b27e46b8648979d8777e90748722d`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:11.770041 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7b60a48b-4e9c-45c3-b2bc-357740fd3417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:11.918320 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 830/1675] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:11.918320 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2639dc-b742-4f16-bb76-32f96b0f1c62 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:11.921450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ef2639dc-b742-4f16-bb76-32f96b0f1c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:11.963554 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2639dc-b742-4f16-bb76-32f96b0f1c62 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:11.976517 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df52ea-0701-4323-9824-35d6ef87b5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:11.977268 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df52ea-0701-4323-9824-35d6ef87b5f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:11.977830 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df52ea-0701-4323-9824-35d6ef87b5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:11.978200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df52ea-0701-4323-9824-35d6ef87b5f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:11.978899 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df52ea-0701-4323-9824-35d6ef87b5f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:11.983903 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df52ea-0701-4323-9824-35d6ef87b5f3 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:11.994608 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 846/1676] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:11.996707 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5faa86-7452-439e-99b6-414188a56e01 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:11.997080 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5faa86-7452-439e-99b6-414188a56e01 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:11.997576 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5faa86-7452-439e-99b6-414188a56e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:12.040448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-fe5faa86-7452-439e-99b6-414188a56e01 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:12.042007 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fe5faa86-7452-439e-99b6-414188a56e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:12.066380 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 831/1677] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:11 2022] POST /identity/v3/projects => generated 403 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:12.066380 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df52ea-0701-4323-9824-35d6ef87b5f3 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:12.067854 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 847/1678] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:12.068857 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5faa86-7452-439e-99b6-414188a56e01 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:12.075833 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b1df52ea-0701-4323-9824-35d6ef87b5f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:12.097825 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5faa86-7452-439e-99b6-414188a56e01 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:12.195955 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:12.210790 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eeb534-69d0-4070-8ae5-f3fa9cc29825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:12.211436 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeb534-69d0-4070-8ae5-f3fa9cc29825 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:12.211717 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeb534-69d0-4070-8ae5-f3fa9cc29825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:12.211995 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeb534-69d0-4070-8ae5-f3fa9cc29825 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:12.212692 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eeb534-69d0-4070-8ae5-f3fa9cc29825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:12.215516 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eeb534-69d0-4070-8ae5-f3fa9cc29825 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:12.246598 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df52ea-0701-4323-9824-35d6ef87b5f3 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:12.262405 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 848/1679] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:12 2022] POST /identity/v3/users => generated 308 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:12.263294 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eeb534-69d0-4070-8ae5-f3fa9cc29825 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:12.268234 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6267f-9291-4224-a785-564d8cd296d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:12.270531 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6267f-9291-4224-a785-564d8cd296d6 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:12.272314 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6267f-9291-4224-a785-564d8cd296d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:12.275105 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6267f-9291-4224-a785-564d8cd296d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:12.287917 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eeb534-69d0-4070-8ae5-f3fa9cc29825 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:12.314200 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9279d7-2ead-4884-9bd0-9af2e3b867a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:12.314838 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9279d7-2ead-4884-9bd0-9af2e3b867a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:12.315120 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9279d7-2ead-4884-9bd0-9af2e3b867a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:12.315568 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9279d7-2ead-4884-9bd0-9af2e3b867a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:12.316251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9279d7-2ead-4884-9bd0-9af2e3b867a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:35:12.316556 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9279d7-2ead-4884-9bd0-9af2e3b867a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:12.318293 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9279d7-2ead-4884-9bd0-9af2e3b867a4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:12.371489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 849/1680] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:35:12.372426 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9279d7-2ead-4884-9bd0-9af2e3b867a4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:12.398135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9279d7-2ead-4884-9bd0-9af2e3b867a4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:12.410873 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccce24a-216f-415d-850b-fc1fb1ced754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:12.411513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccce24a-216f-415d-850b-fc1fb1ced754 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:12.411792 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccce24a-216f-415d-850b-fc1fb1ced754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:12.412067 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccce24a-216f-415d-850b-fc1fb1ced754 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:12.413393 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccce24a-216f-415d-850b-fc1fb1ced754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:12.415118 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccce24a-216f-415d-850b-fc1fb1ced754 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:12.441960 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 850/1681] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:12.441960 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccce24a-216f-415d-850b-fc1fb1ced754 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:12.460167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccce24a-216f-415d-850b-fc1fb1ced754 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:12.475106 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc9f9a-cdd3-4e34-94a8-310fa6a2f58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:12.475752 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc9f9a-cdd3-4e34-94a8-310fa6a2f58a admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:12.476142 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc9f9a-cdd3-4e34-94a8-310fa6a2f58a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:12.476335 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc9f9a-cdd3-4e34-94a8-310fa6a2f58a admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:12.477498 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc9f9a-cdd3-4e34-94a8-310fa6a2f58a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:12.479642 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc9f9a-cdd3-4e34-94a8-310fa6a2f58a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:12.480386 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6267f-9291-4224-a785-564d8cd296d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:12.483580 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6267f-9291-4224-a785-564d8cd296d6 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:12.516880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 832/1682] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:12.518114 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6267f-9291-4224-a785-564d8cd296d6 service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:12.542763 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 851/1683] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:12 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:12.554637 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc9f9a-cdd3-4e34-94a8-310fa6a2f58a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:12.574730 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6267f-9291-4224-a785-564d8cd296d6 service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:12.674746 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:12.842240 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc9f9a-cdd3-4e34-94a8-310fa6a2f58a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:12.857094 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c7073-3eb4-492b-8037-c8dbc8b00624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:12.858014 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c7073-3eb4-492b-8037-c8dbc8b00624 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:12.858438 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c7073-3eb4-492b-8037-c8dbc8b00624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:12.859620 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c7073-3eb4-492b-8037-c8dbc8b00624 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:12.860564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c7073-3eb4-492b-8037-c8dbc8b00624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:12.861588 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82c557-1681-4c3c-a249-e24857511198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:12.863893 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82c557-1681-4c3c-a249-e24857511198 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:12.865057 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82c557-1681-4c3c-a249-e24857511198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:12.865226 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c7073-3eb4-492b-8037-c8dbc8b00624 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:12.866949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82c557-1681-4c3c-a249-e24857511198 admin admin] PATH_INFO: `/v3/projects/316be62936ea494894a5a8f38c178d7c/users/731aa16040154889a17ceeb53bf3e358/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:12.914187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 852/1684] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:12 2022] POST /identity/v3/users => generated 283 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:12.919343 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c7073-3eb4-492b-8037-c8dbc8b00624 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:12.936650 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82c557-1681-4c3c-a249-e24857511198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=316be62936ea494894a5a8f38c178d7c, user_id=731aa16040154889a17ceeb53bf3e358, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:12.939694 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c7073-3eb4-492b-8037-c8dbc8b00624 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:12.942015 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82c557-1681-4c3c-a249-e24857511198 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:12.953184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c885e-eb3c-44de-a907-b927b680d693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:12.953946 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c885e-eb3c-44de-a907-b927b680d693 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:12.954229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c885e-eb3c-44de-a907-b927b680d693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:12.954513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c885e-eb3c-44de-a907-b927b680d693 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:12.956368 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c885e-eb3c-44de-a907-b927b680d693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:12.961431 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c885e-eb3c-44de-a907-b927b680d693 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:12.985928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 853/1685] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:35:12.989279 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c885e-eb3c-44de-a907-b927b680d693 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:12.997207 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 833/1686] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:12 2022] PUT /identity/v3/projects/316be62936ea494894a5a8f38c178d7c/users/731aa16040154889a17ceeb53bf3e358/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:13.002549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82c557-1681-4c3c-a249-e24857511198 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:13.012898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c885e-eb3c-44de-a907-b927b680d693 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:13.170400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ef0a5-54ee-4b9a-aba6-7eb4fba8e307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:13.171452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ef0a5-54ee-4b9a-aba6-7eb4fba8e307 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:13.171452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ef0a5-54ee-4b9a-aba6-7eb4fba8e307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:13.171679 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ef0a5-54ee-4b9a-aba6-7eb4fba8e307 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:13.172273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ef0a5-54ee-4b9a-aba6-7eb4fba8e307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:13.178056 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ef0a5-54ee-4b9a-aba6-7eb4fba8e307 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:13.201541 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 854/1687] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:13.203549 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ef0a5-54ee-4b9a-aba6-7eb4fba8e307 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:13.208743 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ea1ef0a5-54ee-4b9a-aba6-7eb4fba8e307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:13.236997 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ef0a5-54ee-4b9a-aba6-7eb4fba8e307 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:13.248606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ce157-b8dc-4c5e-b568-9c30a15a6d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:13.251339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ce157-b8dc-4c5e-b568-9c30a15a6d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:13.251642 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ce157-b8dc-4c5e-b568-9c30a15a6d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:13.251899 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ce157-b8dc-4c5e-b568-9c30a15a6d8d admin admin] PATH_INFO: `/v3/users/00710e68e7bb4a2fa6d24e1963cdeecc` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:13.258153 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ce157-b8dc-4c5e-b568-9c30a15a6d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=00710e68e7bb4a2fa6d24e1963cdeecc)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:13.272349 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82c557-1681-4c3c-a249-e24857511198 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:13.279517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ce157-b8dc-4c5e-b568-9c30a15a6d8d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:13.281205 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659006ca-69ab-47e9-8125-1a1e52b7128b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:13.294519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659006ca-69ab-47e9-8125-1a1e52b7128b admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:13.295928 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659006ca-69ab-47e9-8125-1a1e52b7128b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:13.296464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659006ca-69ab-47e9-8125-1a1e52b7128b admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:13.299097 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659006ca-69ab-47e9-8125-1a1e52b7128b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:13.301424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:13.304125 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659006ca-69ab-47e9-8125-1a1e52b7128b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:13.338430 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 834/1688] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:35:13.342031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659006ca-69ab-47e9-8125-1a1e52b7128b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:13.354985 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659006ca-69ab-47e9-8125-1a1e52b7128b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:13.363283 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d3197-719c-40f7-a1cb-ddc81cd1337a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:13.364184 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d3197-719c-40f7-a1cb-ddc81cd1337a admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:13.364640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d3197-719c-40f7-a1cb-ddc81cd1337a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:13.366251 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d3197-719c-40f7-a1cb-ddc81cd1337a admin admin] PATH_INFO: `/v3/projects/aea5fdd36f434a588042afa14ac2a0f6/users/9588e9efa7d24781b1a638f72a13dfab/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:13.398710 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d3197-719c-40f7-a1cb-ddc81cd1337a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea5fdd36f434a588042afa14ac2a0f6, user_id=9588e9efa7d24781b1a638f72a13dfab, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:13.404192 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d3197-719c-40f7-a1cb-ddc81cd1337a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:13.435837 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 835/1689] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:13 2022] PUT /identity/v3/projects/aea5fdd36f434a588042afa14ac2a0f6/users/9588e9efa7d24781b1a638f72a13dfab/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:13.438016 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d3197-719c-40f7-a1cb-ddc81cd1337a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:13.440136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8d5ce157-b8dc-4c5e-b568-9c30a15a6d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00710e68e7bb4a2fa6d24e1963cdeecc'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:13.488775 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8d5ce157-b8dc-4c5e-b568-9c30a15a6d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00710e68e7bb4a2fa6d24e1963cdeecc'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:13.490096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8d5ce157-b8dc-4c5e-b568-9c30a15a6d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00710e68e7bb4a2fa6d24e1963cdeecc'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:13.521995 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8d5ce157-b8dc-4c5e-b568-9c30a15a6d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00710e68e7bb4a2fa6d24e1963cdeecc'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:13.536470 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d3197-719c-40f7-a1cb-ddc81cd1337a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:13.547935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8d5ce157-b8dc-4c5e-b568-9c30a15a6d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00710e68e7bb4a2fa6d24e1963cdeecc'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:13.548210 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448f7b3-f7c2-41c0-aff3-07ff14ea34c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:13.549459 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448f7b3-f7c2-41c0-aff3-07ff14ea34c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:13.549858 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448f7b3-f7c2-41c0-aff3-07ff14ea34c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:13.550302 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448f7b3-f7c2-41c0-aff3-07ff14ea34c1 admin admin] PATH_INFO: `/v3/projects/316be62936ea494894a5a8f38c178d7c/users/731aa16040154889a17ceeb53bf3e358/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:13.556381 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448f7b3-f7c2-41c0-aff3-07ff14ea34c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=316be62936ea494894a5a8f38c178d7c, user_id=731aa16040154889a17ceeb53bf3e358, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:13.564570 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448f7b3-f7c2-41c0-aff3-07ff14ea34c1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:13.569054 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 855/1690] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:35:13 2022] DELETE /identity/v3/users/00710e68e7bb4a2fa6d24e1963cdeecc => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:13.570892 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de5fe1-ada5-47b8-a42e-1e94e8057991 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:13.572203 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de5fe1-ada5-47b8-a42e-1e94e8057991 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:13.572665 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de5fe1-ada5-47b8-a42e-1e94e8057991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:13.596259 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 836/1691] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:13 2022] PUT /identity/v3/projects/316be62936ea494894a5a8f38c178d7c/users/731aa16040154889a17ceeb53bf3e358/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:13.614426 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8f1fc-3cd7-4ad4-990c-9952106b3374 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:13.614650 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8f1fc-3cd7-4ad4-990c-9952106b3374 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:13.623021 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8f1fc-3cd7-4ad4-990c-9952106b3374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:13.646763 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c3de5fe1-ada5-47b8-a42e-1e94e8057991 None None] MFA Rules not processed for user `9588e9efa7d24781b1a638f72a13dfab`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:13.649084 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c3de5fe1-ada5-47b8-a42e-1e94e8057991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:13.670517 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-67b8f1fc-3cd7-4ad4-990c-9952106b3374 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:13.671896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-67b8f1fc-3cd7-4ad4-990c-9952106b3374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:13.678756 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:13.867361 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 837/1692] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:13.884143 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d658d7-c6b7-495a-8b58-cafba59bfad4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:13.884662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d658d7-c6b7-495a-8b58-cafba59bfad4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:13.885133 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d658d7-c6b7-495a-8b58-cafba59bfad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:13.894778 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 856/1693] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:13.897910 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de5fe1-ada5-47b8-a42e-1e94e8057991 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:13.899909 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c3de5fe1-ada5-47b8-a42e-1e94e8057991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:13.944897 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de5fe1-ada5-47b8-a42e-1e94e8057991 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:13.952287 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361423e7-f025-42ee-9eae-08bb6c8c390b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:13.953246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361423e7-f025-42ee-9eae-08bb6c8c390b admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:13.953712 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361423e7-f025-42ee-9eae-08bb6c8c390b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:13.955173 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361423e7-f025-42ee-9eae-08bb6c8c390b admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:13.956377 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361423e7-f025-42ee-9eae-08bb6c8c390b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:13.960001 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361423e7-f025-42ee-9eae-08bb6c8c390b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:13.973260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f3d658d7-c6b7-495a-8b58-cafba59bfad4 None None] MFA Rules not processed for user `731aa16040154889a17ceeb53bf3e358`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:13.975055 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f3d658d7-c6b7-495a-8b58-cafba59bfad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:14.049584 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 857/1694] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:13 2022] POST /identity/v3/projects => generated 365 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:14.062411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361423e7-f025-42ee-9eae-08bb6c8c390b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:14.074179 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-361423e7-f025-42ee-9eae-08bb6c8c390b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:14.185353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 838/1695] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:13 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:14.186911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d658d7-c6b7-495a-8b58-cafba59bfad4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:14.229387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d658d7-c6b7-495a-8b58-cafba59bfad4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:14.373635 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361423e7-f025-42ee-9eae-08bb6c8c390b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:14.393559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7954e-ccd0-4f10-9d98-7c7c5fc5ad58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:14.394984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7954e-ccd0-4f10-9d98-7c7c5fc5ad58 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:14.397772 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7954e-ccd0-4f10-9d98-7c7c5fc5ad58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:14.400899 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7954e-ccd0-4f10-9d98-7c7c5fc5ad58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:14.432743 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:14.483855 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe3a9b-ae26-48f6-80b4-c440db4f099c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:14.488231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe3a9b-ae26-48f6-80b4-c440db4f099c admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:14.488778 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe3a9b-ae26-48f6-80b4-c440db4f099c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:14.489261 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe3a9b-ae26-48f6-80b4-c440db4f099c admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:14.492637 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe3a9b-ae26-48f6-80b4-c440db4f099c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:14.503913 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe3a9b-ae26-48f6-80b4-c440db4f099c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:14.596902 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 839/1696] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:14 2022] POST /identity/v3/users => generated 289 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:14.597808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe3a9b-ae26-48f6-80b4-c440db4f099c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:14.602801 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0ebe3a9b-ae26-48f6-80b4-c440db4f099c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:14.700145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7954e-ccd0-4f10-9d98-7c7c5fc5ad58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:14.702929 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7954e-ccd0-4f10-9d98-7c7c5fc5ad58 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:14.717028 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:14.756461 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 858/1697] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:14.761331 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7954e-ccd0-4f10-9d98-7c7c5fc5ad58 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:14.774884 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe3a9b-ae26-48f6-80b4-c440db4f099c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:14.782497 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2c72a-a744-4823-87fa-765d03ba8e6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:14.783590 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2c72a-a744-4823-87fa-765d03ba8e6a service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:14.784477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2c72a-a744-4823-87fa-765d03ba8e6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:14.784913 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2c72a-a744-4823-87fa-765d03ba8e6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:14.809577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7954e-ccd0-4f10-9d98-7c7c5fc5ad58 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:14.840636 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecefbe-deda-46af-a0df-24adfdad7702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:14.842795 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecefbe-deda-46af-a0df-24adfdad7702 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:14.844472 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecefbe-deda-46af-a0df-24adfdad7702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:14.845488 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecefbe-deda-46af-a0df-24adfdad7702 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:14.849231 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecefbe-deda-46af-a0df-24adfdad7702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:14.858747 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecefbe-deda-46af-a0df-24adfdad7702 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:14.908753 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 859/1698] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:14.910970 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecefbe-deda-46af-a0df-24adfdad7702 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:14.932517 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2c72a-a744-4823-87fa-765d03ba8e6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:14.935988 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2c72a-a744-4823-87fa-765d03ba8e6a service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:14.968078 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecefbe-deda-46af-a0df-24adfdad7702 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:14.970315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 840/1699] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:14 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:14.996177 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6b1f0-e078-4584-84f7-f9d361b96bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:14.997356 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6b1f0-e078-4584-84f7-f9d361b96bdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:14.998271 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6b1f0-e078-4584-84f7-f9d361b96bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:14.999095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6b1f0-e078-4584-84f7-f9d361b96bdc admin admin] PATH_INFO: `/v3/projects/997c6fc3ce3245c2ab0a686a726ebfef/users/4353291f5a334e3b8059707d1d48034f/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:15.091764 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6b1f0-e078-4584-84f7-f9d361b96bdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=997c6fc3ce3245c2ab0a686a726ebfef, user_id=4353291f5a334e3b8059707d1d48034f, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:15.098247 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6b1f0-e078-4584-84f7-f9d361b96bdc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:15.149085 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 860/1700] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:14 2022] PUT /identity/v3/projects/997c6fc3ce3245c2ab0a686a726ebfef/users/4353291f5a334e3b8059707d1d48034f/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:15.156583 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2c72a-a744-4823-87fa-765d03ba8e6a service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:15.210437 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2c72a-a744-4823-87fa-765d03ba8e6a service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:15.431054 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6b1f0-e078-4584-84f7-f9d361b96bdc admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:15.436946 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e1b6b1f0-e078-4584-84f7-f9d361b96bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:15.504092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2726a-f6c2-4f13-a551-455afb6711f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:15.505512 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2726a-f6c2-4f13-a551-455afb6711f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:15.506211 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2726a-f6c2-4f13-a551-455afb6711f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:15.506855 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2726a-f6c2-4f13-a551-455afb6711f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:15.509809 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2726a-f6c2-4f13-a551-455afb6711f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:15.516186 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2726a-f6c2-4f13-a551-455afb6711f1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:15.550185 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 841/1701] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:15.581317 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2726a-f6c2-4f13-a551-455afb6711f1 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:15.619857 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2726a-f6c2-4f13-a551-455afb6711f1 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:15.638008 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27040fa-041b-4678-8093-d16a41058c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:15.643863 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27040fa-041b-4678-8093-d16a41058c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:15.643863 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27040fa-041b-4678-8093-d16a41058c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:15.644212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27040fa-041b-4678-8093-d16a41058c3a admin admin] PATH_INFO: `/v3/projects/997c6fc3ce3245c2ab0a686a726ebfef/users/4353291f5a334e3b8059707d1d48034f/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:15.653700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27040fa-041b-4678-8093-d16a41058c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=997c6fc3ce3245c2ab0a686a726ebfef, user_id=4353291f5a334e3b8059707d1d48034f, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:15.662034 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27040fa-041b-4678-8093-d16a41058c3a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:15.696582 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 842/1702] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:15 2022] PUT /identity/v3/projects/997c6fc3ce3245c2ab0a686a726ebfef/users/4353291f5a334e3b8059707d1d48034f/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:15.704428 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6b1f0-e078-4584-84f7-f9d361b96bdc admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:15.717484 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77127302-529e-4ede-bbab-73709d8fe564 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:15.718000 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77127302-529e-4ede-bbab-73709d8fe564 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:15.719976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77127302-529e-4ede-bbab-73709d8fe564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:15.815733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-77127302-529e-4ede-bbab-73709d8fe564 None None] MFA Rules not processed for user `4353291f5a334e3b8059707d1d48034f`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:15.817358 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-77127302-529e-4ede-bbab-73709d8fe564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:15.908528 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:15.962535 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c283157-e62c-4ef3-886d-ba26f389ecdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:15.966485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c283157-e62c-4ef3-886d-ba26f389ecdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:15.967028 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c283157-e62c-4ef3-886d-ba26f389ecdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:15.967488 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c283157-e62c-4ef3-886d-ba26f389ecdd admin admin] PATH_INFO: `/v3/users/77301e3dffc34a83aa1f71893a9c68d0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:15.971459 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 843/1703] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:15.982689 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c283157-e62c-4ef3-886d-ba26f389ecdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=77301e3dffc34a83aa1f71893a9c68d0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:15.989687 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c283157-e62c-4ef3-886d-ba26f389ecdd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:15.995173 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77127302-529e-4ede-bbab-73709d8fe564 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:16.039027 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:16.191048 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4c283157-e62c-4ef3-886d-ba26f389ecdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77301e3dffc34a83aa1f71893a9c68d0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:16.201207 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77127302-529e-4ede-bbab-73709d8fe564 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:16.218852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4c283157-e62c-4ef3-886d-ba26f389ecdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77301e3dffc34a83aa1f71893a9c68d0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:16.220234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4c283157-e62c-4ef3-886d-ba26f389ecdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77301e3dffc34a83aa1f71893a9c68d0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:16.230877 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559ec4f-c0c4-460d-ab90-2e4804b1bec6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:16.231630 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559ec4f-c0c4-460d-ab90-2e4804b1bec6 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:16.232002 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559ec4f-c0c4-460d-ab90-2e4804b1bec6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:16.232301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559ec4f-c0c4-460d-ab90-2e4804b1bec6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:16.238589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4c283157-e62c-4ef3-886d-ba26f389ecdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77301e3dffc34a83aa1f71893a9c68d0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:16.240185 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a559ec4f-c0c4-460d-ab90-2e4804b1bec6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:16.256822 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4c283157-e62c-4ef3-886d-ba26f389ecdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77301e3dffc34a83aa1f71893a9c68d0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:16.287086 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 861/1704] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:35:15 2022] DELETE /identity/v3/users/77301e3dffc34a83aa1f71893a9c68d0 => generated 0 bytes in 857 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:16.288942 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559ec4f-c0c4-460d-ab90-2e4804b1bec6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:16.294866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891440a8-46d4-49eb-876d-dddd990a5018 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:16.295330 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891440a8-46d4-49eb-876d-dddd990a5018 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:16.295766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891440a8-46d4-49eb-876d-dddd990a5018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:16.296926 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559ec4f-c0c4-460d-ab90-2e4804b1bec6 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:16.365630 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 844/1705] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:35:16.399578 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-891440a8-46d4-49eb-876d-dddd990a5018 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:16.403914 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-891440a8-46d4-49eb-876d-dddd990a5018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:16.599262 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559ec4f-c0c4-460d-ab90-2e4804b1bec6 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:16.601930 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a559ec4f-c0c4-460d-ab90-2e4804b1bec6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:16.656892 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 862/1706] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:16.675873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559ec4f-c0c4-460d-ab90-2e4804b1bec6 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:16.763621 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891440a8-46d4-49eb-876d-dddd990a5018 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:16.766510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-891440a8-46d4-49eb-876d-dddd990a5018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:16.899927 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83a15e-4f68-4010-b4e9-8f19d6331422 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:16.902481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83a15e-4f68-4010-b4e9-8f19d6331422 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:16.903129 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83a15e-4f68-4010-b4e9-8f19d6331422 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:16.903509 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83a15e-4f68-4010-b4e9-8f19d6331422 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:16.907934 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1d83a15e-4f68-4010-b4e9-8f19d6331422 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:17.010057 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891440a8-46d4-49eb-876d-dddd990a5018 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:17.021561 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ed408-c12c-41e6-8457-f504aa1a9405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:17.022422 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ed408-c12c-41e6-8457-f504aa1a9405 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:17.023224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ed408-c12c-41e6-8457-f504aa1a9405 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:17.024100 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ed408-c12c-41e6-8457-f504aa1a9405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:17.050429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ed408-c12c-41e6-8457-f504aa1a9405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:17.053972 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ed408-c12c-41e6-8457-f504aa1a9405 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:17.067399 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83a15e-4f68-4010-b4e9-8f19d6331422 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:17.069193 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83a15e-4f68-4010-b4e9-8f19d6331422 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:17.107374 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 845/1707] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:17.131246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 863/1708] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:35:17.518823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a506e-2ddf-41ab-bdbd-24f230c98886 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:17.519485 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a506e-2ddf-41ab-bdbd-24f230c98886 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:17.519995 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a506e-2ddf-41ab-bdbd-24f230c98886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:17.598470 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-943a506e-2ddf-41ab-bdbd-24f230c98886 None None] MFA Rules not processed for user `e08b6d367dc542f882cb821abd11cc34`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:17.602221 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-943a506e-2ddf-41ab-bdbd-24f230c98886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:17.733509 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:17.791555 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ed408-c12c-41e6-8457-f504aa1a9405 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:17.796312 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-950ed408-c12c-41e6-8457-f504aa1a9405 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:17.829661 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 846/1709] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:35:17.847722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ed408-c12c-41e6-8457-f504aa1a9405 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:17.870629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a506e-2ddf-41ab-bdbd-24f230c98886 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:17.873086 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a2156-86e2-4c2f-805b-c824b0279f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:17.874177 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-943a506e-2ddf-41ab-bdbd-24f230c98886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:17.874684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a2156-86e2-4c2f-805b-c824b0279f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:17.875089 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a2156-86e2-4c2f-805b-c824b0279f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:17.876224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a2156-86e2-4c2f-805b-c824b0279f14 admin admin] PATH_INFO: `/v3/users/8ced84e972b54efdabcdefa487461f40` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:17.884548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a2156-86e2-4c2f-805b-c824b0279f14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ced84e972b54efdabcdefa487461f40)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:17.891413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a2156-86e2-4c2f-805b-c824b0279f14 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:18.062055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:18.090332 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b50a2156-86e2-4c2f-805b-c824b0279f14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ced84e972b54efdabcdefa487461f40'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:18.124222 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b50a2156-86e2-4c2f-805b-c824b0279f14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ced84e972b54efdabcdefa487461f40'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:18.126667 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b50a2156-86e2-4c2f-805b-c824b0279f14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ced84e972b54efdabcdefa487461f40'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:18.145225 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b50a2156-86e2-4c2f-805b-c824b0279f14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ced84e972b54efdabcdefa487461f40'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:18.168731 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b50a2156-86e2-4c2f-805b-c824b0279f14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ced84e972b54efdabcdefa487461f40'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:18.180676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 864/1710] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:35:17 2022] DELETE /identity/v3/users/8ced84e972b54efdabcdefa487461f40 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:18.211107 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a506e-2ddf-41ab-bdbd-24f230c98886 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:18.318838 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a2156-86e2-4c2f-805b-c824b0279f14 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:18.320722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b50a2156-86e2-4c2f-805b-c824b0279f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:18.471645 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb35468-062a-4cd8-b8d8-4da690b800e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:18.472442 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb35468-062a-4cd8-b8d8-4da690b800e2 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:18.477103 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb35468-062a-4cd8-b8d8-4da690b800e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:18.477520 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb35468-062a-4cd8-b8d8-4da690b800e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:18.481924 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-bcb35468-062a-4cd8-b8d8-4da690b800e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:18.564440 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a2156-86e2-4c2f-805b-c824b0279f14 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:18.591961 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e55c72-870b-4ea1-b760-a111242c8fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:18.592648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e55c72-870b-4ea1-b760-a111242c8fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:18.592949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e55c72-870b-4ea1-b760-a111242c8fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:18.593232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e55c72-870b-4ea1-b760-a111242c8fd2 admin admin] PATH_INFO: `/v3/projects/cb26f305b6c540aa9012cf9decf20f2b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:18.597830 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e55c72-870b-4ea1-b760-a111242c8fd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb26f305b6c540aa9012cf9decf20f2b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:18.599677 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e55c72-870b-4ea1-b760-a111242c8fd2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:18.731060 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb35468-062a-4cd8-b8d8-4da690b800e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:18.741348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb35468-062a-4cd8-b8d8-4da690b800e2 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:18.799855 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 847/1711] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:17 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 929 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:35:18.822016 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a3e55c72-870b-4ea1-b760-a111242c8fd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb26f305b6c540aa9012cf9decf20f2b', 'request_id': 'req-a3e55c72-870b-4ea1-b760-a111242c8fd2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:18.841545 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a3e55c72-870b-4ea1-b760-a111242c8fd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb26f305b6c540aa9012cf9decf20f2b', 'request_id': 'req-a3e55c72-870b-4ea1-b760-a111242c8fd2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:18.873444 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a3e55c72-870b-4ea1-b760-a111242c8fd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb26f305b6c540aa9012cf9decf20f2b', 'request_id': 'req-a3e55c72-870b-4ea1-b760-a111242c8fd2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:18.910228 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a3e55c72-870b-4ea1-b760-a111242c8fd2 admin admin] The token cache is being invalidate because project cb26f305b6c540aa9012cf9decf20f2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:35:18.910656 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a3e55c72-870b-4ea1-b760-a111242c8fd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:18.920312 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a3e55c72-870b-4ea1-b760-a111242c8fd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:18.928685 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 865/1712] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:35:18 2022] DELETE /identity/v3/projects/cb26f305b6c540aa9012cf9decf20f2b => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:18.932150 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb35468-062a-4cd8-b8d8-4da690b800e2 service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:18.956056 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb35468-062a-4cd8-b8d8-4da690b800e2 service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:18.975192 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:19.201174 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941ef5b-e841-401a-8cb7-9f5749bf6357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:19.202828 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941ef5b-e841-401a-8cb7-9f5749bf6357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:19.204519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941ef5b-e841-401a-8cb7-9f5749bf6357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:19.204519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941ef5b-e841-401a-8cb7-9f5749bf6357 admin admin] PATH_INFO: `/v3/users/c34bad40caba4309b25f8cec92e29294` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:19.208533 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941ef5b-e841-401a-8cb7-9f5749bf6357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c34bad40caba4309b25f8cec92e29294)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:19.210821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941ef5b-e841-401a-8cb7-9f5749bf6357 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:19.329165 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6941ef5b-e841-401a-8cb7-9f5749bf6357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c34bad40caba4309b25f8cec92e29294'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:19.364465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6941ef5b-e841-401a-8cb7-9f5749bf6357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c34bad40caba4309b25f8cec92e29294'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:19.368125 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6941ef5b-e841-401a-8cb7-9f5749bf6357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c34bad40caba4309b25f8cec92e29294'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:19.371299 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6941ef5b-e841-401a-8cb7-9f5749bf6357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c34bad40caba4309b25f8cec92e29294'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:19.388195 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6941ef5b-e841-401a-8cb7-9f5749bf6357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c34bad40caba4309b25f8cec92e29294'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:19.419811 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 848/1713] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:35:18 2022] DELETE /identity/v3/users/c34bad40caba4309b25f8cec92e29294 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:19.479676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e55c72-870b-4ea1-b760-a111242c8fd2 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:19.481825 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a3e55c72-870b-4ea1-b760-a111242c8fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:19.510811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e55c72-870b-4ea1-b760-a111242c8fd2 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:19.596182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:19.650752 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c4f44-b162-45f0-ac9c-84d4cedacde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:19.651525 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c4f44-b162-45f0-ac9c-84d4cedacde8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:19.651848 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c4f44-b162-45f0-ac9c-84d4cedacde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:19.652849 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c4f44-b162-45f0-ac9c-84d4cedacde8 admin admin] PATH_INFO: `/v3/projects/64ea4652b0df426b8a1de567c0a74516` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:19.654980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c4f44-b162-45f0-ac9c-84d4cedacde8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64ea4652b0df426b8a1de567c0a74516)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:19.659344 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c4f44-b162-45f0-ac9c-84d4cedacde8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:19.858567 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e37c4f44-b162-45f0-ac9c-84d4cedacde8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64ea4652b0df426b8a1de567c0a74516', 'request_id': 'req-e37c4f44-b162-45f0-ac9c-84d4cedacde8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:19.880569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e37c4f44-b162-45f0-ac9c-84d4cedacde8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64ea4652b0df426b8a1de567c0a74516', 'request_id': 'req-e37c4f44-b162-45f0-ac9c-84d4cedacde8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:19.898229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e37c4f44-b162-45f0-ac9c-84d4cedacde8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64ea4652b0df426b8a1de567c0a74516', 'request_id': 'req-e37c4f44-b162-45f0-ac9c-84d4cedacde8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:19.940479 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e37c4f44-b162-45f0-ac9c-84d4cedacde8 admin admin] The token cache is being invalidate because project 64ea4652b0df426b8a1de567c0a74516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:35:19.940479 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e37c4f44-b162-45f0-ac9c-84d4cedacde8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:19.940479 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e37c4f44-b162-45f0-ac9c-84d4cedacde8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:19.948171 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941ef5b-e841-401a-8cb7-9f5749bf6357 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:19.949581 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 866/1714] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:35:19 2022] DELETE /identity/v3/projects/64ea4652b0df426b8a1de567c0a74516 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:19.950719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6941ef5b-e841-401a-8cb7-9f5749bf6357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:19.978035 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941ef5b-e841-401a-8cb7-9f5749bf6357 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:20.299568 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb0276-5fc4-4021-a6fc-235c055cfe58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:20.301012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb0276-5fc4-4021-a6fc-235c055cfe58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:20.303754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb0276-5fc4-4021-a6fc-235c055cfe58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:20.304315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb0276-5fc4-4021-a6fc-235c055cfe58 admin admin] PATH_INFO: `/v3/users/731aa16040154889a17ceeb53bf3e358` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:20.316283 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb0276-5fc4-4021-a6fc-235c055cfe58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=731aa16040154889a17ceeb53bf3e358)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:20.327272 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb0276-5fc4-4021-a6fc-235c055cfe58 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:20.426489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c4f44-b162-45f0-ac9c-84d4cedacde8 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:20.428185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e37c4f44-b162-45f0-ac9c-84d4cedacde8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:20.453287 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c4f44-b162-45f0-ac9c-84d4cedacde8 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:20.464497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e5b21-c7a3-4c02-874b-c5b7a19ee4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:20.466898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e5b21-c7a3-4c02-874b-c5b7a19ee4b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:20.467166 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e5b21-c7a3-4c02-874b-c5b7a19ee4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:20.471144 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e5b21-c7a3-4c02-874b-c5b7a19ee4b7 admin admin] PATH_INFO: `/v3/projects/6e79752d0b7844ba93ee263eb460f800` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:20.475003 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e5b21-c7a3-4c02-874b-c5b7a19ee4b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e79752d0b7844ba93ee263eb460f800)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:20.480583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e5b21-c7a3-4c02-874b-c5b7a19ee4b7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:20.493614 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:20.589666 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3deb0276-5fc4-4021-a6fc-235c055cfe58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '731aa16040154889a17ceeb53bf3e358'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:20.639249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0a7e5b21-c7a3-4c02-874b-c5b7a19ee4b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e79752d0b7844ba93ee263eb460f800', 'request_id': 'req-0a7e5b21-c7a3-4c02-874b-c5b7a19ee4b7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:20.653390 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3deb0276-5fc4-4021-a6fc-235c055cfe58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '731aa16040154889a17ceeb53bf3e358'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:20.656693 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3deb0276-5fc4-4021-a6fc-235c055cfe58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '731aa16040154889a17ceeb53bf3e358'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:20.660307 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3deb0276-5fc4-4021-a6fc-235c055cfe58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '731aa16040154889a17ceeb53bf3e358'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:20.670142 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0a7e5b21-c7a3-4c02-874b-c5b7a19ee4b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e79752d0b7844ba93ee263eb460f800', 'request_id': 'req-0a7e5b21-c7a3-4c02-874b-c5b7a19ee4b7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:20.693799 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3deb0276-5fc4-4021-a6fc-235c055cfe58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '731aa16040154889a17ceeb53bf3e358'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:20.704104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0a7e5b21-c7a3-4c02-874b-c5b7a19ee4b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e79752d0b7844ba93ee263eb460f800', 'request_id': 'req-0a7e5b21-c7a3-4c02-874b-c5b7a19ee4b7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:20.732858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0a7e5b21-c7a3-4c02-874b-c5b7a19ee4b7 admin admin] The token cache is being invalidate because project 6e79752d0b7844ba93ee263eb460f800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:35:20.735793 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0a7e5b21-c7a3-4c02-874b-c5b7a19ee4b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:20.738189 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0a7e5b21-c7a3-4c02-874b-c5b7a19ee4b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:20.743113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 867/1715] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:35:20 2022] DELETE /identity/v3/projects/6e79752d0b7844ba93ee263eb460f800 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:20.749932 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e5b21-c7a3-4c02-874b-c5b7a19ee4b7 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:20.751742 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0a7e5b21-c7a3-4c02-874b-c5b7a19ee4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:20.769323 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 849/1716] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:35:19 2022] DELETE /identity/v3/users/731aa16040154889a17ceeb53bf3e358 => generated 0 bytes in 819 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:20.930539 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:20.962374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e5b21-c7a3-4c02-874b-c5b7a19ee4b7 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:21.124459 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308ab1e-a5c4-4f8e-9f11-0c2180b48820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:21.127111 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308ab1e-a5c4-4f8e-9f11-0c2180b48820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:21.127404 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308ab1e-a5c4-4f8e-9f11-0c2180b48820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:21.127768 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308ab1e-a5c4-4f8e-9f11-0c2180b48820 admin admin] PATH_INFO: `/v3/users/a788bc9c753d4be5adf2f152f5d4a34e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:21.131785 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308ab1e-a5c4-4f8e-9f11-0c2180b48820 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a788bc9c753d4be5adf2f152f5d4a34e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:21.135624 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308ab1e-a5c4-4f8e-9f11-0c2180b48820 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:21.221566 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec23ac-898b-441b-b789-c07260490214 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:21.226513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec23ac-898b-441b-b789-c07260490214 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:21.227592 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec23ac-898b-441b-b789-c07260490214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:21.256151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f308ab1e-a5c4-4f8e-9f11-0c2180b48820 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a788bc9c753d4be5adf2f152f5d4a34e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:21.288349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f308ab1e-a5c4-4f8e-9f11-0c2180b48820 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a788bc9c753d4be5adf2f152f5d4a34e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:21.291348 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f308ab1e-a5c4-4f8e-9f11-0c2180b48820 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a788bc9c753d4be5adf2f152f5d4a34e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:21.307926 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f308ab1e-a5c4-4f8e-9f11-0c2180b48820 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a788bc9c753d4be5adf2f152f5d4a34e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:21.322650 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c1ec23ac-898b-441b-b789-c07260490214 None None] MFA Rules not processed for user `054b27e46b8648979d8777e90748722d`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:21.326093 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c1ec23ac-898b-441b-b789-c07260490214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:21.337206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f308ab1e-a5c4-4f8e-9f11-0c2180b48820 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a788bc9c753d4be5adf2f152f5d4a34e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:21.351197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 868/1717] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:35:20 2022] DELETE /identity/v3/users/a788bc9c753d4be5adf2f152f5d4a34e => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:21.706876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 850/1718] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:21.714222 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308ab1e-a5c4-4f8e-9f11-0c2180b48820 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:21.716384 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f308ab1e-a5c4-4f8e-9f11-0c2180b48820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:21.911733 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308ab1e-a5c4-4f8e-9f11-0c2180b48820 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:21.921405 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435bd7b-2778-462f-99b9-f70f045908c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:21.922091 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435bd7b-2778-462f-99b9-f70f045908c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:21.922376 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435bd7b-2778-462f-99b9-f70f045908c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:21.922713 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435bd7b-2778-462f-99b9-f70f045908c8 admin admin] PATH_INFO: `/v3/projects/54052fe7cc3148c098e30e7702091e88` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:21.938649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435bd7b-2778-462f-99b9-f70f045908c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54052fe7cc3148c098e30e7702091e88)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:21.945210 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435bd7b-2778-462f-99b9-f70f045908c8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:21.996483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec23ac-898b-441b-b789-c07260490214 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:22.000370 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c1ec23ac-898b-441b-b789-c07260490214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:22.027713 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:22.115003 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec23ac-898b-441b-b789-c07260490214 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:22.178371 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b435bd7b-2778-462f-99b9-f70f045908c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54052fe7cc3148c098e30e7702091e88', 'request_id': 'req-b435bd7b-2778-462f-99b9-f70f045908c8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:22.211915 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b435bd7b-2778-462f-99b9-f70f045908c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54052fe7cc3148c098e30e7702091e88', 'request_id': 'req-b435bd7b-2778-462f-99b9-f70f045908c8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:22.243421 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b435bd7b-2778-462f-99b9-f70f045908c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54052fe7cc3148c098e30e7702091e88', 'request_id': 'req-b435bd7b-2778-462f-99b9-f70f045908c8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:22.297449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b435bd7b-2778-462f-99b9-f70f045908c8 admin admin] The token cache is being invalidate because project 54052fe7cc3148c098e30e7702091e88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:35:22.297970 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b435bd7b-2778-462f-99b9-f70f045908c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:22.301402 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b435bd7b-2778-462f-99b9-f70f045908c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:22.317629 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 869/1719] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:35:21 2022] DELETE /identity/v3/projects/54052fe7cc3148c098e30e7702091e88 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:22.321312 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5969e-16ea-4453-b9c6-9f03a0b8485a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:22.321823 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5969e-16ea-4453-b9c6-9f03a0b8485a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:22.322325 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5969e-16ea-4453-b9c6-9f03a0b8485a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:22.402662 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d8c5969e-16ea-4453-b9c6-9f03a0b8485a None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:22.405217 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d8c5969e-16ea-4453-b9c6-9f03a0b8485a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:22.424242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0101f5e-de80-4048-9361-cd54a22369cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:22.429617 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0101f5e-de80-4048-9361-cd54a22369cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:22.430354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0101f5e-de80-4048-9361-cd54a22369cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:22.430971 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0101f5e-de80-4048-9361-cd54a22369cf admin admin] PATH_INFO: `/v3/users/9588e9efa7d24781b1a638f72a13dfab` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:22.440533 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0101f5e-de80-4048-9361-cd54a22369cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9588e9efa7d24781b1a638f72a13dfab)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:22.443520 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 870/1720] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:22.456859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0101f5e-de80-4048-9361-cd54a22369cf admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:22.464992 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38bece-df46-428f-8af4-2d54ddc722e0 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:22.465421 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38bece-df46-428f-8af4-2d54ddc722e0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:22.465842 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38bece-df46-428f-8af4-2d54ddc722e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:22.538177 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1c38bece-df46-428f-8af4-2d54ddc722e0 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:22.548106 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1c38bece-df46-428f-8af4-2d54ddc722e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:22.585119 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 871/1721] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:22.589066 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38bece-df46-428f-8af4-2d54ddc722e0 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:22.594952 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1c38bece-df46-428f-8af4-2d54ddc722e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:22.642094 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38bece-df46-428f-8af4-2d54ddc722e0 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:22.670611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e0101f5e-de80-4048-9361-cd54a22369cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9588e9efa7d24781b1a638f72a13dfab'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:22.671681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a76fd-ac87-4076-819f-eee4506783cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:22.672919 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a76fd-ac87-4076-819f-eee4506783cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:22.673429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a76fd-ac87-4076-819f-eee4506783cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:22.673944 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a76fd-ac87-4076-819f-eee4506783cf admin admin] PATH_INFO: `/v3/projects/316be62936ea494894a5a8f38c178d7c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:22.676272 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a76fd-ac87-4076-819f-eee4506783cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=316be62936ea494894a5a8f38c178d7c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:22.681663 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a76fd-ac87-4076-819f-eee4506783cf admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:22.698216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:22.739401 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e0101f5e-de80-4048-9361-cd54a22369cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9588e9efa7d24781b1a638f72a13dfab'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:22.747562 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e0101f5e-de80-4048-9361-cd54a22369cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9588e9efa7d24781b1a638f72a13dfab'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:22.749393 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e0101f5e-de80-4048-9361-cd54a22369cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9588e9efa7d24781b1a638f72a13dfab'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:22.774412 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e0101f5e-de80-4048-9361-cd54a22369cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9588e9efa7d24781b1a638f72a13dfab'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:22.828941 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 851/1722] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:35:21 2022] DELETE /identity/v3/users/9588e9efa7d24781b1a638f72a13dfab => generated 0 bytes in 830 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:35:22.834127 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0101f5e-de80-4048-9361-cd54a22369cf admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:22.836861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e0101f5e-de80-4048-9361-cd54a22369cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:22.920343 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-707a76fd-ac87-4076-819f-eee4506783cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '316be62936ea494894a5a8f38c178d7c', 'request_id': 'req-707a76fd-ac87-4076-819f-eee4506783cf'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:22.941778 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-707a76fd-ac87-4076-819f-eee4506783cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '316be62936ea494894a5a8f38c178d7c', 'request_id': 'req-707a76fd-ac87-4076-819f-eee4506783cf'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:22.983381 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-707a76fd-ac87-4076-819f-eee4506783cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '316be62936ea494894a5a8f38c178d7c', 'request_id': 'req-707a76fd-ac87-4076-819f-eee4506783cf'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:23.056025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-707a76fd-ac87-4076-819f-eee4506783cf admin admin] The token cache is being invalidate because project 316be62936ea494894a5a8f38c178d7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:35:23.056588 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-707a76fd-ac87-4076-819f-eee4506783cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:23.075289 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-707a76fd-ac87-4076-819f-eee4506783cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:23.075499 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0101f5e-de80-4048-9361-cd54a22369cf admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:23.083382 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 872/1723] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:35:22 2022] DELETE /identity/v3/projects/316be62936ea494894a5a8f38c178d7c => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:23.093257 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7fbe9-f653-4373-81d6-0cb2003a35d6 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:23.094848 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7fbe9-f653-4373-81d6-0cb2003a35d6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:23.095356 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7fbe9-f653-4373-81d6-0cb2003a35d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:23.198158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87dc363-993e-44d2-9997-184f288af102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:23.199029 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dc363-993e-44d2-9997-184f288af102 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:23.199416 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dc363-993e-44d2-9997-184f288af102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:23.199800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dc363-993e-44d2-9997-184f288af102 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:23.200744 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87dc363-993e-44d2-9997-184f288af102 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:35:23.201118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87dc363-993e-44d2-9997-184f288af102 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:23.202950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87dc363-993e-44d2-9997-184f288af102 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:23.216993 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0ca7fbe9-f653-4373-81d6-0cb2003a35d6 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:23.218123 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 852/1724] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:35:23.219814 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1b2d2-c460-416e-a342-daff4f86477b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:23.220333 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1b2d2-c460-416e-a342-daff4f86477b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:23.220748 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1b2d2-c460-416e-a342-daff4f86477b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:23.225394 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0ca7fbe9-f653-4373-81d6-0cb2003a35d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:23.244307 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-90e1b2d2-c460-416e-a342-daff4f86477b None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:23.246250 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-90e1b2d2-c460-416e-a342-daff4f86477b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:23.256329 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 853/1725] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:23.257841 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1b2d2-c460-416e-a342-daff4f86477b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:23.259852 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-90e1b2d2-c460-416e-a342-daff4f86477b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:23.275108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1b2d2-c460-416e-a342-daff4f86477b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:23.282046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 873/1726] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:23.287101 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f9dc9-4485-464f-ab85-2fc44297eb69 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:23.287551 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f9dc9-4485-464f-ab85-2fc44297eb69 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:23.287965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f9dc9-4485-464f-ab85-2fc44297eb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:23.294913 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef97c4-160b-4e6b-9c89-e39e44247c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:23.295994 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef97c4-160b-4e6b-9c89-e39e44247c2c admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:23.304005 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef97c4-160b-4e6b-9c89-e39e44247c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:23.304712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef97c4-160b-4e6b-9c89-e39e44247c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:23.306006 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef97c4-160b-4e6b-9c89-e39e44247c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:23.310662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef97c4-160b-4e6b-9c89-e39e44247c2c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:23.371906 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-808f9dc9-4485-464f-ab85-2fc44297eb69 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:23.374109 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-808f9dc9-4485-464f-ab85-2fc44297eb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:23.410997 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 874/1727] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:23.418310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f9dc9-4485-464f-ab85-2fc44297eb69 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:23.441520 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 854/1728] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:23 2022] POST /identity/v3/projects => generated 381 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:23.447514 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef97c4-160b-4e6b-9c89-e39e44247c2c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:23.460430 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f9dc9-4485-464f-ab85-2fc44297eb69 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:23.567626 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:23.636232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef97c4-160b-4e6b-9c89-e39e44247c2c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:23.673830 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fff71a-4443-42a6-ad75-32519ad39f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:23.674856 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fff71a-4443-42a6-ad75-32519ad39f5b admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:23.675311 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fff71a-4443-42a6-ad75-32519ad39f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:23.675821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fff71a-4443-42a6-ad75-32519ad39f5b admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:23.677762 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fff71a-4443-42a6-ad75-32519ad39f5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:23.683981 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fff71a-4443-42a6-ad75-32519ad39f5b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:23.751491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a5c06-0935-41ef-b507-53fa47377c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:23.752355 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a5c06-0935-41ef-b507-53fa47377c52 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:23.752921 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a5c06-0935-41ef-b507-53fa47377c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:23.753426 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a5c06-0935-41ef-b507-53fa47377c52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:23.754668 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a5c06-0935-41ef-b507-53fa47377c52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:35:23.755218 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a5c06-0935-41ef-b507-53fa47377c52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:23.768051 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a5c06-0935-41ef-b507-53fa47377c52 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:23.784052 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 855/1729] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:23 2022] POST /identity/v3/users => generated 291 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:23.785911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fff71a-4443-42a6-ad75-32519ad39f5b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:23.816843 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:23.832914 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 875/1730] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:35:23.844387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a5c06-0935-41ef-b507-53fa47377c52 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:23.862388 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fff71a-4443-42a6-ad75-32519ad39f5b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:23.889862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a77f2c-10d1-4ab2-ae2a-2a4ea52f35b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:23.890574 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a77f2c-10d1-4ab2-ae2a-2a4ea52f35b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:23.891069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a77f2c-10d1-4ab2-ae2a-2a4ea52f35b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:23.891568 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a77f2c-10d1-4ab2-ae2a-2a4ea52f35b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:23.892877 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a77f2c-10d1-4ab2-ae2a-2a4ea52f35b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:23.899155 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a77f2c-10d1-4ab2-ae2a-2a4ea52f35b5 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:23.906943 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a5c06-0935-41ef-b507-53fa47377c52 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:23.925785 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ab540-49f6-44a1-addb-b177395f4a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:23.927296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ab540-49f6-44a1-addb-b177395f4a81 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:23.927918 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ab540-49f6-44a1-addb-b177395f4a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:23.928492 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ab540-49f6-44a1-addb-b177395f4a81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:23.933807 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ab540-49f6-44a1-addb-b177395f4a81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:23.938493 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ab540-49f6-44a1-addb-b177395f4a81 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:23.947055 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 856/1731] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:23.956561 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a77f2c-10d1-4ab2-ae2a-2a4ea52f35b5 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:24.016849 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a77f2c-10d1-4ab2-ae2a-2a4ea52f35b5 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:24.042457 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c3bc5-074e-4e09-997c-7372c6577c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:24.045954 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c3bc5-074e-4e09-997c-7372c6577c1f admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:24.047743 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c3bc5-074e-4e09-997c-7372c6577c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:24.048226 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c3bc5-074e-4e09-997c-7372c6577c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:24.050472 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c3bc5-074e-4e09-997c-7372c6577c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:24.069329 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 876/1732] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:23 2022] POST /identity/v3/projects => generated 379 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:24.069860 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c3bc5-074e-4e09-997c-7372c6577c1f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:24.071535 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ab540-49f6-44a1-addb-b177395f4a81 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:24.125637 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 857/1733] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:24.126825 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c3bc5-074e-4e09-997c-7372c6577c1f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:24.144123 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c3bc5-074e-4e09-997c-7372c6577c1f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:24.234611 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ab540-49f6-44a1-addb-b177395f4a81 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:24.240657 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93e933-e00d-430e-9e37-da52a173ccf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:24.241517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93e933-e00d-430e-9e37-da52a173ccf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:24.241946 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93e933-e00d-430e-9e37-da52a173ccf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:24.244211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93e933-e00d-430e-9e37-da52a173ccf9 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:24.245313 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93e933-e00d-430e-9e37-da52a173ccf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:24.251055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93e933-e00d-430e-9e37-da52a173ccf9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:24.325468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 877/1734] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:24 2022] POST /identity/v3/users => generated 290 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:24.332481 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93e933-e00d-430e-9e37-da52a173ccf9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:24.361169 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93e933-e00d-430e-9e37-da52a173ccf9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:24.377214 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4f805-d6c7-4161-b726-86da3f18e762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:24.379202 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4f805-d6c7-4161-b726-86da3f18e762 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:24.379202 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4f805-d6c7-4161-b726-86da3f18e762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:24.381309 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4f805-d6c7-4161-b726-86da3f18e762 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:24.382846 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd4ce6-39a3-4522-96a2-d3388feb1fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:24.383549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd4ce6-39a3-4522-96a2-d3388feb1fc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:24.383934 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4f805-d6c7-4161-b726-86da3f18e762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:24.385107 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd4ce6-39a3-4522-96a2-d3388feb1fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:24.385396 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd4ce6-39a3-4522-96a2-d3388feb1fc3 admin admin] PATH_INFO: `/v3/projects/5c7b6b5cd383421aaab8d7a887162007/users/1fc9d5197ebf4d788411c16cb8db1e92/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:24.388514 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4f805-d6c7-4161-b726-86da3f18e762 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:24.420357 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 878/1735] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:35:24.424886 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4f805-d6c7-4161-b726-86da3f18e762 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:24.432236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd4ce6-39a3-4522-96a2-d3388feb1fc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7b6b5cd383421aaab8d7a887162007, user_id=1fc9d5197ebf4d788411c16cb8db1e92, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:24.436993 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd4ce6-39a3-4522-96a2-d3388feb1fc3 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:24.453509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4f805-d6c7-4161-b726-86da3f18e762 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:24.470407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6cda16-e09d-4e21-bcae-e8ce57ef4770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:24.475042 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 858/1736] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:24 2022] PUT /identity/v3/projects/5c7b6b5cd383421aaab8d7a887162007/users/1fc9d5197ebf4d788411c16cb8db1e92/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:24.475854 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cda16-e09d-4e21-bcae-e8ce57ef4770 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:24.475854 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cda16-e09d-4e21-bcae-e8ce57ef4770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:24.476144 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cda16-e09d-4e21-bcae-e8ce57ef4770 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:24.476753 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6cda16-e09d-4e21-bcae-e8ce57ef4770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:24.478471 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd4ce6-39a3-4522-96a2-d3388feb1fc3 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:24.481657 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6cda16-e09d-4e21-bcae-e8ce57ef4770 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:24.485275 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-35bd4ce6-39a3-4522-96a2-d3388feb1fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:24.520478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 879/1737] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:24.525987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569c84d-2941-4d28-8ef3-1d4c50496a12 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:24.526265 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569c84d-2941-4d28-8ef3-1d4c50496a12 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:24.528306 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569c84d-2941-4d28-8ef3-1d4c50496a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:24.632245 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5569c84d-2941-4d28-8ef3-1d4c50496a12 None None] MFA Rules not processed for user `1fc9d5197ebf4d788411c16cb8db1e92`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:24.635662 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5569c84d-2941-4d28-8ef3-1d4c50496a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:24.657792 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd4ce6-39a3-4522-96a2-d3388feb1fc3 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:24.663513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdf37a-c2ee-4743-ac93-bfc9ddab5fcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:24.666075 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdf37a-c2ee-4743-ac93-bfc9ddab5fcb service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:24.666885 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdf37a-c2ee-4743-ac93-bfc9ddab5fcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:24.679381 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdf37a-c2ee-4743-ac93-bfc9ddab5fcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:24.810213 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 880/1738] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:24.818947 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569c84d-2941-4d28-8ef3-1d4c50496a12 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:24.894117 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:24.924716 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcdf37a-c2ee-4743-ac93-bfc9ddab5fcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:24.927341 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcdf37a-c2ee-4743-ac93-bfc9ddab5fcb service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:24.971904 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 859/1739] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:24.972878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdf37a-c2ee-4743-ac93-bfc9ddab5fcb service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:24.976840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ddcdf37a-c2ee-4743-ac93-bfc9ddab5fcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:25.020653 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:25.022425 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdf37a-c2ee-4743-ac93-bfc9ddab5fcb service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:25.036010 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365e0ca-b469-4cfb-8370-00ed894af9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:25.036978 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365e0ca-b469-4cfb-8370-00ed894af9ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:25.037441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365e0ca-b469-4cfb-8370-00ed894af9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:25.037864 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365e0ca-b469-4cfb-8370-00ed894af9ee admin admin] PATH_INFO: `/v3/projects/5cbff20d01b346f9b365ad05a74fb418` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:25.040463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365e0ca-b469-4cfb-8370-00ed894af9ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cbff20d01b346f9b365ad05a74fb418)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:25.044380 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365e0ca-b469-4cfb-8370-00ed894af9ee admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:25.091719 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569c84d-2941-4d28-8ef3-1d4c50496a12 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:25.111144 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0f5ec-2685-419d-bec0-9244714e5a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:25.114348 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0f5ec-2685-419d-bec0-9244714e5a04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:25.118834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0f5ec-2685-419d-bec0-9244714e5a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:25.119815 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0f5ec-2685-419d-bec0-9244714e5a04 admin admin] PATH_INFO: `/v3/projects/553aedb1b57749c89e0193a073957795/users/e8595677551e4fae9b63f0db25e1233f/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:25.149425 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c365e0ca-b469-4cfb-8370-00ed894af9ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cbff20d01b346f9b365ad05a74fb418', 'request_id': 'req-c365e0ca-b469-4cfb-8370-00ed894af9ee'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:25.162181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0f5ec-2685-419d-bec0-9244714e5a04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=553aedb1b57749c89e0193a073957795, user_id=e8595677551e4fae9b63f0db25e1233f, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:25.169023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0f5ec-2685-419d-bec0-9244714e5a04 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:25.174810 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c365e0ca-b469-4cfb-8370-00ed894af9ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cbff20d01b346f9b365ad05a74fb418', 'request_id': 'req-c365e0ca-b469-4cfb-8370-00ed894af9ee'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:25.205031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c365e0ca-b469-4cfb-8370-00ed894af9ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cbff20d01b346f9b365ad05a74fb418', 'request_id': 'req-c365e0ca-b469-4cfb-8370-00ed894af9ee'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:25.211539 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 881/1740] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:24 2022] PUT /identity/v3/projects/553aedb1b57749c89e0193a073957795/users/e8595677551e4fae9b63f0db25e1233f/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:25.213051 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0f5ec-2685-419d-bec0-9244714e5a04 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:25.286102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c365e0ca-b469-4cfb-8370-00ed894af9ee admin admin] The token cache is being invalidate because project 5cbff20d01b346f9b365ad05a74fb418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:35:25.286673 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c365e0ca-b469-4cfb-8370-00ed894af9ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:25.288014 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c365e0ca-b469-4cfb-8370-00ed894af9ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:25.294813 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 860/1741] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:35:24 2022] DELETE /identity/v3/projects/5cbff20d01b346f9b365ad05a74fb418 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:25.300780 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebad20f-c42d-4e27-b83f-b5a215d251ac None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:25.301457 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebad20f-c42d-4e27-b83f-b5a215d251ac None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:25.302028 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebad20f-c42d-4e27-b83f-b5a215d251ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:25.341160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0f5ec-2685-419d-bec0-9244714e5a04 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:25.348808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e62b9-6dfa-419f-83f6-b8aaf3f130aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:25.349573 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e62b9-6dfa-419f-83f6-b8aaf3f130aa admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:25.349858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e62b9-6dfa-419f-83f6-b8aaf3f130aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:25.350133 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e62b9-6dfa-419f-83f6-b8aaf3f130aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:25.350977 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e62b9-6dfa-419f-83f6-b8aaf3f130aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:25.353171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e62b9-6dfa-419f-83f6-b8aaf3f130aa admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:25.373079 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4ebad20f-c42d-4e27-b83f-b5a215d251ac None None] MFA Rules not processed for user `e8595677551e4fae9b63f0db25e1233f`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:25.376021 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4ebad20f-c42d-4e27-b83f-b5a215d251ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:25.404806 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 882/1742] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:25 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:25.407325 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64eff9-6ca9-4f45-a046-c8ef35bede62 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:25.407691 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64eff9-6ca9-4f45-a046-c8ef35bede62 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:25.408189 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64eff9-6ca9-4f45-a046-c8ef35bede62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:25.457275 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8b64eff9-6ca9-4f45-a046-c8ef35bede62 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:25.458777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8b64eff9-6ca9-4f45-a046-c8ef35bede62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:25.565197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 883/1743] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:25.566189 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64eff9-6ca9-4f45-a046-c8ef35bede62 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:25.580349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8b64eff9-6ca9-4f45-a046-c8ef35bede62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:25.608967 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64eff9-6ca9-4f45-a046-c8ef35bede62 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:25.633732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4b91c-e688-46ee-9e4f-e75536922df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:25.640466 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4b91c-e688-46ee-9e4f-e75536922df6 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:25.641414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4b91c-e688-46ee-9e4f-e75536922df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:25.642600 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4b91c-e688-46ee-9e4f-e75536922df6 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:25.644920 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4b91c-e688-46ee-9e4f-e75536922df6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:25.652883 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4b91c-e688-46ee-9e4f-e75536922df6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:25.669609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 861/1744] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:25.671562 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54f1b6-bc71-4f99-b7f4-fc9bd1e71aab None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:25.671974 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54f1b6-bc71-4f99-b7f4-fc9bd1e71aab None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:25.672326 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54f1b6-bc71-4f99-b7f4-fc9bd1e71aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:25.730974 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 884/1745] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:25 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:25.733112 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4b91c-e688-46ee-9e4f-e75536922df6 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:25.737086 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ce54f1b6-bc71-4f99-b7f4-fc9bd1e71aab None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:25.739506 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ce54f1b6-bc71-4f99-b7f4-fc9bd1e71aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:25.743586 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-12d4b91c-e688-46ee-9e4f-e75536922df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:25.751395 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 862/1746] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:25.752577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54f1b6-bc71-4f99-b7f4-fc9bd1e71aab None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:25.779794 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54f1b6-bc71-4f99-b7f4-fc9bd1e71aab None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:25.785643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4b91c-e688-46ee-9e4f-e75536922df6 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:25.785913 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494d9a9-3cf1-4147-afe7-531417af4a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:25.787349 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494d9a9-3cf1-4147-afe7-531417af4a63 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:25.787753 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494d9a9-3cf1-4147-afe7-531417af4a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:25.788105 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494d9a9-3cf1-4147-afe7-531417af4a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:25.789343 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494d9a9-3cf1-4147-afe7-531417af4a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:25.792206 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494d9a9-3cf1-4147-afe7-531417af4a63 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:25.819064 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 863/1747] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:25.819593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494d9a9-3cf1-4147-afe7-531417af4a63 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:25.828109 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7a2b5-9158-4e81-bc9e-df7dc893cfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:25.829319 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7a2b5-9158-4e81-bc9e-df7dc893cfde admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:25.829708 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7a2b5-9158-4e81-bc9e-df7dc893cfde admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:25.830206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7a2b5-9158-4e81-bc9e-df7dc893cfde admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:25.831478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7a2b5-9158-4e81-bc9e-df7dc893cfde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:25.834284 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494d9a9-3cf1-4147-afe7-531417af4a63 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:25.835439 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7a2b5-9158-4e81-bc9e-df7dc893cfde admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:25.840942 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706e122-36a2-409b-ab94-e6ce0e8fd070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:25.841970 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706e122-36a2-409b-ab94-e6ce0e8fd070 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:25.842786 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706e122-36a2-409b-ab94-e6ce0e8fd070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:25.843291 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706e122-36a2-409b-ab94-e6ce0e8fd070 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:25.844469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706e122-36a2-409b-ab94-e6ce0e8fd070 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:35:25.845051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706e122-36a2-409b-ab94-e6ce0e8fd070 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:25.848012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706e122-36a2-409b-ab94-e6ce0e8fd070 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:25.873275 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 864/1748] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:35:25.875536 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706e122-36a2-409b-ab94-e6ce0e8fd070 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:25.891739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706e122-36a2-409b-ab94-e6ce0e8fd070 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:25.901461 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5efac4-d19c-472f-b1ac-b0339606520e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:25.903016 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5efac4-d19c-472f-b1ac-b0339606520e admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:25.904963 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5efac4-d19c-472f-b1ac-b0339606520e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:25.906503 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5efac4-d19c-472f-b1ac-b0339606520e admin admin] PATH_INFO: `/v3/projects/59da6220e6c04218b3783cf2df16a8fe/users/c1b24caccee5427491e5c96649fc845c/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:25.956432 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5efac4-d19c-472f-b1ac-b0339606520e admin admin] RBAC: Authorizing `identity:create_grant(project_id=59da6220e6c04218b3783cf2df16a8fe, user_id=c1b24caccee5427491e5c96649fc845c, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:25.971701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5efac4-d19c-472f-b1ac-b0339606520e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:25.983773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 885/1749] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:25 2022] POST /identity/v3/projects => generated 379 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:25.985090 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7a2b5-9158-4e81-bc9e-df7dc893cfde admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:26.005880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:26.018538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:26.031495 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 865/1750] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:25 2022] PUT /identity/v3/projects/59da6220e6c04218b3783cf2df16a8fe/users/c1b24caccee5427491e5c96649fc845c/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:26.034069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5efac4-d19c-472f-b1ac-b0339606520e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:26.203714 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7a2b5-9158-4e81-bc9e-df7dc893cfde admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:26.377625 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5efac4-d19c-472f-b1ac-b0339606520e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:26.379020 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec4f88-b1e9-41c9-81a4-4a19310df7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:26.379705 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec4f88-b1e9-41c9-81a4-4a19310df7a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:26.379990 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec4f88-b1e9-41c9-81a4-4a19310df7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:26.380265 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec4f88-b1e9-41c9-81a4-4a19310df7a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:26.380978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec4f88-b1e9-41c9-81a4-4a19310df7a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:26.383057 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec4f88-b1e9-41c9-81a4-4a19310df7a3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:26.395004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199152e-52b0-4456-8c20-8976df269b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:26.396897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199152e-52b0-4456-8c20-8976df269b10 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:26.397343 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199152e-52b0-4456-8c20-8976df269b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:26.397839 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199152e-52b0-4456-8c20-8976df269b10 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:26.399159 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199152e-52b0-4456-8c20-8976df269b10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:26.404693 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199152e-52b0-4456-8c20-8976df269b10 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:26.457261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 886/1751] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:25 2022] POST /identity/v3/projects => generated 371 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:26.458280 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec4f88-b1e9-41c9-81a4-4a19310df7a3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:26.506892 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 866/1752] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:26 2022] POST /identity/v3/users => generated 296 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:26.510665 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67658fbe-80df-4f96-a91f-ada90088422e None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:26.511205 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67658fbe-80df-4f96-a91f-ada90088422e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:26.512478 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67658fbe-80df-4f96-a91f-ada90088422e None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:26.516341 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 867/1753] 10.222.0.52 () {54 vars in 912 bytes} [Thu Sep 1 16:35:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:35:26.518632 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67658fbe-80df-4f96-a91f-ada90088422e None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:26.639119 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec4f88-b1e9-41c9-81a4-4a19310df7a3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:26.649918 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9480c-ebb5-40b8-8bdb-d18a77a47c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:26.650651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9480c-ebb5-40b8-8bdb-d18a77a47c07 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:26.650952 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9480c-ebb5-40b8-8bdb-d18a77a47c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:26.651232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9480c-ebb5-40b8-8bdb-d18a77a47c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:26.653803 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9480c-ebb5-40b8-8bdb-d18a77a47c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:26.655634 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9480c-ebb5-40b8-8bdb-d18a77a47c07 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:26.675250 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 887/1754] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:26.677646 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9480c-ebb5-40b8-8bdb-d18a77a47c07 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:26.705862 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9480c-ebb5-40b8-8bdb-d18a77a47c07 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:26.725295 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ac40b-1a8f-4024-99ec-9d1257a2f707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:26.725990 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ac40b-1a8f-4024-99ec-9d1257a2f707 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:26.726239 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ac40b-1a8f-4024-99ec-9d1257a2f707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:26.726519 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ac40b-1a8f-4024-99ec-9d1257a2f707 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:26.727215 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ac40b-1a8f-4024-99ec-9d1257a2f707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:26.728996 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ac40b-1a8f-4024-99ec-9d1257a2f707 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:26.773644 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 888/1755] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:26.775002 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6cdf9-f7f8-492e-905e-1f065af02d40 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:26.775292 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6cdf9-f7f8-492e-905e-1f065af02d40 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:26.775654 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6cdf9-f7f8-492e-905e-1f065af02d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:26.833796 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67658fbe-80df-4f96-a91f-ada90088422e None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:26.843249 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b03e0-4c67-4e88-ad77-1b326a6f147a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:26.844259 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b03e0-4c67-4e88-ad77-1b326a6f147a admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:26.844851 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b03e0-4c67-4e88-ad77-1b326a6f147a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:26.845389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b03e0-4c67-4e88-ad77-1b326a6f147a admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:26.853323 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b03e0-4c67-4e88-ad77-1b326a6f147a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:26.856436 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b03e0-4c67-4e88-ad77-1b326a6f147a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:26.883224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ecc6cdf9-f7f8-492e-905e-1f065af02d40 None None] MFA Rules not processed for user `0668b918bf2c49c2901838cd22770030`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:26.883965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ecc6cdf9-f7f8-492e-905e-1f065af02d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:26.893620 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:26.923521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 868/1756] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:26 2022] POST /identity/v3/users => generated 286 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:26.923521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d97dd2-7ae9-49c2-9b98-c154235c258c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:26.923521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d97dd2-7ae9-49c2-9b98-c154235c258c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:26.923521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d97dd2-7ae9-49c2-9b98-c154235c258c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:26.994512 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e9d97dd2-7ae9-49c2-9b98-c154235c258c None None] MFA Rules not processed for user `071e0d407c6e4353b491c246700c3e41`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:26.998784 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e9d97dd2-7ae9-49c2-9b98-c154235c258c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:27.008085 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 889/1757] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 1 16:35:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:27.009983 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6cdf9-f7f8-492e-905e-1f065af02d40 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:27.029268 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6cdf9-f7f8-492e-905e-1f065af02d40 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:27.043424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33073dce-19cd-4b33-9cc6-e08e21706d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:27.044940 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33073dce-19cd-4b33-9cc6-e08e21706d8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:27.045332 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33073dce-19cd-4b33-9cc6-e08e21706d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:27.046381 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33073dce-19cd-4b33-9cc6-e08e21706d8e admin admin] PATH_INFO: `/v3/projects/59da6220e6c04218b3783cf2df16a8fe/users/c1b24caccee5427491e5c96649fc845c/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:27.049747 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33073dce-19cd-4b33-9cc6-e08e21706d8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=59da6220e6c04218b3783cf2df16a8fe, user_id=c1b24caccee5427491e5c96649fc845c, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:27.054767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33073dce-19cd-4b33-9cc6-e08e21706d8e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:27.100145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 890/1758] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:27 2022] PUT /identity/v3/projects/59da6220e6c04218b3783cf2df16a8fe/users/c1b24caccee5427491e5c96649fc845c/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:27.102843 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33073dce-19cd-4b33-9cc6-e08e21706d8e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:27.266575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33073dce-19cd-4b33-9cc6-e08e21706d8e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:27.272041 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaacbca-d620-4120-be65-5b948eaf5c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:27.272969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaacbca-d620-4120-be65-5b948eaf5c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:27.273251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaacbca-d620-4120-be65-5b948eaf5c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:27.273531 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaacbca-d620-4120-be65-5b948eaf5c27 admin admin] PATH_INFO: `/v3/projects/c2574729623a49dab46ab9d7a58dcc72/users/6b19f61860b54c18bcc2a0d896c62e38/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:27.296408 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaacbca-d620-4120-be65-5b948eaf5c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2574729623a49dab46ab9d7a58dcc72, user_id=6b19f61860b54c18bcc2a0d896c62e38, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:27.299886 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaacbca-d620-4120-be65-5b948eaf5c27 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:27.318833 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 869/1759] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:27.321674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d97dd2-7ae9-49c2-9b98-c154235c258c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:27.325867 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e9d97dd2-7ae9-49c2-9b98-c154235c258c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:27.326992 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 891/1760] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:27 2022] PUT /identity/v3/projects/c2574729623a49dab46ab9d7a58dcc72/users/6b19f61860b54c18bcc2a0d896c62e38/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:27.328057 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaacbca-d620-4120-be65-5b948eaf5c27 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:27.362920 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d97dd2-7ae9-49c2-9b98-c154235c258c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:27.381228 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:27.482986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaacbca-d620-4120-be65-5b948eaf5c27 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:27.503195 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40469e-a964-48a1-a962-2596f9d5eb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:27.504077 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40469e-a964-48a1-a962-2596f9d5eb08 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:27.504372 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40469e-a964-48a1-a962-2596f9d5eb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:27.504723 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40469e-a964-48a1-a962-2596f9d5eb08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:27.505428 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40469e-a964-48a1-a962-2596f9d5eb08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:27.507211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40469e-a964-48a1-a962-2596f9d5eb08 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:27.542565 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 892/1761] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:27.544262 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40469e-a964-48a1-a962-2596f9d5eb08 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:27.547264 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1d40469e-a964-48a1-a962-2596f9d5eb08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:27.551096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024ce27-aed9-4dd1-bdc5-7a4d7698852e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:27.551780 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024ce27-aed9-4dd1-bdc5-7a4d7698852e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:27.552065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024ce27-aed9-4dd1-bdc5-7a4d7698852e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:27.552341 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024ce27-aed9-4dd1-bdc5-7a4d7698852e admin admin] PATH_INFO: `/v3/projects/aea5fdd36f434a588042afa14ac2a0f6` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:27.554145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024ce27-aed9-4dd1-bdc5-7a4d7698852e admin admin] RBAC: Authorizing `identity:delete_project(project_id=aea5fdd36f434a588042afa14ac2a0f6)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:27.558983 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024ce27-aed9-4dd1-bdc5-7a4d7698852e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:27.625267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:27.742516 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3024ce27-aed9-4dd1-bdc5-7a4d7698852e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aea5fdd36f434a588042afa14ac2a0f6', 'request_id': 'req-3024ce27-aed9-4dd1-bdc5-7a4d7698852e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:27.762265 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40469e-a964-48a1-a962-2596f9d5eb08 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:27.766254 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3024ce27-aed9-4dd1-bdc5-7a4d7698852e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aea5fdd36f434a588042afa14ac2a0f6', 'request_id': 'req-3024ce27-aed9-4dd1-bdc5-7a4d7698852e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:27.792322 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3024ce27-aed9-4dd1-bdc5-7a4d7698852e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aea5fdd36f434a588042afa14ac2a0f6', 'request_id': 'req-3024ce27-aed9-4dd1-bdc5-7a4d7698852e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:27.862331 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3024ce27-aed9-4dd1-bdc5-7a4d7698852e admin admin] The token cache is being invalidate because project aea5fdd36f434a588042afa14ac2a0f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:35:27.863027 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3024ce27-aed9-4dd1-bdc5-7a4d7698852e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:27.867926 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3024ce27-aed9-4dd1-bdc5-7a4d7698852e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:27.887671 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 870/1762] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:35:27 2022] DELETE /identity/v3/projects/aea5fdd36f434a588042afa14ac2a0f6 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:27.894692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad8542-fad9-42e4-91f6-4a0f0c9651b9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:27.895092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad8542-fad9-42e4-91f6-4a0f0c9651b9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:27.895598 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad8542-fad9-42e4-91f6-4a0f0c9651b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:27.951454 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c0ad8542-fad9-42e4-91f6-4a0f0c9651b9 None None] MFA Rules not processed for user `3fb9d9c35c224ceabcb12fe5933e09c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:27.953249 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c0ad8542-fad9-42e4-91f6-4a0f0c9651b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:28.031815 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c361a-131e-4267-ba42-b00194688b07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:28.034526 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c361a-131e-4267-ba42-b00194688b07 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:28.034831 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c361a-131e-4267-ba42-b00194688b07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:28.037527 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c361a-131e-4267-ba42-b00194688b07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:28.042267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-309c361a-131e-4267-ba42-b00194688b07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:28.073064 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c361a-131e-4267-ba42-b00194688b07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:28.075575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c361a-131e-4267-ba42-b00194688b07 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:28.097529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 871/1763] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:28.101437 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1da2b-5b4b-4f61-96d0-375e54b734a4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:28.101437 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1da2b-5b4b-4f61-96d0-375e54b734a4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:28.101437 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1da2b-5b4b-4f61-96d0-375e54b734a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:28.110570 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 893/1764] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:28.119332 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c361a-131e-4267-ba42-b00194688b07 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:28.130718 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-309c361a-131e-4267-ba42-b00194688b07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:28.159605 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e9d1da2b-5b4b-4f61-96d0-375e54b734a4 None None] MFA Rules not processed for user `c1b24caccee5427491e5c96649fc845c`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:28.161093 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e9d1da2b-5b4b-4f61-96d0-375e54b734a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:28.204839 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:28.266377 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c361a-131e-4267-ba42-b00194688b07 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:28.283013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ef44a-570c-4f63-9e4f-59f47abf5b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:28.283999 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ef44a-570c-4f63-9e4f-59f47abf5b1d admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:28.283999 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ef44a-570c-4f63-9e4f-59f47abf5b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:28.284974 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ef44a-570c-4f63-9e4f-59f47abf5b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:28.285805 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ef44a-570c-4f63-9e4f-59f47abf5b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:28.288814 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ef44a-570c-4f63-9e4f-59f47abf5b1d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:28.342399 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 894/1766] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:28.342642 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 872/1766] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:28 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:28.342642 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1da2b-5b4b-4f61-96d0-375e54b734a4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:28.345456 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54dfc2-c357-4481-b6ab-5fcc2efaa816 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:28.345778 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54dfc2-c357-4481-b6ab-5fcc2efaa816 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:28.346274 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54dfc2-c357-4481-b6ab-5fcc2efaa816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:28.347854 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e9d1da2b-5b4b-4f61-96d0-375e54b734a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:28.385275 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-bb54dfc2-c357-4481-b6ab-5fcc2efaa816 None None] MFA Rules not processed for user `071e0d407c6e4353b491c246700c3e41`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:28.386598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bb54dfc2-c357-4481-b6ab-5fcc2efaa816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:28.394119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1da2b-5b4b-4f61-96d0-375e54b734a4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:28.403167 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160daba7-b80e-4329-91e8-42ad642af178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:28.404579 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160daba7-b80e-4329-91e8-42ad642af178 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:28.405336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160daba7-b80e-4329-91e8-42ad642af178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:28.406255 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160daba7-b80e-4329-91e8-42ad642af178 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:28.408508 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160daba7-b80e-4329-91e8-42ad642af178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:28.412954 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160daba7-b80e-4329-91e8-42ad642af178 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:28.435772 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 873/1767] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:28.437200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160daba7-b80e-4329-91e8-42ad642af178 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:28.441754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-160daba7-b80e-4329-91e8-42ad642af178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:28.491036 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160daba7-b80e-4329-91e8-42ad642af178 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:28.503288 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c5841-5cbc-400d-8486-e46c789fd14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:28.505204 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c5841-5cbc-400d-8486-e46c789fd14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:28.506160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c5841-5cbc-400d-8486-e46c789fd14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:28.506909 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c5841-5cbc-400d-8486-e46c789fd14d admin admin] PATH_INFO: `/v3/users/4353291f5a334e3b8059707d1d48034f` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:28.510153 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c5841-5cbc-400d-8486-e46c789fd14d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4353291f5a334e3b8059707d1d48034f)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:28.516590 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c5841-5cbc-400d-8486-e46c789fd14d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:28.652435 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 895/1768] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:28.654461 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47836189-bbd2-4579-a184-47a7641c7bd9 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:28.654785 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47836189-bbd2-4579-a184-47a7641c7bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:28.655019 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47836189-bbd2-4579-a184-47a7641c7bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:28.726558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-482c5841-5cbc-400d-8486-e46c789fd14d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4353291f5a334e3b8059707d1d48034f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:28.735754 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-47836189-bbd2-4579-a184-47a7641c7bd9 None None] MFA Rules not processed for user `e08b6d367dc542f882cb821abd11cc34`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:28.743956 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-47836189-bbd2-4579-a184-47a7641c7bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:28.769514 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-482c5841-5cbc-400d-8486-e46c789fd14d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4353291f5a334e3b8059707d1d48034f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:28.770835 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-482c5841-5cbc-400d-8486-e46c789fd14d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4353291f5a334e3b8059707d1d48034f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:28.772200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-482c5841-5cbc-400d-8486-e46c789fd14d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4353291f5a334e3b8059707d1d48034f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:28.779568 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:28.793399 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-482c5841-5cbc-400d-8486-e46c789fd14d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4353291f5a334e3b8059707d1d48034f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:28.832820 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 874/1769] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:35:28 2022] DELETE /identity/v3/users/4353291f5a334e3b8059707d1d48034f => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:28.832820 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c5841-5cbc-400d-8486-e46c789fd14d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:28.835650 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-482c5841-5cbc-400d-8486-e46c789fd14d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:28.881613 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 896/1770] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:28.881613 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47836189-bbd2-4579-a184-47a7641c7bd9 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:28.885150 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-47836189-bbd2-4579-a184-47a7641c7bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:29.071937 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47836189-bbd2-4579-a184-47a7641c7bd9 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:29.089637 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c5841-5cbc-400d-8486-e46c789fd14d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:29.117151 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11e47b-e07e-4b2a-ae24-72b71dc453cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:29.119362 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11e47b-e07e-4b2a-ae24-72b71dc453cc service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:29.119808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11e47b-e07e-4b2a-ae24-72b71dc453cc service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:29.120089 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11e47b-e07e-4b2a-ae24-72b71dc453cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:29.132850 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ff11e47b-e07e-4b2a-ae24-72b71dc453cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:29.168463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:29.227965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cce13-3533-4b7a-9670-987c238c7740 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:29.228599 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cce13-3533-4b7a-9670-987c238c7740 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:29.228953 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cce13-3533-4b7a-9670-987c238c7740 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:29.229235 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cce13-3533-4b7a-9670-987c238c7740 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:29.231897 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-695cce13-3533-4b7a-9670-987c238c7740 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:29.318001 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11e47b-e07e-4b2a-ae24-72b71dc453cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:29.320599 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11e47b-e07e-4b2a-ae24-72b71dc453cc service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:29.351678 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 875/1771] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:29.352350 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11e47b-e07e-4b2a-ae24-72b71dc453cc service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:29.360832 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ff11e47b-e07e-4b2a-ae24-72b71dc453cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:29.421916 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695cce13-3533-4b7a-9670-987c238c7740 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:29.427242 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695cce13-3533-4b7a-9670-987c238c7740 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:29.451696 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 897/1772] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:29.453792 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cce13-3533-4b7a-9670-987c238c7740 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:29.458386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-695cce13-3533-4b7a-9670-987c238c7740 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:29.545937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11e47b-e07e-4b2a-ae24-72b71dc453cc service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:29.564343 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125734b-2039-4d21-abf3-e9bc0bc80c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:29.565102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125734b-2039-4d21-abf3-e9bc0bc80c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:29.565387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125734b-2039-4d21-abf3-e9bc0bc80c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:29.565666 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125734b-2039-4d21-abf3-e9bc0bc80c50 admin admin] PATH_INFO: `/v3/projects/c2574729623a49dab46ab9d7a58dcc72/users/6b19f61860b54c18bcc2a0d896c62e38/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:29.571375 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125734b-2039-4d21-abf3-e9bc0bc80c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2574729623a49dab46ab9d7a58dcc72, user_id=6b19f61860b54c18bcc2a0d896c62e38, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:29.579002 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:29.581803 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125734b-2039-4d21-abf3-e9bc0bc80c50 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:29.665134 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 876/1773] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:29 2022] PUT /identity/v3/projects/c2574729623a49dab46ab9d7a58dcc72/users/6b19f61860b54c18bcc2a0d896c62e38/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:29.672734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125734b-2039-4d21-abf3-e9bc0bc80c50 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:29.702599 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d125734b-2039-4d21-abf3-e9bc0bc80c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:29.742195 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cce13-3533-4b7a-9670-987c238c7740 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:29.913113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b17a74-36f5-45cd-9d11-83c2e06e1d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:29.913744 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b17a74-36f5-45cd-9d11-83c2e06e1d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:29.926307 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b17a74-36f5-45cd-9d11-83c2e06e1d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:29.926843 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b17a74-36f5-45cd-9d11-83c2e06e1d66 admin admin] PATH_INFO: `/v3/projects/3406aadf651f451bb21a3ac2ce2bcb49/users/74c07ca9deb64410b29beaead7223ff6/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:30.013635 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b17a74-36f5-45cd-9d11-83c2e06e1d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3406aadf651f451bb21a3ac2ce2bcb49, user_id=74c07ca9deb64410b29beaead7223ff6, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:30.018342 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b17a74-36f5-45cd-9d11-83c2e06e1d66 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:30.051958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 898/1774] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:29 2022] PUT /identity/v3/projects/3406aadf651f451bb21a3ac2ce2bcb49/users/74c07ca9deb64410b29beaead7223ff6/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:30.051958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b17a74-36f5-45cd-9d11-83c2e06e1d66 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:30.060507 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-69b17a74-36f5-45cd-9d11-83c2e06e1d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:30.095603 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125734b-2039-4d21-abf3-e9bc0bc80c50 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:30.373155 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:30.458496 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b17a74-36f5-45cd-9d11-83c2e06e1d66 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:30.465813 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11a4db-c67f-4056-ba5c-cb8536fca863 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:30.466897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11a4db-c67f-4056-ba5c-cb8536fca863 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:30.467560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11a4db-c67f-4056-ba5c-cb8536fca863 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:30.468674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11a4db-c67f-4056-ba5c-cb8536fca863 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:30.472040 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872f5dd-5800-498f-bb63-d1f48f12c7c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64fc190fac540259444a531cdbb8d53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:30.473338 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872f5dd-5800-498f-bb63-d1f48f12c7c4 service placement] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:30.473482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4f11a4db-c67f-4056-ba5c-cb8536fca863 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:30.475445 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872f5dd-5800-498f-bb63-d1f48f12c7c4 service placement] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:30.476280 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872f5dd-5800-498f-bb63-d1f48f12c7c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:30.486719 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9872f5dd-5800-498f-bb63-d1f48f12c7c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:30.526977 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872f5dd-5800-498f-bb63-d1f48f12c7c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:30.530811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872f5dd-5800-498f-bb63-d1f48f12c7c4 service placement] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:30.565478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 899/1775] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:30.568170 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd185982-bcdf-4e1c-b1e9-35c6acfece32 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:30.568695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd185982-bcdf-4e1c-b1e9-35c6acfece32 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:30.569378 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd185982-bcdf-4e1c-b1e9-35c6acfece32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:30.643440 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-dd185982-bcdf-4e1c-b1e9-35c6acfece32 None None] MFA Rules not processed for user `6b19f61860b54c18bcc2a0d896c62e38`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:30.645668 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dd185982-bcdf-4e1c-b1e9-35c6acfece32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:30.744396 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11a4db-c67f-4056-ba5c-cb8536fca863 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:30.751720 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11a4db-c67f-4056-ba5c-cb8536fca863 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:30.773558 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:30.790713 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 877/1776] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 1124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:30.792557 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11a4db-c67f-4056-ba5c-cb8536fca863 service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:30.801407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4f11a4db-c67f-4056-ba5c-cb8536fca863 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:30.858662 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 900/1777] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:30 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:30.859622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd185982-bcdf-4e1c-b1e9-35c6acfece32 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:30.961789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd185982-bcdf-4e1c-b1e9-35c6acfece32 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:30.970105 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace43d0f-de7d-4d09-ab3f-46e32de1fe5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:30.971341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace43d0f-de7d-4d09-ab3f-46e32de1fe5a service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:30.972926 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace43d0f-de7d-4d09-ab3f-46e32de1fe5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:30.973276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace43d0f-de7d-4d09-ab3f-46e32de1fe5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:30.979095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ace43d0f-de7d-4d09-ab3f-46e32de1fe5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:31.087790 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11a4db-c67f-4056-ba5c-cb8536fca863 service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:31.117201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262dabc-5548-49e0-b22e-810769a53a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:31.118057 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262dabc-5548-49e0-b22e-810769a53a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:31.120303 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262dabc-5548-49e0-b22e-810769a53a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:31.120730 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262dabc-5548-49e0-b22e-810769a53a44 admin admin] PATH_INFO: `/v3/projects/997c6fc3ce3245c2ab0a686a726ebfef` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:31.124522 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262dabc-5548-49e0-b22e-810769a53a44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=997c6fc3ce3245c2ab0a686a726ebfef)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:31.133358 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262dabc-5548-49e0-b22e-810769a53a44 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:31.165783 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace43d0f-de7d-4d09-ab3f-46e32de1fe5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:31.173045 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace43d0f-de7d-4d09-ab3f-46e32de1fe5a service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:31.247009 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 901/1778] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:31.256016 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3048d38-ea40-47b7-b79a-c2e6de019e65 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:31.261646 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3048d38-ea40-47b7-b79a-c2e6de019e65 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:31.271870 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3048d38-ea40-47b7-b79a-c2e6de019e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:31.292126 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8262dabc-5548-49e0-b22e-810769a53a44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '997c6fc3ce3245c2ab0a686a726ebfef', 'request_id': 'req-8262dabc-5548-49e0-b22e-810769a53a44'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:31.305960 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8262dabc-5548-49e0-b22e-810769a53a44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '997c6fc3ce3245c2ab0a686a726ebfef', 'request_id': 'req-8262dabc-5548-49e0-b22e-810769a53a44'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:31.326785 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8262dabc-5548-49e0-b22e-810769a53a44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '997c6fc3ce3245c2ab0a686a726ebfef', 'request_id': 'req-8262dabc-5548-49e0-b22e-810769a53a44'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:31.355505 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8262dabc-5548-49e0-b22e-810769a53a44 admin admin] The token cache is being invalidate because project 997c6fc3ce3245c2ab0a686a726ebfef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:35:31.355811 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8262dabc-5548-49e0-b22e-810769a53a44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:31.358459 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8262dabc-5548-49e0-b22e-810769a53a44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:31.369780 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 878/1779] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:35:30 2022] DELETE /identity/v3/projects/997c6fc3ce3245c2ab0a686a726ebfef => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:31.369780 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb718f-c533-466b-823f-0cc3369040bd None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:31.369780 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb718f-c533-466b-823f-0cc3369040bd None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:31.369780 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb718f-c533-466b-823f-0cc3369040bd None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:31.373006 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 879/1780] 10.222.0.52 () {54 vars in 912 bytes} [Thu Sep 1 16:35:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:35:31.373225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb718f-c533-466b-823f-0cc3369040bd None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:31.380497 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e9fb718f-c533-466b-823f-0cc3369040bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:31.420865 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:31.435612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a3048d38-ea40-47b7-b79a-c2e6de019e65 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:31.442719 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a3048d38-ea40-47b7-b79a-c2e6de019e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:31.597508 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 902/1781] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:31.599017 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71687cd0-d124-4921-8ac2-e381057378c7 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:31.599312 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71687cd0-d124-4921-8ac2-e381057378c7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:31.599594 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71687cd0-d124-4921-8ac2-e381057378c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:31.662052 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-71687cd0-d124-4921-8ac2-e381057378c7 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:31.663548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-71687cd0-d124-4921-8ac2-e381057378c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:31.694730 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb718f-c533-466b-823f-0cc3369040bd None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:31.716246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 903/1782] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:31.716246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a9b9d-4d69-49df-8eef-b905be71fc02 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:31.716246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a9b9d-4d69-49df-8eef-b905be71fc02 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:31.716246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a9b9d-4d69-49df-8eef-b905be71fc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:31.716936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70022e-caee-4769-995a-e94a093381bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:31.716936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70022e-caee-4769-995a-e94a093381bc service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:31.716936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70022e-caee-4769-995a-e94a093381bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:31.716936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70022e-caee-4769-995a-e94a093381bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:31.725883 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1b70022e-caee-4769-995a-e94a093381bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:31.770516 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b64a9b9d-4d69-49df-8eef-b905be71fc02 None None] MFA Rules not processed for user `0668b918bf2c49c2901838cd22770030`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:31.772378 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b64a9b9d-4d69-49df-8eef-b905be71fc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:31.818975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:31.861372 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 904/1783] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 1 16:35:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:31.863011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a9b9d-4d69-49df-8eef-b905be71fc02 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:31.864945 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b64a9b9d-4d69-49df-8eef-b905be71fc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:31.877578 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a9b9d-4d69-49df-8eef-b905be71fc02 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:31.889385 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca87109-e6b5-4875-a35f-77ca49b99132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:31.890796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca87109-e6b5-4875-a35f-77ca49b99132 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:31.891741 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca87109-e6b5-4875-a35f-77ca49b99132 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:31.892539 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca87109-e6b5-4875-a35f-77ca49b99132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:31.897956 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70022e-caee-4769-995a-e94a093381bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:31.900866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70022e-caee-4769-995a-e94a093381bc service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:31.933136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 880/1784] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:31 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:31.934267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca87109-e6b5-4875-a35f-77ca49b99132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:31.934649 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb022f7-be14-42ed-9e66-74da4e898289 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:31.934938 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb022f7-be14-42ed-9e66-74da4e898289 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:31.935216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb022f7-be14-42ed-9e66-74da4e898289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:31.939137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca87109-e6b5-4875-a35f-77ca49b99132 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:31.973663 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 905/1785] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:31.976052 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca87109-e6b5-4875-a35f-77ca49b99132 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:31.979891 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9ca87109-e6b5-4875-a35f-77ca49b99132 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:32.017705 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca87109-e6b5-4875-a35f-77ca49b99132 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:32.028146 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd7ffc-2cc3-48bb-a9e0-89e05e28eba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:32.029626 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd7ffc-2cc3-48bb-a9e0-89e05e28eba9 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:32.029626 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd7ffc-2cc3-48bb-a9e0-89e05e28eba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:32.029626 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd7ffc-2cc3-48bb-a9e0-89e05e28eba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:32.032137 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-6fb022f7-be14-42ed-9e66-74da4e898289 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:32.033460 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6fb022f7-be14-42ed-9e66-74da4e898289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:32.051045 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd7ffc-2cc3-48bb-a9e0-89e05e28eba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:32.057677 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd7ffc-2cc3-48bb-a9e0-89e05e28eba9 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:32.081436 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 881/1786] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:32.083513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 906/1787] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:32.091713 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb022f7-be14-42ed-9e66-74da4e898289 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:32.114918 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb022f7-be14-42ed-9e66-74da4e898289 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:32.133797 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eacfcc-0697-41cc-a6e7-681a5a5c482a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:32.134906 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eacfcc-0697-41cc-a6e7-681a5a5c482a admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:32.134906 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eacfcc-0697-41cc-a6e7-681a5a5c482a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:32.135677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eacfcc-0697-41cc-a6e7-681a5a5c482a admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:32.137012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eacfcc-0697-41cc-a6e7-681a5a5c482a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:35:32.154981 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eacfcc-0697-41cc-a6e7-681a5a5c482a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:32.159631 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eacfcc-0697-41cc-a6e7-681a5a5c482a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:32.201546 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 882/1788] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:35:32.204654 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd7ffc-2cc3-48bb-a9e0-89e05e28eba9 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:32.233937 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd7ffc-2cc3-48bb-a9e0-89e05e28eba9 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:32.246535 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dc996-4d7f-4276-851f-8d8643642cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:32.247303 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dc996-4d7f-4276-851f-8d8643642cee admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:32.247676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dc996-4d7f-4276-851f-8d8643642cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:32.247837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dc996-4d7f-4276-851f-8d8643642cee admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:32.248522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7dc996-4d7f-4276-851f-8d8643642cee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:32.250584 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7dc996-4d7f-4276-851f-8d8643642cee admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:32.334480 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 907/1789] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:32 2022] POST /identity/v3/projects => generated 369 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:32.338397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eacfcc-0697-41cc-a6e7-681a5a5c482a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:32.388134 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eacfcc-0697-41cc-a6e7-681a5a5c482a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:32.631529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75461a1e-3995-4393-980d-6aa9ebf6e711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:32.633716 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75461a1e-3995-4393-980d-6aa9ebf6e711 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:32.635769 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75461a1e-3995-4393-980d-6aa9ebf6e711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:32.638602 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75461a1e-3995-4393-980d-6aa9ebf6e711 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:32.640260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75461a1e-3995-4393-980d-6aa9ebf6e711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:32.656230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75461a1e-3995-4393-980d-6aa9ebf6e711 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:32.733683 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 883/1790] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:32 2022] POST /identity/v3/users => generated 285 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:32.738487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dc996-4d7f-4276-851f-8d8643642cee admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:32.789583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dc996-4d7f-4276-851f-8d8643642cee admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:32.823718 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4a2cc-7f01-4b6f-a917-07b40b320411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:32.834164 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4a2cc-7f01-4b6f-a917-07b40b320411 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:32.835148 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4a2cc-7f01-4b6f-a917-07b40b320411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:32.838878 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4a2cc-7f01-4b6f-a917-07b40b320411 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:32.848792 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4a2cc-7f01-4b6f-a917-07b40b320411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:32.860554 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4a2cc-7f01-4b6f-a917-07b40b320411 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:32.909752 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 908/1791] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:32.917418 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75461a1e-3995-4393-980d-6aa9ebf6e711 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:32.951115 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75461a1e-3995-4393-980d-6aa9ebf6e711 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:32.967573 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a0ba9-7b05-4042-8b3a-b9a3ed55f75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:32.968865 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a0ba9-7b05-4042-8b3a-b9a3ed55f75c admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:32.969335 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a0ba9-7b05-4042-8b3a-b9a3ed55f75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:32.969840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a0ba9-7b05-4042-8b3a-b9a3ed55f75c admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:32.971264 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a0ba9-7b05-4042-8b3a-b9a3ed55f75c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:32.974882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a0ba9-7b05-4042-8b3a-b9a3ed55f75c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:33.007125 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 884/1792] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:33.012534 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4a2cc-7f01-4b6f-a917-07b40b320411 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:33.066563 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4a2cc-7f01-4b6f-a917-07b40b320411 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:33.075914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a0ba9-7b05-4042-8b3a-b9a3ed55f75c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:33.095138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf9543-e316-4c95-aac0-0575a3285310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:33.099871 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf9543-e316-4c95-aac0-0575a3285310 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:33.101231 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf9543-e316-4c95-aac0-0575a3285310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:33.104311 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf9543-e316-4c95-aac0-0575a3285310 admin admin] PATH_INFO: `/v3/projects/b16ae157618b4d2385c4cb4bd46a6cd4/users/0261fdd9fc764620816d2f032de9c8aa/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:33.195432 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf9543-e316-4c95-aac0-0575a3285310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b16ae157618b4d2385c4cb4bd46a6cd4, user_id=0261fdd9fc764620816d2f032de9c8aa, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:33.216114 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf9543-e316-4c95-aac0-0575a3285310 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:33.221357 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:33.283884 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 909/1793] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:33 2022] PUT /identity/v3/projects/b16ae157618b4d2385c4cb4bd46a6cd4/users/0261fdd9fc764620816d2f032de9c8aa/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:33.304457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ec690-00ae-425b-af07-4d7205d1cd74 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:33.305098 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ec690-00ae-425b-af07-4d7205d1cd74 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:33.306022 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ec690-00ae-425b-af07-4d7205d1cd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:33.443178 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-046ec690-00ae-425b-af07-4d7205d1cd74 None None] MFA Rules not processed for user `0261fdd9fc764620816d2f032de9c8aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:33.445962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-046ec690-00ae-425b-af07-4d7205d1cd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:33.473292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a0ba9-7b05-4042-8b3a-b9a3ed55f75c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:33.661582 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e2602-bb06-4260-9c13-4602b2292897 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b19f61860b54c18bcc2a0d896c62e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2574729623a49dab46ab9d7a58dcc72', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:33.662232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e2602-bb06-4260-9c13-4602b2292897 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:33.662525 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e2602-bb06-4260-9c13-4602b2292897 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:33.662800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e2602-bb06-4260-9c13-4602b2292897 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:33.663472 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e2602-bb06-4260-9c13-4602b2292897 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:35:33.664463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e2602-bb06-4260-9c13-4602b2292897 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:33.665517 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e2602-bb06-4260-9c13-4602b2292897 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:33.685570 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 885/1794] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 607 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:35:33.690957 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e2602-bb06-4260-9c13-4602b2292897 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:33.738582 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e2602-bb06-4260-9c13-4602b2292897 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:33.750092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8c73f-4454-4e14-8ea7-39718744834c tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b19f61860b54c18bcc2a0d896c62e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2574729623a49dab46ab9d7a58dcc72', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:33.750736 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8c73f-4454-4e14-8ea7-39718744834c tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:33.753247 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8c73f-4454-4e14-8ea7-39718744834c tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:33.753519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8c73f-4454-4e14-8ea7-39718744834c tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:33.758027 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8c73f-4454-4e14-8ea7-39718744834c tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:33.760101 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8c73f-4454-4e14-8ea7-39718744834c tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:33.918213 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 886/1795] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:33 2022] POST /identity/v3/projects => generated 353 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:33.922814 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8c73f-4454-4e14-8ea7-39718744834c tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:34.035266 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 910/1796] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 734 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:34.046703 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ec690-00ae-425b-af07-4d7205d1cd74 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:34.310904 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:34.328466 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8c73f-4454-4e14-8ea7-39718744834c tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:34.352283 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f3fac-2cc7-49f2-893e-fc09c6b990b9 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b19f61860b54c18bcc2a0d896c62e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2574729623a49dab46ab9d7a58dcc72', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:34.353426 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f3fac-2cc7-49f2-893e-fc09c6b990b9 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:34.353939 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f3fac-2cc7-49f2-893e-fc09c6b990b9 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:34.354439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f3fac-2cc7-49f2-893e-fc09c6b990b9 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:34.361747 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ec690-00ae-425b-af07-4d7205d1cd74 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:34.365062 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f3fac-2cc7-49f2-893e-fc09c6b990b9 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:35:34.365939 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f3fac-2cc7-49f2-893e-fc09c6b990b9 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:34.375879 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f3fac-2cc7-49f2-893e-fc09c6b990b9 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:34.448988 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 887/1797] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 520 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:35:34.580217 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f3fac-2cc7-49f2-893e-fc09c6b990b9 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:34.602015 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f3fac-2cc7-49f2-893e-fc09c6b990b9 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:34.613092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a649764-408b-4752-b175-483970504223 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b19f61860b54c18bcc2a0d896c62e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2574729623a49dab46ab9d7a58dcc72', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:34.614676 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a649764-408b-4752-b175-483970504223 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:34.615480 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a649764-408b-4752-b175-483970504223 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:34.616262 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a649764-408b-4752-b175-483970504223 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] PATH_INFO: `/v3/projects/0a7646d0ee2c4805a7a3686bc5274c9b` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:34.618794 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a649764-408b-4752-b175-483970504223 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0a7646d0ee2c4805a7a3686bc5274c9b)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:34.624242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a649764-408b-4752-b175-483970504223 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:34.713781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa3310-6cd1-4f12-88bc-5ed9cf21e0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:34.716232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa3310-6cd1-4f12-88bc-5ed9cf21e0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:34.718448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa3310-6cd1-4f12-88bc-5ed9cf21e0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:34.719027 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa3310-6cd1-4f12-88bc-5ed9cf21e0c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:34.727036 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fa3310-6cd1-4f12-88bc-5ed9cf21e0c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:34.738004 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fa3310-6cd1-4f12-88bc-5ed9cf21e0c1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:34.744120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:34.816288 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5a649764-408b-4752-b175-483970504223 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a7646d0ee2c4805a7a3686bc5274c9b', 'request_id': 'req-5a649764-408b-4752-b175-483970504223'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:34.855603 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5a649764-408b-4752-b175-483970504223 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a7646d0ee2c4805a7a3686bc5274c9b', 'request_id': 'req-5a649764-408b-4752-b175-483970504223'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:34.898070 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 911/1798] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:34 2022] POST /identity/v3/projects => generated 367 bytes in 852 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:34.902388 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa3310-6cd1-4f12-88bc-5ed9cf21e0c1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:34.906697 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5a649764-408b-4752-b175-483970504223 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a7646d0ee2c4805a7a3686bc5274c9b', 'request_id': 'req-5a649764-408b-4752-b175-483970504223'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:34.970691 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5a649764-408b-4752-b175-483970504223 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] The token cache is being invalidate because project 0a7646d0ee2c4805a7a3686bc5274c9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:35:34.975335 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5a649764-408b-4752-b175-483970504223 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:34.977338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5a649764-408b-4752-b175-483970504223 tempest-VolumeQuotaClassesTest-178705150 tempest-VolumeQuotaClassesTest-178705150-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:35.003301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 888/1799] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:35:34 2022] DELETE /identity/v3/projects/0a7646d0ee2c4805a7a3686bc5274c9b => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:35:35.411632 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa3310-6cd1-4f12-88bc-5ed9cf21e0c1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:35.434866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111635fb-9e92-4f78-9b66-9a8d7a3fee1e None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.436674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111635fb-9e92-4f78-9b66-9a8d7a3fee1e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.437508 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111635fb-9e92-4f78-9b66-9a8d7a3fee1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.477212 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf0424-cda1-489b-a98d-6ca4e0cd006a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:35.478626 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf0424-cda1-489b-a98d-6ca4e0cd006a admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.482478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf0424-cda1-489b-a98d-6ca4e0cd006a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.483153 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf0424-cda1-489b-a98d-6ca4e0cd006a admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.487379 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf0424-cda1-489b-a98d-6ca4e0cd006a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:35.496498 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf0424-cda1-489b-a98d-6ca4e0cd006a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:35.535052 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-111635fb-9e92-4f78-9b66-9a8d7a3fee1e None None] MFA Rules not processed for user `3fb9d9c35c224ceabcb12fe5933e09c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:35.545769 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-111635fb-9e92-4f78-9b66-9a8d7a3fee1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:35.609388 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 912/1800] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:34 2022] POST /identity/v3/users => generated 290 bytes in 710 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:35.615098 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf0424-cda1-489b-a98d-6ca4e0cd006a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:35.622417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b5cf0424-cda1-489b-a98d-6ca4e0cd006a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:35.678998 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf0424-cda1-489b-a98d-6ca4e0cd006a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:35.713262 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01645e6-110e-4e90-833a-0817dc0c11f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:35.715050 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01645e6-110e-4e90-833a-0817dc0c11f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.722866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01645e6-110e-4e90-833a-0817dc0c11f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.725068 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01645e6-110e-4e90-833a-0817dc0c11f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.726460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01645e6-110e-4e90-833a-0817dc0c11f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:35.735151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01645e6-110e-4e90-833a-0817dc0c11f0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:35.824673 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 889/1801] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:35.832445 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 913/1802] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:35.846442 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111635fb-9e92-4f78-9b66-9a8d7a3fee1e None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:35.945179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111635fb-9e92-4f78-9b66-9a8d7a3fee1e None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:35.968481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfddd0f-e3fa-4583-b442-c1b111165851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:35.970636 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfddd0f-e3fa-4583-b442-c1b111165851 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.971722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfddd0f-e3fa-4583-b442-c1b111165851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.972604 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfddd0f-e3fa-4583-b442-c1b111165851 admin admin] PATH_INFO: `/v3/projects/ac8e70ab7b30446aaf8316afb5dab145/users/00ea3dd7dc5b4b779448619c1381efe9/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:36.072230 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01645e6-110e-4e90-833a-0817dc0c11f0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:36.076827 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f01645e6-110e-4e90-833a-0817dc0c11f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:36.089266 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfddd0f-e3fa-4583-b442-c1b111165851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac8e70ab7b30446aaf8316afb5dab145, user_id=00ea3dd7dc5b4b779448619c1381efe9, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:36.105963 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfddd0f-e3fa-4583-b442-c1b111165851 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:36.132877 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01645e6-110e-4e90-833a-0817dc0c11f0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:36.143294 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4127e-830a-4480-8980-2d2235431482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:36.145079 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4127e-830a-4480-8980-2d2235431482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:36.146369 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4127e-830a-4480-8980-2d2235431482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:36.147732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4127e-830a-4480-8980-2d2235431482 admin admin] PATH_INFO: `/v3/users/e8595677551e4fae9b63f0db25e1233f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:36.151638 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4127e-830a-4480-8980-2d2235431482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8595677551e4fae9b63f0db25e1233f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:36.176431 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4127e-830a-4480-8980-2d2235431482 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:36.204295 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 890/1803] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:35 2022] PUT /identity/v3/projects/ac8e70ab7b30446aaf8316afb5dab145/users/00ea3dd7dc5b4b779448619c1381efe9/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:36.206828 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfddd0f-e3fa-4583-b442-c1b111165851 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:36.230101 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4cfddd0f-e3fa-4583-b442-c1b111165851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:36.394351 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-07c4127e-830a-4480-8980-2d2235431482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8595677551e4fae9b63f0db25e1233f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:36.407340 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:36.465689 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-07c4127e-830a-4480-8980-2d2235431482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8595677551e4fae9b63f0db25e1233f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:36.468253 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-07c4127e-830a-4480-8980-2d2235431482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8595677551e4fae9b63f0db25e1233f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:36.486109 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-07c4127e-830a-4480-8980-2d2235431482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8595677551e4fae9b63f0db25e1233f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:36.506679 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-07c4127e-830a-4480-8980-2d2235431482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8595677551e4fae9b63f0db25e1233f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:36.523940 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 914/1804] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:35:36 2022] DELETE /identity/v3/users/e8595677551e4fae9b63f0db25e1233f => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:36.527289 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4127e-830a-4480-8980-2d2235431482 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:36.533374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-07c4127e-830a-4480-8980-2d2235431482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:36.652169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfddd0f-e3fa-4583-b442-c1b111165851 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:36.819114 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4127e-830a-4480-8980-2d2235431482 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:36.847916 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b1728-1cb0-465b-b477-073b2826ded7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:36.848752 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b1728-1cb0-465b-b477-073b2826ded7 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:36.849186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b1728-1cb0-465b-b477-073b2826ded7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:36.849659 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b1728-1cb0-465b-b477-073b2826ded7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:36.850820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b1728-1cb0-465b-b477-073b2826ded7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:36.866232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b1728-1cb0-465b-b477-073b2826ded7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:36.923933 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 915/1805] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:36.926274 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdcd0c-7846-41d4-93b6-fb9012c4e09b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:36.927233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:36.936097 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdcd0c-7846-41d4-93b6-fb9012c4e09b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:36.936800 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdcd0c-7846-41d4-93b6-fb9012c4e09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:37.015631 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d0bdcd0c-7846-41d4-93b6-fb9012c4e09b None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:37.017869 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d0bdcd0c-7846-41d4-93b6-fb9012c4e09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:37.025928 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f726266-50ce-4156-8712-2a63f3d12ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:37.030674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f726266-50ce-4156-8712-2a63f3d12ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:37.034539 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f726266-50ce-4156-8712-2a63f3d12ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:37.035340 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f726266-50ce-4156-8712-2a63f3d12ec7 admin admin] PATH_INFO: `/v3/users/1fc9d5197ebf4d788411c16cb8db1e92` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:37.047216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f726266-50ce-4156-8712-2a63f3d12ec7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fc9d5197ebf4d788411c16cb8db1e92)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:37.075846 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f726266-50ce-4156-8712-2a63f3d12ec7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:37.093221 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 916/1806] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:37.094222 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdcd0c-7846-41d4-93b6-fb9012c4e09b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:37.124838 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdcd0c-7846-41d4-93b6-fb9012c4e09b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:37.141774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482f561-e5ab-4cf7-b5d1-08cb0a56a183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:37.143116 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482f561-e5ab-4cf7-b5d1-08cb0a56a183 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:37.143933 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482f561-e5ab-4cf7-b5d1-08cb0a56a183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:37.144728 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482f561-e5ab-4cf7-b5d1-08cb0a56a183 admin admin] PATH_INFO: `/v3/projects/ac8e70ab7b30446aaf8316afb5dab145/users/00ea3dd7dc5b4b779448619c1381efe9/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:37.158658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0482f561-e5ab-4cf7-b5d1-08cb0a56a183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac8e70ab7b30446aaf8316afb5dab145, user_id=00ea3dd7dc5b4b779448619c1381efe9, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:37.170676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0482f561-e5ab-4cf7-b5d1-08cb0a56a183 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:37.236644 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 917/1807] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:37 2022] PUT /identity/v3/projects/ac8e70ab7b30446aaf8316afb5dab145/users/00ea3dd7dc5b4b779448619c1381efe9/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:37.238395 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482f561-e5ab-4cf7-b5d1-08cb0a56a183 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:37.251405 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0482f561-e5ab-4cf7-b5d1-08cb0a56a183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:37.438262 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4f726266-50ce-4156-8712-2a63f3d12ec7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fc9d5197ebf4d788411c16cb8db1e92'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:37.532199 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4f726266-50ce-4156-8712-2a63f3d12ec7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fc9d5197ebf4d788411c16cb8db1e92'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:37.539351 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4f726266-50ce-4156-8712-2a63f3d12ec7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fc9d5197ebf4d788411c16cb8db1e92'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:37.544043 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4f726266-50ce-4156-8712-2a63f3d12ec7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fc9d5197ebf4d788411c16cb8db1e92'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:37.568559 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4f726266-50ce-4156-8712-2a63f3d12ec7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fc9d5197ebf4d788411c16cb8db1e92'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:37.601003 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 891/1808] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:35:36 2022] DELETE /identity/v3/users/1fc9d5197ebf4d788411c16cb8db1e92 => generated 0 bytes in 1387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:37.606684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95eb843-ebab-4674-b802-74b4cd4f4dfe None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:37.607130 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95eb843-ebab-4674-b802-74b4cd4f4dfe None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:37.607548 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95eb843-ebab-4674-b802-74b4cd4f4dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:37.632092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482f561-e5ab-4cf7-b5d1-08cb0a56a183 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:37.663598 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c95eb843-ebab-4674-b802-74b4cd4f4dfe None None] MFA Rules not processed for user `00ea3dd7dc5b4b779448619c1381efe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:37.665013 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c95eb843-ebab-4674-b802-74b4cd4f4dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:37.831186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e0b53-6658-44d8-b8de-caebbaaf67e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:37.832598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e0b53-6658-44d8-b8de-caebbaaf67e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:37.835381 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e0b53-6658-44d8-b8de-caebbaaf67e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:37.837308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e0b53-6658-44d8-b8de-caebbaaf67e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:37.844244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4d4e0b53-6658-44d8-b8de-caebbaaf67e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:37.884794 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:38.021453 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 892/1809] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:38.021453 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931a63d-e4a5-46a0-b8b0-80a47c0e63d9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:38.039458 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931a63d-e4a5-46a0-b8b0-80a47c0e63d9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:38.040019 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931a63d-e4a5-46a0-b8b0-80a47c0e63d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:38.222937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9931a63d-e4a5-46a0-b8b0-80a47c0e63d9 None None] MFA Rules not processed for user `74c07ca9deb64410b29beaead7223ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:38.226859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9931a63d-e4a5-46a0-b8b0-80a47c0e63d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:38.276500 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e0b53-6658-44d8-b8de-caebbaaf67e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:38.279820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e0b53-6658-44d8-b8de-caebbaaf67e4 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:38.312209 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 918/1810] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 1075 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:38.314220 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6aa43a-8970-498a-88a2-08095bddcf08 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:38.315024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6aa43a-8970-498a-88a2-08095bddcf08 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:38.315501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6aa43a-8970-498a-88a2-08095bddcf08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:38.403029 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-bb6aa43a-8970-498a-88a2-08095bddcf08 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:38.404304 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bb6aa43a-8970-498a-88a2-08095bddcf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:38.408898 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:38.432675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 919/1811] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:38.432675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1fca1-2faf-4355-8ba1-86dafcbc1352 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:38.432675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1fca1-2faf-4355-8ba1-86dafcbc1352 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:38.432675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1fca1-2faf-4355-8ba1-86dafcbc1352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:38.509463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 893/1812] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:38.509463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931a63d-e4a5-46a0-b8b0-80a47c0e63d9 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:38.509463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9931a63d-e4a5-46a0-b8b0-80a47c0e63d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:38.544505 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-12c1fca1-2faf-4355-8ba1-86dafcbc1352 None None] MFA Rules not processed for user `3c001a902faf4b3c8d8f23f2e017c706`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:38.545700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-12c1fca1-2faf-4355-8ba1-86dafcbc1352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:38.632608 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931a63d-e4a5-46a0-b8b0-80a47c0e63d9 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:38.647003 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d9ba7-0c45-4753-95bb-1ed9d3bbedab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:38.648379 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d9ba7-0c45-4753-95bb-1ed9d3bbedab service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:38.648688 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d9ba7-0c45-4753-95bb-1ed9d3bbedab service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:38.648965 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d9ba7-0c45-4753-95bb-1ed9d3bbedab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:38.671966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d9ba7-0c45-4753-95bb-1ed9d3bbedab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:38.673549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d9ba7-0c45-4753-95bb-1ed9d3bbedab service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:38.696868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 920/1813] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 1 16:35:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:38.700696 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1fca1-2faf-4355-8ba1-86dafcbc1352 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:38.705243 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-12c1fca1-2faf-4355-8ba1-86dafcbc1352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:38.705943 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 894/1814] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:38.706877 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d9ba7-0c45-4753-95bb-1ed9d3bbedab service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:38.711545 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ac4d9ba7-0c45-4753-95bb-1ed9d3bbedab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:38.735220 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1fca1-2faf-4355-8ba1-86dafcbc1352 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:38.763248 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d9ba7-0c45-4753-95bb-1ed9d3bbedab service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:38.766856 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f7f87-78f4-41f2-ab92-5cafbc443c2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:38.771109 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f7f87-78f4-41f2-ab92-5cafbc443c2a service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:38.773110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f7f87-78f4-41f2-ab92-5cafbc443c2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:38.774451 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f7f87-78f4-41f2-ab92-5cafbc443c2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:38.788470 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f938b3-dd6d-4ac9-9caf-c1b117be13e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:38.793924 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f938b3-dd6d-4ac9-9caf-c1b117be13e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:38.795398 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f938b3-dd6d-4ac9-9caf-c1b117be13e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:38.795781 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f938b3-dd6d-4ac9-9caf-c1b117be13e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:38.796859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f938b3-dd6d-4ac9-9caf-c1b117be13e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:38.807920 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f938b3-dd6d-4ac9-9caf-c1b117be13e6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:38.825944 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f7f87-78f4-41f2-ab92-5cafbc443c2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:38.834022 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f7f87-78f4-41f2-ab92-5cafbc443c2a service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:38.901466 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 921/1815] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:39.030803 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f7f87-78f4-41f2-ab92-5cafbc443c2a service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:39.042035 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 895/1816] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:38 2022] POST /identity/v3/projects => generated 373 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:39.048986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f7f87-78f4-41f2-ab92-5cafbc443c2a service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:39.051670 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f938b3-dd6d-4ac9-9caf-c1b117be13e6 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:39.067236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-38f938b3-dd6d-4ac9-9caf-c1b117be13e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:39.273614 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74407809-fa08-4b9a-ae6e-298bb7e0fe50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:39.274333 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74407809-fa08-4b9a-ae6e-298bb7e0fe50 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:39.274694 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74407809-fa08-4b9a-ae6e-298bb7e0fe50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:39.275529 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74407809-fa08-4b9a-ae6e-298bb7e0fe50 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:39.276915 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74407809-fa08-4b9a-ae6e-298bb7e0fe50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:39.284833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74407809-fa08-4b9a-ae6e-298bb7e0fe50 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:39.329288 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:39.395139 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 922/1817] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:39 2022] POST /identity/v3/users => generated 293 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:39.400150 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74407809-fa08-4b9a-ae6e-298bb7e0fe50 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:39.465394 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74407809-fa08-4b9a-ae6e-298bb7e0fe50 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:39.478791 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec09bd-967b-42a3-8236-a419ea6a7041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:39.479438 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec09bd-967b-42a3-8236-a419ea6a7041 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:39.479723 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec09bd-967b-42a3-8236-a419ea6a7041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:39.479992 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec09bd-967b-42a3-8236-a419ea6a7041 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:39.481265 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec09bd-967b-42a3-8236-a419ea6a7041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:39.485278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec09bd-967b-42a3-8236-a419ea6a7041 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:39.516916 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 923/1818] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:39.524074 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec09bd-967b-42a3-8236-a419ea6a7041 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:39.554493 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec09bd-967b-42a3-8236-a419ea6a7041 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:39.600288 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81109dfd-669c-401e-819d-bf633c633279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:39.605668 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81109dfd-669c-401e-819d-bf633c633279 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:39.606429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81109dfd-669c-401e-819d-bf633c633279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:39.607145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81109dfd-669c-401e-819d-bf633c633279 admin admin] PATH_INFO: `/v3/projects/c83cbb47a1634acf97172ef502524743/users/c1ebbdddfed74f2eb519f5344b2377ac/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:39.613742 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f938b3-dd6d-4ac9-9caf-c1b117be13e6 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:39.628447 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af92c91-047b-433a-9a27-15dac84a0dba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748e35d9a1534920860b2234d45f6724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:39.629146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af92c91-047b-433a-9a27-15dac84a0dba service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:39.629451 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af92c91-047b-433a-9a27-15dac84a0dba service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:39.629728 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af92c91-047b-433a-9a27-15dac84a0dba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:39.687981 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81109dfd-669c-401e-819d-bf633c633279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c83cbb47a1634acf97172ef502524743, user_id=c1ebbdddfed74f2eb519f5344b2377ac, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:39.690874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81109dfd-669c-401e-819d-bf633c633279 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:39.737338 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 924/1819] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:39 2022] PUT /identity/v3/projects/c83cbb47a1634acf97172ef502524743/users/c1ebbdddfed74f2eb519f5344b2377ac/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:39.740172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81109dfd-669c-401e-819d-bf633c633279 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:39.808598 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:39.861080 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af92c91-047b-433a-9a27-15dac84a0dba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:39.864684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af92c91-047b-433a-9a27-15dac84a0dba service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:39.886053 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 896/1820] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 1 16:35:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 843 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:35:39.975041 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81109dfd-669c-401e-819d-bf633c633279 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:39.981356 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c8993-d27b-4ea1-81cc-b0865c9773a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:39.982363 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c8993-d27b-4ea1-81cc-b0865c9773a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:39.982802 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c8993-d27b-4ea1-81cc-b0865c9773a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:39.983387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c8993-d27b-4ea1-81cc-b0865c9773a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:39.984229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c8993-d27b-4ea1-81cc-b0865c9773a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:39.986356 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c8993-d27b-4ea1-81cc-b0865c9773a8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:40.033730 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 925/1821] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:40.035186 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af92c91-047b-433a-9a27-15dac84a0dba service swift] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:40.066714 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af92c91-047b-433a-9a27-15dac84a0dba service swift] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:40.116601 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc50f06-d620-4d3a-a076-2085c3925a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:40.117637 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc50f06-d620-4d3a-a076-2085c3925a89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:40.118133 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc50f06-d620-4d3a-a076-2085c3925a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:40.118551 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc50f06-d620-4d3a-a076-2085c3925a89 admin admin] PATH_INFO: `/v3/projects/c83cbb47a1634acf97172ef502524743/users/c1ebbdddfed74f2eb519f5344b2377ac/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:40.134608 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc50f06-d620-4d3a-a076-2085c3925a89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c83cbb47a1634acf97172ef502524743, user_id=c1ebbdddfed74f2eb519f5344b2377ac, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:40.166698 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc50f06-d620-4d3a-a076-2085c3925a89 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:40.254178 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 897/1822] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:40 2022] PUT /identity/v3/projects/c83cbb47a1634acf97172ef502524743/users/c1ebbdddfed74f2eb519f5344b2377ac/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:40.367993 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c8993-d27b-4ea1-81cc-b0865c9773a8 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:40.376875 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-048c8993-d27b-4ea1-81cc-b0865c9773a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:40.468246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c8993-d27b-4ea1-81cc-b0865c9773a8 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:40.713010 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dea91a-e6f2-4dcd-880d-30de5238709f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:40.714320 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dea91a-e6f2-4dcd-880d-30de5238709f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:40.715108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dea91a-e6f2-4dcd-880d-30de5238709f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:40.715675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dea91a-e6f2-4dcd-880d-30de5238709f admin admin] PATH_INFO: `/v3/projects/553aedb1b57749c89e0193a073957795` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:40.719972 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dea91a-e6f2-4dcd-880d-30de5238709f admin admin] RBAC: Authorizing `identity:delete_project(project_id=553aedb1b57749c89e0193a073957795)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:40.731881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dea91a-e6f2-4dcd-880d-30de5238709f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:41.043246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-13dea91a-e6f2-4dcd-880d-30de5238709f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '553aedb1b57749c89e0193a073957795', 'request_id': 'req-13dea91a-e6f2-4dcd-880d-30de5238709f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:41.089716 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-13dea91a-e6f2-4dcd-880d-30de5238709f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '553aedb1b57749c89e0193a073957795', 'request_id': 'req-13dea91a-e6f2-4dcd-880d-30de5238709f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:41.098854 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:41.117194 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-13dea91a-e6f2-4dcd-880d-30de5238709f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '553aedb1b57749c89e0193a073957795', 'request_id': 'req-13dea91a-e6f2-4dcd-880d-30de5238709f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:41.154613 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-13dea91a-e6f2-4dcd-880d-30de5238709f admin admin] The token cache is being invalidate because project 553aedb1b57749c89e0193a073957795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:35:41.154932 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-13dea91a-e6f2-4dcd-880d-30de5238709f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:41.158664 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-13dea91a-e6f2-4dcd-880d-30de5238709f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:41.185196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 926/1823] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:35:40 2022] DELETE /identity/v3/projects/553aedb1b57749c89e0193a073957795 => generated 0 bytes in 820 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:41.193015 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc50f06-d620-4d3a-a076-2085c3925a89 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:41.197268 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9dc50f06-d620-4d3a-a076-2085c3925a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:41.274108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc50f06-d620-4d3a-a076-2085c3925a89 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:41.518774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8168d5-836e-43a5-9c22-6fc5cb93c804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:41.519814 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8168d5-836e-43a5-9c22-6fc5cb93c804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:41.520289 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8168d5-836e-43a5-9c22-6fc5cb93c804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:41.521166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8168d5-836e-43a5-9c22-6fc5cb93c804 admin admin] PATH_INFO: `/v3/users/6b19f61860b54c18bcc2a0d896c62e38` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:41.525218 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8168d5-836e-43a5-9c22-6fc5cb93c804 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b19f61860b54c18bcc2a0d896c62e38)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:41.533927 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8168d5-836e-43a5-9c22-6fc5cb93c804 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:41.677945 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ce8168d5-836e-43a5-9c22-6fc5cb93c804 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b19f61860b54c18bcc2a0d896c62e38'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:41.732152 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ce8168d5-836e-43a5-9c22-6fc5cb93c804 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b19f61860b54c18bcc2a0d896c62e38'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:41.734195 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ce8168d5-836e-43a5-9c22-6fc5cb93c804 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b19f61860b54c18bcc2a0d896c62e38'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:41.735954 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ce8168d5-836e-43a5-9c22-6fc5cb93c804 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b19f61860b54c18bcc2a0d896c62e38'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:41.761574 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ce8168d5-836e-43a5-9c22-6fc5cb93c804 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b19f61860b54c18bcc2a0d896c62e38'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:41.809788 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 898/1824] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:35:41 2022] DELETE /identity/v3/users/6b19f61860b54c18bcc2a0d896c62e38 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:35:42.039135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dea91a-e6f2-4dcd-880d-30de5238709f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:42.041385 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-13dea91a-e6f2-4dcd-880d-30de5238709f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:42.110845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dea91a-e6f2-4dcd-880d-30de5238709f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:42.356944 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2574ce-825a-4d5a-bc4a-c9d0a4c1fdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:42.357631 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2574ce-825a-4d5a-bc4a-c9d0a4c1fdf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:42.357920 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2574ce-825a-4d5a-bc4a-c9d0a4c1fdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:42.358192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2574ce-825a-4d5a-bc4a-c9d0a4c1fdf0 admin admin] PATH_INFO: `/v3/projects/5c7b6b5cd383421aaab8d7a887162007` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:42.359803 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2574ce-825a-4d5a-bc4a-c9d0a4c1fdf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c7b6b5cd383421aaab8d7a887162007)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:42.362278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2574ce-825a-4d5a-bc4a-c9d0a4c1fdf0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:42.561290 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2b2574ce-825a-4d5a-bc4a-c9d0a4c1fdf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c7b6b5cd383421aaab8d7a887162007', 'request_id': 'req-2b2574ce-825a-4d5a-bc4a-c9d0a4c1fdf0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:42.579467 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2b2574ce-825a-4d5a-bc4a-c9d0a4c1fdf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c7b6b5cd383421aaab8d7a887162007', 'request_id': 'req-2b2574ce-825a-4d5a-bc4a-c9d0a4c1fdf0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:42.598119 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2b2574ce-825a-4d5a-bc4a-c9d0a4c1fdf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c7b6b5cd383421aaab8d7a887162007', 'request_id': 'req-2b2574ce-825a-4d5a-bc4a-c9d0a4c1fdf0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:42.637016 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2b2574ce-825a-4d5a-bc4a-c9d0a4c1fdf0 admin admin] The token cache is being invalidate because project 5c7b6b5cd383421aaab8d7a887162007 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:35:42.637916 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2b2574ce-825a-4d5a-bc4a-c9d0a4c1fdf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:42.639496 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2b2574ce-825a-4d5a-bc4a-c9d0a4c1fdf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:42.643062 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 927/1825] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:35:42 2022] DELETE /identity/v3/projects/5c7b6b5cd383421aaab8d7a887162007 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:42.654584 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8168d5-836e-43a5-9c22-6fc5cb93c804 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:42.660580 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ce8168d5-836e-43a5-9c22-6fc5cb93c804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:42.720436 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8168d5-836e-43a5-9c22-6fc5cb93c804 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:42.968927 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:42.996862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab96ecc-c26c-44f6-aeac-972ecd7f3952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:42.997920 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab96ecc-c26c-44f6-aeac-972ecd7f3952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:42.998346 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab96ecc-c26c-44f6-aeac-972ecd7f3952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:42.998774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab96ecc-c26c-44f6-aeac-972ecd7f3952 admin admin] PATH_INFO: `/v3/users/c1b24caccee5427491e5c96649fc845c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:43.002254 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab96ecc-c26c-44f6-aeac-972ecd7f3952 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1b24caccee5427491e5c96649fc845c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:43.008692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab96ecc-c26c-44f6-aeac-972ecd7f3952 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:43.141320 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-1ab96ecc-c26c-44f6-aeac-972ecd7f3952 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1b24caccee5427491e5c96649fc845c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:43.198251 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-1ab96ecc-c26c-44f6-aeac-972ecd7f3952 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1b24caccee5427491e5c96649fc845c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:43.199417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-1ab96ecc-c26c-44f6-aeac-972ecd7f3952 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1b24caccee5427491e5c96649fc845c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:43.200865 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-1ab96ecc-c26c-44f6-aeac-972ecd7f3952 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1b24caccee5427491e5c96649fc845c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:43.222719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-1ab96ecc-c26c-44f6-aeac-972ecd7f3952 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1b24caccee5427491e5c96649fc845c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:43.279789 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 899/1826] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:35:42 2022] DELETE /identity/v3/users/c1b24caccee5427491e5c96649fc845c => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:43.542823 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d408b2-1bb8-4300-bc47-8425cd8450cd None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:43.544585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d408b2-1bb8-4300-bc47-8425cd8450cd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:43.545164 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d408b2-1bb8-4300-bc47-8425cd8450cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:43.632943 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b5d408b2-1bb8-4300-bc47-8425cd8450cd None None] MFA Rules not processed for user `0668b918bf2c49c2901838cd22770030`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:43.669101 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b5d408b2-1bb8-4300-bc47-8425cd8450cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:44.023848 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 928/1827] 10.222.0.75 () {58 vars in 1015 bytes} [Thu Sep 1 16:35:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:35:44.233662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab96ecc-c26c-44f6-aeac-972ecd7f3952 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:44.237987 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1ab96ecc-c26c-44f6-aeac-972ecd7f3952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:44.305112 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab96ecc-c26c-44f6-aeac-972ecd7f3952 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:44.326682 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405324d-0e1c-4d5c-8020-990f09b3d7f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:44.327752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405324d-0e1c-4d5c-8020-990f09b3d7f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:44.328234 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405324d-0e1c-4d5c-8020-990f09b3d7f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:44.328722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405324d-0e1c-4d5c-8020-990f09b3d7f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:44.358853 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405324d-0e1c-4d5c-8020-990f09b3d7f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:44.368666 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405324d-0e1c-4d5c-8020-990f09b3d7f2 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:44.417926 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 900/1828] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:44.428358 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d408b2-1bb8-4300-bc47-8425cd8450cd None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:44.446285 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d408b2-1bb8-4300-bc47-8425cd8450cd None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:44.472952 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b163d-438a-472b-9f1e-2d60f1cc608f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:44.473656 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b163d-438a-472b-9f1e-2d60f1cc608f service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:44.475373 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b163d-438a-472b-9f1e-2d60f1cc608f service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:44.475717 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b163d-438a-472b-9f1e-2d60f1cc608f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:44.513831 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b163d-438a-472b-9f1e-2d60f1cc608f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:44.517952 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b163d-438a-472b-9f1e-2d60f1cc608f service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:44.524318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405324d-0e1c-4d5c-8020-990f09b3d7f2 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:44.526344 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a405324d-0e1c-4d5c-8020-990f09b3d7f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:44.564775 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 929/1829] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:35:44.782199 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405324d-0e1c-4d5c-8020-990f09b3d7f2 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:44.806492 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbfe717-f22c-4398-b7a9-a47643d5a609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:44.807301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbfe717-f22c-4398-b7a9-a47643d5a609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:44.807528 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbfe717-f22c-4398-b7a9-a47643d5a609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:44.807913 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbfe717-f22c-4398-b7a9-a47643d5a609 admin admin] PATH_INFO: `/v3/users/0261fdd9fc764620816d2f032de9c8aa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:44.809862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbfe717-f22c-4398-b7a9-a47643d5a609 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0261fdd9fc764620816d2f032de9c8aa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:44.812355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbfe717-f22c-4398-b7a9-a47643d5a609 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:45.020795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7bbfe717-f22c-4398-b7a9-a47643d5a609 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0261fdd9fc764620816d2f032de9c8aa'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:45.047737 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:45.079940 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7bbfe717-f22c-4398-b7a9-a47643d5a609 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0261fdd9fc764620816d2f032de9c8aa'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:45.087227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7bbfe717-f22c-4398-b7a9-a47643d5a609 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0261fdd9fc764620816d2f032de9c8aa'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:45.088800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7bbfe717-f22c-4398-b7a9-a47643d5a609 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0261fdd9fc764620816d2f032de9c8aa'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:45.124104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7bbfe717-f22c-4398-b7a9-a47643d5a609 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0261fdd9fc764620816d2f032de9c8aa'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:45.159685 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 901/1830] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:35:44 2022] DELETE /identity/v3/users/0261fdd9fc764620816d2f032de9c8aa => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:35:45.163695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2c0b8-8c95-4fc6-9ea3-e39dcac7d62b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:45.164007 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2c0b8-8c95-4fc6-9ea3-e39dcac7d62b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:45.164302 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2c0b8-8c95-4fc6-9ea3-e39dcac7d62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:45.303699 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-69c2c0b8-8c95-4fc6-9ea3-e39dcac7d62b None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:45.306666 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-69c2c0b8-8c95-4fc6-9ea3-e39dcac7d62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:45.346039 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:45.581580 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 930/1831] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:35:45.701526 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbfe717-f22c-4398-b7a9-a47643d5a609 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:45.704033 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7bbfe717-f22c-4398-b7a9-a47643d5a609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:45.905474 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbfe717-f22c-4398-b7a9-a47643d5a609 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:45.926980 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4466cf-eae5-46d4-8750-d423a5f34614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:45.927618 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4466cf-eae5-46d4-8750-d423a5f34614 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:45.927896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4466cf-eae5-46d4-8750-d423a5f34614 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:45.941279 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4466cf-eae5-46d4-8750-d423a5f34614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:46.014650 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4466cf-eae5-46d4-8750-d423a5f34614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:46.023542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4466cf-eae5-46d4-8750-d423a5f34614 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:46.112908 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 902/1832] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:46.374973 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2c0b8-8c95-4fc6-9ea3-e39dcac7d62b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:46.378616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-69c2c0b8-8c95-4fc6-9ea3-e39dcac7d62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:46.409842 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2c0b8-8c95-4fc6-9ea3-e39dcac7d62b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:46.420126 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cef3e0-a445-4a64-8c6a-4d76790af666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:46.420845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cef3e0-a445-4a64-8c6a-4d76790af666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:46.421127 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cef3e0-a445-4a64-8c6a-4d76790af666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:46.421403 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cef3e0-a445-4a64-8c6a-4d76790af666 admin admin] PATH_INFO: `/v3/projects/c2574729623a49dab46ab9d7a58dcc72` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:46.427151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cef3e0-a445-4a64-8c6a-4d76790af666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2574729623a49dab46ab9d7a58dcc72)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:46.429988 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cef3e0-a445-4a64-8c6a-4d76790af666 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:46.534272 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-74cef3e0-a445-4a64-8c6a-4d76790af666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2574729623a49dab46ab9d7a58dcc72', 'request_id': 'req-74cef3e0-a445-4a64-8c6a-4d76790af666'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:46.560768 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-74cef3e0-a445-4a64-8c6a-4d76790af666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2574729623a49dab46ab9d7a58dcc72', 'request_id': 'req-74cef3e0-a445-4a64-8c6a-4d76790af666'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:46.571747 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-74cef3e0-a445-4a64-8c6a-4d76790af666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2574729623a49dab46ab9d7a58dcc72', 'request_id': 'req-74cef3e0-a445-4a64-8c6a-4d76790af666'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:46.587970 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-74cef3e0-a445-4a64-8c6a-4d76790af666 admin admin] The token cache is being invalidate because project c2574729623a49dab46ab9d7a58dcc72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:35:46.588586 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-74cef3e0-a445-4a64-8c6a-4d76790af666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:46.589076 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-74cef3e0-a445-4a64-8c6a-4d76790af666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:46.591945 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 931/1833] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:35:46 2022] DELETE /identity/v3/projects/c2574729623a49dab46ab9d7a58dcc72 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:46.598414 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632ddb5-ccc2-4ce5-aedc-353844f1eaa5 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:46.598846 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632ddb5-ccc2-4ce5-aedc-353844f1eaa5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:46.604742 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632ddb5-ccc2-4ce5-aedc-353844f1eaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:46.782693 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f632ddb5-ccc2-4ce5-aedc-353844f1eaa5 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:46.790198 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f632ddb5-ccc2-4ce5-aedc-353844f1eaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:47.038644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 903/1834] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:47.047776 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b46cd6-516c-45d2-a2af-9cf34d421d0f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:47.048111 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b46cd6-516c-45d2-a2af-9cf34d421d0f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:47.048668 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b46cd6-516c-45d2-a2af-9cf34d421d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:47.118593 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-78b46cd6-516c-45d2-a2af-9cf34d421d0f None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:47.122514 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632ddb5-ccc2-4ce5-aedc-353844f1eaa5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:47.128459 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f632ddb5-ccc2-4ce5-aedc-353844f1eaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:47.131399 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-78b46cd6-516c-45d2-a2af-9cf34d421d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:47.167180 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632ddb5-ccc2-4ce5-aedc-353844f1eaa5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:47.170951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 932/1835] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:47.172200 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b46cd6-516c-45d2-a2af-9cf34d421d0f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:47.174267 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4380c-f29f-49f7-a9bb-75644831eb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:47.175298 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4380c-f29f-49f7-a9bb-75644831eb65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:47.175959 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4380c-f29f-49f7-a9bb-75644831eb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:47.177612 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4380c-f29f-49f7-a9bb-75644831eb65 admin admin] PATH_INFO: `/v3/projects/b16ae157618b4d2385c4cb4bd46a6cd4` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:47.185198 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4380c-f29f-49f7-a9bb-75644831eb65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b16ae157618b4d2385c4cb4bd46a6cd4)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:47.189979 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4380c-f29f-49f7-a9bb-75644831eb65 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:47.217328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b46cd6-516c-45d2-a2af-9cf34d421d0f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:47.247755 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73121ee4-c765-45ec-8ac0-26eb6787d808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:47.251458 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73121ee4-c765-45ec-8ac0-26eb6787d808 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:47.251974 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73121ee4-c765-45ec-8ac0-26eb6787d808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:47.252471 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73121ee4-c765-45ec-8ac0-26eb6787d808 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:47.253812 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73121ee4-c765-45ec-8ac0-26eb6787d808 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:35:47.261352 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73121ee4-c765-45ec-8ac0-26eb6787d808 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:47.277493 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73121ee4-c765-45ec-8ac0-26eb6787d808 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:47.309627 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 933/1836] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:35:47.338255 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73121ee4-c765-45ec-8ac0-26eb6787d808 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:47.370837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73121ee4-c765-45ec-8ac0-26eb6787d808 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:47.434200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-70f4380c-f29f-49f7-a9bb-75644831eb65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b16ae157618b4d2385c4cb4bd46a6cd4', 'request_id': 'req-70f4380c-f29f-49f7-a9bb-75644831eb65'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:47.465193 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-70f4380c-f29f-49f7-a9bb-75644831eb65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b16ae157618b4d2385c4cb4bd46a6cd4', 'request_id': 'req-70f4380c-f29f-49f7-a9bb-75644831eb65'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:47.485350 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-70f4380c-f29f-49f7-a9bb-75644831eb65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b16ae157618b4d2385c4cb4bd46a6cd4', 'request_id': 'req-70f4380c-f29f-49f7-a9bb-75644831eb65'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:47.515763 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:47.526906 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-70f4380c-f29f-49f7-a9bb-75644831eb65 admin admin] The token cache is being invalidate because project b16ae157618b4d2385c4cb4bd46a6cd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:35:47.527616 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-70f4380c-f29f-49f7-a9bb-75644831eb65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:47.530090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-70f4380c-f29f-49f7-a9bb-75644831eb65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:47.533339 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 904/1837] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:35:47 2022] DELETE /identity/v3/projects/b16ae157618b4d2385c4cb4bd46a6cd4 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:47.541259 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4380c-f29f-49f7-a9bb-75644831eb65 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:47.544362 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-70f4380c-f29f-49f7-a9bb-75644831eb65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:47.554910 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb3976-514d-4ca2-a79a-53ccb4b89ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:47.555668 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb3976-514d-4ca2-a79a-53ccb4b89ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:47.555895 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb3976-514d-4ca2-a79a-53ccb4b89ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:47.556290 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb3976-514d-4ca2-a79a-53ccb4b89ac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:47.556842 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb3976-514d-4ca2-a79a-53ccb4b89ac3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:47.559167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb3976-514d-4ca2-a79a-53ccb4b89ac3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:47.611383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4380c-f29f-49f7-a9bb-75644831eb65 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:47.645000 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde64e96-e2e0-4609-a540-bc4ee744f89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:47.645764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde64e96-e2e0-4609-a540-bc4ee744f89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:47.646056 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde64e96-e2e0-4609-a540-bc4ee744f89c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:47.646343 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde64e96-e2e0-4609-a540-bc4ee744f89c admin admin] PATH_INFO: `/v3/projects/59da6220e6c04218b3783cf2df16a8fe` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:47.653690 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde64e96-e2e0-4609-a540-bc4ee744f89c admin admin] RBAC: Authorizing `identity:delete_project(project_id=59da6220e6c04218b3783cf2df16a8fe)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:47.660354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde64e96-e2e0-4609-a540-bc4ee744f89c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:47.692372 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:47.735773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 934/1838] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:47 2022] POST /identity/v3/projects => generated 387 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:47.748108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb3976-514d-4ca2-a79a-53ccb4b89ac3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:47.757788 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-91eb3976-514d-4ca2-a79a-53ccb4b89ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:47.888751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb3976-514d-4ca2-a79a-53ccb4b89ac3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:47.899538 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fde64e96-e2e0-4609-a540-bc4ee744f89c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59da6220e6c04218b3783cf2df16a8fe', 'request_id': 'req-fde64e96-e2e0-4609-a540-bc4ee744f89c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:47.926160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fde64e96-e2e0-4609-a540-bc4ee744f89c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59da6220e6c04218b3783cf2df16a8fe', 'request_id': 'req-fde64e96-e2e0-4609-a540-bc4ee744f89c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:47.944555 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fde64e96-e2e0-4609-a540-bc4ee744f89c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59da6220e6c04218b3783cf2df16a8fe', 'request_id': 'req-fde64e96-e2e0-4609-a540-bc4ee744f89c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:47.978631 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fde64e96-e2e0-4609-a540-bc4ee744f89c admin admin] The token cache is being invalidate because project 59da6220e6c04218b3783cf2df16a8fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:35:47.979161 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fde64e96-e2e0-4609-a540-bc4ee744f89c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:47.980721 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fde64e96-e2e0-4609-a540-bc4ee744f89c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:47.983823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 905/1839] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:35:47 2022] DELETE /identity/v3/projects/59da6220e6c04218b3783cf2df16a8fe => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:47.986256 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde64e96-e2e0-4609-a540-bc4ee744f89c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:47.994902 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0a68b-c054-4981-a621-e23b8dda80a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:47.995838 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0a68b-c054-4981-a621-e23b8dda80a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:47.996284 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fde64e96-e2e0-4609-a540-bc4ee744f89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:47.997389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0a68b-c054-4981-a621-e23b8dda80a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:47.998587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0a68b-c054-4981-a621-e23b8dda80a9 admin admin] PATH_INFO: `/v3/users/00ea3dd7dc5b4b779448619c1381efe9` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:48.000876 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0a68b-c054-4981-a621-e23b8dda80a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00ea3dd7dc5b4b779448619c1381efe9)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:48.006922 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0a68b-c054-4981-a621-e23b8dda80a9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:48.034826 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde64e96-e2e0-4609-a540-bc4ee744f89c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:48.047583 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8f30e-61ff-4452-9f5a-97b5608ed8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:48.053461 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8f30e-61ff-4452-9f5a-97b5608ed8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:48.053461 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8f30e-61ff-4452-9f5a-97b5608ed8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:48.053461 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8f30e-61ff-4452-9f5a-97b5608ed8a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:48.053461 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b8f30e-61ff-4452-9f5a-97b5608ed8a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:48.057377 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b8f30e-61ff-4452-9f5a-97b5608ed8a7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:48.160035 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-29c0a68b-c054-4981-a621-e23b8dda80a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00ea3dd7dc5b4b779448619c1381efe9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:48.194237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 906/1840] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:47 2022] POST /identity/v3/users => generated 294 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:48.200121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670389a-211a-4980-bb38-280be81e350f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:48.200121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670389a-211a-4980-bb38-280be81e350f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:48.200121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670389a-211a-4980-bb38-280be81e350f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:48.229508 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-29c0a68b-c054-4981-a621-e23b8dda80a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00ea3dd7dc5b4b779448619c1381efe9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:48.232781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-29c0a68b-c054-4981-a621-e23b8dda80a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00ea3dd7dc5b4b779448619c1381efe9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:48.254440 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8670389a-211a-4980-bb38-280be81e350f None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:48.256887 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-29c0a68b-c054-4981-a621-e23b8dda80a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00ea3dd7dc5b4b779448619c1381efe9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:48.257171 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8670389a-211a-4980-bb38-280be81e350f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:48.281770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-29c0a68b-c054-4981-a621-e23b8dda80a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00ea3dd7dc5b4b779448619c1381efe9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:48.304690 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 935/1841] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:35:47 2022] DELETE /identity/v3/users/00ea3dd7dc5b4b779448619c1381efe9 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:48.309012 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0a68b-c054-4981-a621-e23b8dda80a9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:48.317248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-29c0a68b-c054-4981-a621-e23b8dda80a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:48.334475 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 907/1842] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:48.344442 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880a996-d36f-408d-a9d0-c047b6928275 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:48.345979 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880a996-d36f-408d-a9d0-c047b6928275 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:48.346532 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880a996-d36f-408d-a9d0-c047b6928275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:48.450308 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1880a996-d36f-408d-a9d0-c047b6928275 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:48.454054 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:48.466263 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1880a996-d36f-408d-a9d0-c047b6928275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:48.690844 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0a68b-c054-4981-a621-e23b8dda80a9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:48.712173 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0993d9b-c36d-4e2d-a202-48cb0ba0bd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:48.716669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0993d9b-c36d-4e2d-a202-48cb0ba0bd26 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:48.717800 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0993d9b-c36d-4e2d-a202-48cb0ba0bd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:48.721730 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0993d9b-c36d-4e2d-a202-48cb0ba0bd26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:48.723989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0993d9b-c36d-4e2d-a202-48cb0ba0bd26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:48.735812 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0993d9b-c36d-4e2d-a202-48cb0ba0bd26 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:48.803453 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 936/1843] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 498 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:48.811381 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0993d9b-c36d-4e2d-a202-48cb0ba0bd26 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:48.812035 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 908/1844] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:48.814799 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880a996-d36f-408d-a9d0-c047b6928275 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:48.857633 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880a996-d36f-408d-a9d0-c047b6928275 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:48.859890 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0993d9b-c36d-4e2d-a202-48cb0ba0bd26 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:48.897000 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962cb50-0884-4180-b3f2-3fbe501853d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:48.901060 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962cb50-0884-4180-b3f2-3fbe501853d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:48.901438 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dc2f6-c435-4460-8ca0-bce9497e1f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:48.902442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962cb50-0884-4180-b3f2-3fbe501853d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:48.902932 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dc2f6-c435-4460-8ca0-bce9497e1f6d admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:48.902932 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dc2f6-c435-4460-8ca0-bce9497e1f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:48.905807 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dc2f6-c435-4460-8ca0-bce9497e1f6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:48.906702 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00dc2f6-c435-4460-8ca0-bce9497e1f6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:35:48.907015 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00dc2f6-c435-4460-8ca0-bce9497e1f6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:48.907390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962cb50-0884-4180-b3f2-3fbe501853d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:48.911809 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962cb50-0884-4180-b3f2-3fbe501853d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:48.914115 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00dc2f6-c435-4460-8ca0-bce9497e1f6d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:48.919412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962cb50-0884-4180-b3f2-3fbe501853d0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:48.963748 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 937/1845] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:48.970139 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962cb50-0884-4180-b3f2-3fbe501853d0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:48.977387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 909/1846] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:35:48.982188 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dc2f6-c435-4460-8ca0-bce9497e1f6d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:48.990272 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962cb50-0884-4180-b3f2-3fbe501853d0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:49.012085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dc2f6-c435-4460-8ca0-bce9497e1f6d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:49.033910 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205a624-0ddb-4de6-a276-f12462c4e53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:49.035251 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205a624-0ddb-4de6-a276-f12462c4e53e admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:49.036786 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff20dca-783c-4798-82f8-cc2e14014229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:49.037724 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff20dca-783c-4798-82f8-cc2e14014229 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:49.037959 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205a624-0ddb-4de6-a276-f12462c4e53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:49.038445 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205a624-0ddb-4de6-a276-f12462c4e53e admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:49.040512 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff20dca-783c-4798-82f8-cc2e14014229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:49.040979 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff20dca-783c-4798-82f8-cc2e14014229 admin admin] PATH_INFO: `/v3/projects/4ccc34afc640426796281f07d7b5eedf/users/0b3c5f520cb743d283e08746db4aff8c/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:49.041697 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205a624-0ddb-4de6-a276-f12462c4e53e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:49.049740 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205a624-0ddb-4de6-a276-f12462c4e53e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:49.102775 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff20dca-783c-4798-82f8-cc2e14014229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ccc34afc640426796281f07d7b5eedf, user_id=0b3c5f520cb743d283e08746db4aff8c, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:49.120746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff20dca-783c-4798-82f8-cc2e14014229 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:49.188859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 910/1847] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:48 2022] POST /identity/v3/projects => generated 379 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:49.190105 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205a624-0ddb-4de6-a276-f12462c4e53e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:49.234343 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 938/1848] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:48 2022] PUT /identity/v3/projects/4ccc34afc640426796281f07d7b5eedf/users/0b3c5f520cb743d283e08746db4aff8c/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:49.237506 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf156185-eed6-4d6a-85c9-52b46d06ca1b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:49.251340 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf156185-eed6-4d6a-85c9-52b46d06ca1b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:49.253236 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf156185-eed6-4d6a-85c9-52b46d06ca1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:49.271557 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:49.408213 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205a624-0ddb-4de6-a276-f12462c4e53e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:49.441890 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-cf156185-eed6-4d6a-85c9-52b46d06ca1b None None] MFA Rules not processed for user `0b3c5f520cb743d283e08746db4aff8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:49.447673 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cf156185-eed6-4d6a-85c9-52b46d06ca1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:49.698240 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 939/1849] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:49.710788 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254e348-5a36-4bef-82d2-d29a40ef1ab0 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:49.711123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254e348-5a36-4bef-82d2-d29a40ef1ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:49.713051 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254e348-5a36-4bef-82d2-d29a40ef1ab0 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:49.718812 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 940/1850] 10.222.0.52 () {54 vars in 921 bytes} [Thu Sep 1 16:35:49 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:35:49.722105 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709ab0a-30a8-41d9-b49c-c8a22a744d37 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:49.723407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709ab0a-30a8-41d9-b49c-c8a22a744d37 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:49.723724 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709ab0a-30a8-41d9-b49c-c8a22a744d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:49.748322 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181a55f-ff84-41cc-880c-4e03fcbcc912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:49.749454 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181a55f-ff84-41cc-880c-4e03fcbcc912 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:49.749964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181a55f-ff84-41cc-880c-4e03fcbcc912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:49.750483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181a55f-ff84-41cc-880c-4e03fcbcc912 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:49.751547 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181a55f-ff84-41cc-880c-4e03fcbcc912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:49.754470 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181a55f-ff84-41cc-880c-4e03fcbcc912 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:49.844348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 911/1851] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:49 2022] POST /identity/v3/users => generated 290 bytes in 655 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:49.845825 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181a55f-ff84-41cc-880c-4e03fcbcc912 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:49.867088 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2709ab0a-30a8-41d9-b49c-c8a22a744d37 None None] MFA Rules not processed for user `c1ebbdddfed74f2eb519f5344b2377ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:49.867556 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181a55f-ff84-41cc-880c-4e03fcbcc912 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:49.870207 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2709ab0a-30a8-41d9-b49c-c8a22a744d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:49.892000 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119aada-8998-42b6-ac04-161fd7dd6c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:49.893100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119aada-8998-42b6-ac04-161fd7dd6c36 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:49.893579 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119aada-8998-42b6-ac04-161fd7dd6c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:49.894022 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119aada-8998-42b6-ac04-161fd7dd6c36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:49.894845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119aada-8998-42b6-ac04-161fd7dd6c36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:49.897043 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119aada-8998-42b6-ac04-161fd7dd6c36 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:49.993822 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 912/1852] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:49 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:49.994840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119aada-8998-42b6-ac04-161fd7dd6c36 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:50.089462 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:50.111209 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 941/1853] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:50.116443 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e20af7-3ad5-454a-95b5-227d387b991a None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:50.116875 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e20af7-3ad5-454a-95b5-227d387b991a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:50.117225 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e20af7-3ad5-454a-95b5-227d387b991a None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:50.123667 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 942/1854] 10.222.0.52 () {54 vars in 921 bytes} [Thu Sep 1 16:35:50 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:35:50.128331 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e20af7-3ad5-454a-95b5-227d387b991a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:50.298090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119aada-8998-42b6-ac04-161fd7dd6c36 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:50.310062 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042b675-9f4f-4aaf-a721-b63ecec64cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:50.311816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042b675-9f4f-4aaf-a721-b63ecec64cba admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:50.312334 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042b675-9f4f-4aaf-a721-b63ecec64cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:50.312895 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042b675-9f4f-4aaf-a721-b63ecec64cba admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:50.314152 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042b675-9f4f-4aaf-a721-b63ecec64cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:50.319380 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042b675-9f4f-4aaf-a721-b63ecec64cba admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:50.384714 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 913/1855] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:50.388173 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e20af7-3ad5-454a-95b5-227d387b991a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:50.388421 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d8c93-2d21-4c28-be94-cce01bea0dc4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:50.388936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d8c93-2d21-4c28-be94-cce01bea0dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:50.389335 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d8c93-2d21-4c28-be94-cce01bea0dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:50.411910 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1780c8-a3a2-427d-91d4-86c58241cfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:50.412799 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1780c8-a3a2-427d-91d4-86c58241cfcc admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:50.413263 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1780c8-a3a2-427d-91d4-86c58241cfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:50.413685 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1780c8-a3a2-427d-91d4-86c58241cfcc admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:50.414528 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1780c8-a3a2-427d-91d4-86c58241cfcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:50.417214 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1780c8-a3a2-427d-91d4-86c58241cfcc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:50.464197 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-368d8c93-2d21-4c28-be94-cce01bea0dc4 None None] MFA Rules not processed for user `74c07ca9deb64410b29beaead7223ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:50.467533 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-368d8c93-2d21-4c28-be94-cce01bea0dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:50.498775 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 943/1856] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:50 2022] POST /identity/v3/users => generated 293 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:50.500236 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015450eb-a613-4ae3-9607-af99865b57ed None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:50.501541 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015450eb-a613-4ae3-9607-af99865b57ed None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:50.501858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015450eb-a613-4ae3-9607-af99865b57ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:50.561218 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-015450eb-a613-4ae3-9607-af99865b57ed None None] MFA Rules not processed for user `55f389ab3ea046008b44f129113de995`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:50.563044 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-015450eb-a613-4ae3-9607-af99865b57ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:50.619496 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:50.723122 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 914/1857] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:50.724814 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9af4a8-01d2-468f-a4cc-2e0738cbcd1c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:50.724814 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9af4a8-01d2-468f-a4cc-2e0738cbcd1c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:50.724814 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9af4a8-01d2-468f-a4cc-2e0738cbcd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:50.763759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 944/1858] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Sep 1 16:35:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:50.764998 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015450eb-a613-4ae3-9607-af99865b57ed None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:50.786054 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-cd9af4a8-01d2-468f-a4cc-2e0738cbcd1c None None] MFA Rules not processed for user `55f389ab3ea046008b44f129113de995`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:50.792687 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015450eb-a613-4ae3-9607-af99865b57ed None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:50.806874 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cd9af4a8-01d2-468f-a4cc-2e0738cbcd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:50.808245 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53084ec-a458-4aba-a1ec-8ebc4842c1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:50.808941 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53084ec-a458-4aba-a1ec-8ebc4842c1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:50.809247 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53084ec-a458-4aba-a1ec-8ebc4842c1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:50.809522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53084ec-a458-4aba-a1ec-8ebc4842c1f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:50.810344 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53084ec-a458-4aba-a1ec-8ebc4842c1f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:50.812710 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53084ec-a458-4aba-a1ec-8ebc4842c1f3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:50.834241 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 915/1859] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Sep 1 16:35:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:50.835555 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9af4a8-01d2-468f-a4cc-2e0738cbcd1c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:50.845407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 945/1860] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:50.847447 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53084ec-a458-4aba-a1ec-8ebc4842c1f3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:50.866008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53084ec-a458-4aba-a1ec-8ebc4842c1f3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:50.876342 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7de498-f8e2-40f3-9698-b66cbf9ff849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:50.877991 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7de498-f8e2-40f3-9698-b66cbf9ff849 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:50.878288 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7de498-f8e2-40f3-9698-b66cbf9ff849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:50.878564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7de498-f8e2-40f3-9698-b66cbf9ff849 admin admin] PATH_INFO: `/v3/projects/6972c4056b164f6bac49b4091eb927be/users/aa6cc259c13a49edaf30659c47c45e0f/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:50.890186 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9af4a8-01d2-468f-a4cc-2e0738cbcd1c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:50.917551 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22927855-cd77-4e7a-9f05-2dc25415cef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:50.918480 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22927855-cd77-4e7a-9f05-2dc25415cef4 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:50.919640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22927855-cd77-4e7a-9f05-2dc25415cef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:50.920046 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22927855-cd77-4e7a-9f05-2dc25415cef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:50.920874 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22927855-cd77-4e7a-9f05-2dc25415cef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:50.922677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22927855-cd77-4e7a-9f05-2dc25415cef4 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:50.930166 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7de498-f8e2-40f3-9698-b66cbf9ff849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6972c4056b164f6bac49b4091eb927be, user_id=aa6cc259c13a49edaf30659c47c45e0f, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:50.933130 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7de498-f8e2-40f3-9698-b66cbf9ff849 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:50.941138 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 916/1861] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:50.953009 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22927855-cd77-4e7a-9f05-2dc25415cef4 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:50.976777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 946/1862] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:50 2022] PUT /identity/v3/projects/6972c4056b164f6bac49b4091eb927be/users/aa6cc259c13a49edaf30659c47c45e0f/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:50.978560 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b95635-0b43-4ca5-934c-59b2d48c6aee None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:50.979485 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22927855-cd77-4e7a-9f05-2dc25415cef4 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:50.979865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b95635-0b43-4ca5-934c-59b2d48c6aee None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:50.980272 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b95635-0b43-4ca5-934c-59b2d48c6aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:51.072363 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b2b95635-0b43-4ca5-934c-59b2d48c6aee None None] MFA Rules not processed for user `aa6cc259c13a49edaf30659c47c45e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:51.075967 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b2b95635-0b43-4ca5-934c-59b2d48c6aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:51.171097 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce10921-f03b-4f7d-98bc-66d42777b5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:51.172849 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce10921-f03b-4f7d-98bc-66d42777b5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:51.173329 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce10921-f03b-4f7d-98bc-66d42777b5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:51.173801 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce10921-f03b-4f7d-98bc-66d42777b5f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:51.174879 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce10921-f03b-4f7d-98bc-66d42777b5f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:51.176929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce10921-f03b-4f7d-98bc-66d42777b5f4 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:51.182429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:51.198367 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 917/1863] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:51.200804 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce10921-f03b-4f7d-98bc-66d42777b5f4 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:51.203548 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2ce10921-f03b-4f7d-98bc-66d42777b5f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:51.222382 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce10921-f03b-4f7d-98bc-66d42777b5f4 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:51.231273 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65118d82-f04c-4459-a291-9369a98c9a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:51.233893 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65118d82-f04c-4459-a291-9369a98c9a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:51.234296 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65118d82-f04c-4459-a291-9369a98c9a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:51.234676 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65118d82-f04c-4459-a291-9369a98c9a62 admin admin] PATH_INFO: `/v3/projects/ac8e70ab7b30446aaf8316afb5dab145` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:51.236511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65118d82-f04c-4459-a291-9369a98c9a62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac8e70ab7b30446aaf8316afb5dab145)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:51.239671 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65118d82-f04c-4459-a291-9369a98c9a62 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:51.284658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 947/1864] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:51.284658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b95635-0b43-4ca5-934c-59b2d48c6aee None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:51.321671 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b95635-0b43-4ca5-934c-59b2d48c6aee None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:51.324136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-65118d82-f04c-4459-a291-9369a98c9a62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac8e70ab7b30446aaf8316afb5dab145', 'request_id': 'req-65118d82-f04c-4459-a291-9369a98c9a62'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:51.333230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-65118d82-f04c-4459-a291-9369a98c9a62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac8e70ab7b30446aaf8316afb5dab145', 'request_id': 'req-65118d82-f04c-4459-a291-9369a98c9a62'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:51.341147 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-65118d82-f04c-4459-a291-9369a98c9a62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac8e70ab7b30446aaf8316afb5dab145', 'request_id': 'req-65118d82-f04c-4459-a291-9369a98c9a62'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:51.392498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-65118d82-f04c-4459-a291-9369a98c9a62 admin admin] The token cache is being invalidate because project ac8e70ab7b30446aaf8316afb5dab145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:35:51.392815 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-65118d82-f04c-4459-a291-9369a98c9a62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:51.396538 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-65118d82-f04c-4459-a291-9369a98c9a62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:51.402395 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 918/1865] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:35:51 2022] DELETE /identity/v3/projects/ac8e70ab7b30446aaf8316afb5dab145 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:51.404548 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65118d82-f04c-4459-a291-9369a98c9a62 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:51.406054 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-65118d82-f04c-4459-a291-9369a98c9a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:51.477093 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4862008-4ba0-4906-bdcb-1bf364d9a29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:51.483144 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4862008-4ba0-4906-bdcb-1bf364d9a29a admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:51.484812 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4862008-4ba0-4906-bdcb-1bf364d9a29a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:51.485576 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4862008-4ba0-4906-bdcb-1bf364d9a29a admin admin] PATH_INFO: `/v3/projects/c01bf1f47cf04ea3814cbbcec1daa658/users/742d17e7f0cb4b92b012e83961973cf7/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:51.566475 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4862008-4ba0-4906-bdcb-1bf364d9a29a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c01bf1f47cf04ea3814cbbcec1daa658, user_id=742d17e7f0cb4b92b012e83961973cf7, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:51.571831 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4862008-4ba0-4906-bdcb-1bf364d9a29a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:51.601852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 948/1866] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:51 2022] PUT /identity/v3/projects/c01bf1f47cf04ea3814cbbcec1daa658/users/742d17e7f0cb4b92b012e83961973cf7/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:51.603195 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4862008-4ba0-4906-bdcb-1bf364d9a29a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:51.604760 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:51.614812 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a4862008-4ba0-4906-bdcb-1bf364d9a29a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:51.667492 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65118d82-f04c-4459-a291-9369a98c9a62 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:51.833764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3924a-8529-45ab-89ea-67217aa30dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:51.835112 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3924a-8529-45ab-89ea-67217aa30dbb admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:51.835519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3924a-8529-45ab-89ea-67217aa30dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:51.836058 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3924a-8529-45ab-89ea-67217aa30dbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:51.837684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3924a-8529-45ab-89ea-67217aa30dbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:51.843179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3924a-8529-45ab-89ea-67217aa30dbb admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:51.877297 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4862008-4ba0-4906-bdcb-1bf364d9a29a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:51.887108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47f78b-5a45-4325-a6d4-c0c9d3357819 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:51.887933 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47f78b-5a45-4325-a6d4-c0c9d3357819 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:51.888376 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47f78b-5a45-4325-a6d4-c0c9d3357819 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:51.888687 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47f78b-5a45-4325-a6d4-c0c9d3357819 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:51.891481 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1a47f78b-5a45-4325-a6d4-c0c9d3357819 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:51.912074 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 919/1867] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:51 2022] POST /identity/v3/projects => generated 381 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:51.915384 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3924a-8529-45ab-89ea-67217aa30dbb admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:51.920129 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-47a3924a-8529-45ab-89ea-67217aa30dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:52.040472 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:52.047854 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47f78b-5a45-4325-a6d4-c0c9d3357819 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:52.055737 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47f78b-5a45-4325-a6d4-c0c9d3357819 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:52.086480 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 949/1868] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:52.094068 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab341be-5af9-4bd2-8034-e5964edd26e8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:52.094579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab341be-5af9-4bd2-8034-e5964edd26e8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:52.096943 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab341be-5af9-4bd2-8034-e5964edd26e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:52.102090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3924a-8529-45ab-89ea-67217aa30dbb admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:52.135901 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf559a-0d22-4ad7-8d08-44571a087868 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:52.138194 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf559a-0d22-4ad7-8d08-44571a087868 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:52.138509 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf559a-0d22-4ad7-8d08-44571a087868 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:52.140199 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf559a-0d22-4ad7-8d08-44571a087868 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:52.145066 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-24bf559a-0d22-4ad7-8d08-44571a087868 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:52.157532 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-dab341be-5af9-4bd2-8034-e5964edd26e8 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:52.159663 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dab341be-5af9-4bd2-8034-e5964edd26e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:52.197168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf559a-0d22-4ad7-8d08-44571a087868 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:52.206532 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf559a-0d22-4ad7-8d08-44571a087868 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:52.239836 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 920/1869] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:52.246609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8121f4-a942-416c-9d7a-6f213d85e982 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:52.246609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8121f4-a942-416c-9d7a-6f213d85e982 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:52.247911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8121f4-a942-416c-9d7a-6f213d85e982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:52.316507 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8a8121f4-a942-416c-9d7a-6f213d85e982 None None] MFA Rules not processed for user `742d17e7f0cb4b92b012e83961973cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:52.318042 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8a8121f4-a942-416c-9d7a-6f213d85e982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:52.437468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 950/1870] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:52.441131 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab341be-5af9-4bd2-8034-e5964edd26e8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:52.442179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:52.495183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab341be-5af9-4bd2-8034-e5964edd26e8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:52.506461 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 921/1871] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:52.508586 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6644d-6ad1-4555-bf6f-819e72a2ccf9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:52.508870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6644d-6ad1-4555-bf6f-819e72a2ccf9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:52.509160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6644d-6ad1-4555-bf6f-819e72a2ccf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:52.519059 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beede111-3c6d-4b74-a7fe-b7de785e20aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:52.519924 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beede111-3c6d-4b74-a7fe-b7de785e20aa admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:52.520431 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beede111-3c6d-4b74-a7fe-b7de785e20aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:52.520955 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beede111-3c6d-4b74-a7fe-b7de785e20aa admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:52.522294 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beede111-3c6d-4b74-a7fe-b7de785e20aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:52.530028 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beede111-3c6d-4b74-a7fe-b7de785e20aa admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:52.556443 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-aad6644d-6ad1-4555-bf6f-819e72a2ccf9 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:52.560422 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-aad6644d-6ad1-4555-bf6f-819e72a2ccf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:52.587729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 922/1872] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:52.591109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6644d-6ad1-4555-bf6f-819e72a2ccf9 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:52.594631 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-aad6644d-6ad1-4555-bf6f-819e72a2ccf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:52.609251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 951/1873] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:52 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:52.610945 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beede111-3c6d-4b74-a7fe-b7de785e20aa admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:52.641488 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6644d-6ad1-4555-bf6f-819e72a2ccf9 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:52.662947 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41059260-aa05-4331-97af-9465b10049a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:52.663821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41059260-aa05-4331-97af-9465b10049a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:52.663981 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beede111-3c6d-4b74-a7fe-b7de785e20aa admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:52.664396 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41059260-aa05-4331-97af-9465b10049a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:52.664574 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41059260-aa05-4331-97af-9465b10049a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:52.666792 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41059260-aa05-4331-97af-9465b10049a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:52.673455 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41059260-aa05-4331-97af-9465b10049a4 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:52.697180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b3e93-0ccf-4b25-bf41-700e54a87c54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:52.700701 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b3e93-0ccf-4b25-bf41-700e54a87c54 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:52.700975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b3e93-0ccf-4b25-bf41-700e54a87c54 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:52.701484 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b3e93-0ccf-4b25-bf41-700e54a87c54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:52.707009 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1a9b3e93-0ccf-4b25-bf41-700e54a87c54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:52.747925 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 923/1874] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:52 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:52.749335 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41059260-aa05-4331-97af-9465b10049a4 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:52.777047 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b3e93-0ccf-4b25-bf41-700e54a87c54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:52.783457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b3e93-0ccf-4b25-bf41-700e54a87c54 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:52.851754 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 952/1875] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:52.853519 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b3e93-0ccf-4b25-bf41-700e54a87c54 service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:52.912564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b3e93-0ccf-4b25-bf41-700e54a87c54 service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:52.920011 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41059260-aa05-4331-97af-9465b10049a4 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:52.939186 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8d020-5e6f-4c92-959f-d1b17bed7bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:52.940132 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8d020-5e6f-4c92-959f-d1b17bed7bee admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:52.940300 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa013d95-2613-44e1-8562-3d52370c1813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:52.940492 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8d020-5e6f-4c92-959f-d1b17bed7bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:52.940492 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8d020-5e6f-4c92-959f-d1b17bed7bee admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:52.941012 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa013d95-2613-44e1-8562-3d52370c1813 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:52.941493 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa013d95-2613-44e1-8562-3d52370c1813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:52.941658 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b8d020-5e6f-4c92-959f-d1b17bed7bee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:35:52.941802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b8d020-5e6f-4c92-959f-d1b17bed7bee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:52.942093 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa013d95-2613-44e1-8562-3d52370c1813 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:52.943155 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa013d95-2613-44e1-8562-3d52370c1813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:52.947086 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b8d020-5e6f-4c92-959f-d1b17bed7bee admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:52.947548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa013d95-2613-44e1-8562-3d52370c1813 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:52.983472 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 924/1876] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:35:52.989024 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8d020-5e6f-4c92-959f-d1b17bed7bee admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:53.004189 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 953/1877] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:53.009254 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa013d95-2613-44e1-8562-3d52370c1813 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:53.012428 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8d020-5e6f-4c92-959f-d1b17bed7bee admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:53.028974 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51498398-7940-4b37-a6fd-a5eebdc1ca94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:53.029713 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51498398-7940-4b37-a6fd-a5eebdc1ca94 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:53.030037 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51498398-7940-4b37-a6fd-a5eebdc1ca94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:53.030367 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51498398-7940-4b37-a6fd-a5eebdc1ca94 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:53.031276 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51498398-7940-4b37-a6fd-a5eebdc1ca94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:53.033559 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51498398-7940-4b37-a6fd-a5eebdc1ca94 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:53.066608 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa013d95-2613-44e1-8562-3d52370c1813 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:53.083602 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc842f2-6e23-4e5b-9d22-90ee4cfcbf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:53.084983 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc842f2-6e23-4e5b-9d22-90ee4cfcbf35 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:53.085174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc842f2-6e23-4e5b-9d22-90ee4cfcbf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:53.085749 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc842f2-6e23-4e5b-9d22-90ee4cfcbf35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:53.088657 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc842f2-6e23-4e5b-9d22-90ee4cfcbf35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:53.088898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc842f2-6e23-4e5b-9d22-90ee4cfcbf35 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:53.120270 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 925/1878] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:52 2022] POST /identity/v3/users => generated 299 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:53.122967 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51498398-7940-4b37-a6fd-a5eebdc1ca94 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:53.148558 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 954/1879] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:53 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:53.149611 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc842f2-6e23-4e5b-9d22-90ee4cfcbf35 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:53.156129 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51498398-7940-4b37-a6fd-a5eebdc1ca94 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:53.249917 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c862cb-7e5a-4917-9eb9-75a7c31c952a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:53.250970 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c862cb-7e5a-4917-9eb9-75a7c31c952a admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:53.251119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c862cb-7e5a-4917-9eb9-75a7c31c952a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:53.251509 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c862cb-7e5a-4917-9eb9-75a7c31c952a admin admin] PATH_INFO: `/v3/projects/5cd0b3a016124cd59ad881e8d4baeaff/users/88687d056c824eae941d31e94e871733/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:53.259948 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc842f2-6e23-4e5b-9d22-90ee4cfcbf35 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:53.273677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c862cb-7e5a-4917-9eb9-75a7c31c952a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd0b3a016124cd59ad881e8d4baeaff, user_id=88687d056c824eae941d31e94e871733, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:53.277031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c862cb-7e5a-4917-9eb9-75a7c31c952a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:53.279235 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0743bd-718d-48b3-8f1b-102b5f02524e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:53.281807 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0743bd-718d-48b3-8f1b-102b5f02524e admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:53.283474 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0743bd-718d-48b3-8f1b-102b5f02524e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:53.284486 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0743bd-718d-48b3-8f1b-102b5f02524e admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:53.286616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0743bd-718d-48b3-8f1b-102b5f02524e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:53.290564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0743bd-718d-48b3-8f1b-102b5f02524e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:53.303742 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 926/1880] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:53 2022] PUT /identity/v3/projects/5cd0b3a016124cd59ad881e8d4baeaff/users/88687d056c824eae941d31e94e871733/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:53.304828 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c862cb-7e5a-4917-9eb9-75a7c31c952a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:53.322330 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 955/1881] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:53.324401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0743bd-718d-48b3-8f1b-102b5f02524e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:53.346811 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:53.351346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0743bd-718d-48b3-8f1b-102b5f02524e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:53.417379 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:53.434189 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c862cb-7e5a-4917-9eb9-75a7c31c952a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:53.466257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111faab7-c2be-4dfb-a766-61b2703dbd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:53.471205 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111faab7-c2be-4dfb-a766-61b2703dbd0b admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:53.471767 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111faab7-c2be-4dfb-a766-61b2703dbd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:53.472272 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111faab7-c2be-4dfb-a766-61b2703dbd0b admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:53.474389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111faab7-c2be-4dfb-a766-61b2703dbd0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:53.476974 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111faab7-c2be-4dfb-a766-61b2703dbd0b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:53.482481 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6cda9-11ae-43b3-a3b4-06fb5ecd61c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:53.483157 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6cda9-11ae-43b3-a3b4-06fb5ecd61c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:53.483536 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6cda9-11ae-43b3-a3b4-06fb5ecd61c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:53.483911 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6cda9-11ae-43b3-a3b4-06fb5ecd61c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:53.484735 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6cda9-11ae-43b3-a3b4-06fb5ecd61c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:53.486934 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6cda9-11ae-43b3-a3b4-06fb5ecd61c7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:53.503066 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 956/1882] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:53.504272 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6cda9-11ae-43b3-a3b4-06fb5ecd61c7 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:53.510454 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 927/1883] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:53 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:53.511977 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111faab7-c2be-4dfb-a766-61b2703dbd0b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:53.519063 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6cda9-11ae-43b3-a3b4-06fb5ecd61c7 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:53.526457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076167e6-0496-478b-96ac-8e8c7c54d834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:53.527889 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076167e6-0496-478b-96ac-8e8c7c54d834 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:53.528750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111faab7-c2be-4dfb-a766-61b2703dbd0b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:53.529155 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076167e6-0496-478b-96ac-8e8c7c54d834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:53.530425 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076167e6-0496-478b-96ac-8e8c7c54d834 admin admin] PATH_INFO: `/v3/projects/f4d3053a080144c69afc9c5a0bb206ab/users/ec0698adc28241ecbde97b90bcf4d311/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:53.536891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73561e-ca7a-4f70-979f-ace3c23b699e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:53.537976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73561e-ca7a-4f70-979f-ace3c23b699e admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:53.538409 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73561e-ca7a-4f70-979f-ace3c23b699e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:53.538958 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73561e-ca7a-4f70-979f-ace3c23b699e admin admin] PATH_INFO: `/v3/projects/5cd0b3a016124cd59ad881e8d4baeaff/users/88687d056c824eae941d31e94e871733/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:53.541992 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73561e-ca7a-4f70-979f-ace3c23b699e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd0b3a016124cd59ad881e8d4baeaff, user_id=88687d056c824eae941d31e94e871733, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:53.546184 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73561e-ca7a-4f70-979f-ace3c23b699e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:53.556485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076167e6-0496-478b-96ac-8e8c7c54d834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d3053a080144c69afc9c5a0bb206ab, user_id=ec0698adc28241ecbde97b90bcf4d311, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:53.561789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076167e6-0496-478b-96ac-8e8c7c54d834 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:53.563996 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 928/1884] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:53 2022] PUT /identity/v3/projects/5cd0b3a016124cd59ad881e8d4baeaff/users/88687d056c824eae941d31e94e871733/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:53.564827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73561e-ca7a-4f70-979f-ace3c23b699e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:53.609240 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 957/1885] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:53 2022] PUT /identity/v3/projects/f4d3053a080144c69afc9c5a0bb206ab/users/ec0698adc28241ecbde97b90bcf4d311/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:53.612985 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d999d0-2e7c-4145-9966-4141a371cfb5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:53.613292 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d999d0-2e7c-4145-9966-4141a371cfb5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:53.614210 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d999d0-2e7c-4145-9966-4141a371cfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:53.675420 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73561e-ca7a-4f70-979f-ace3c23b699e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:53.681302 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-14d999d0-2e7c-4145-9966-4141a371cfb5 None None] MFA Rules not processed for user `88687d056c824eae941d31e94e871733`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:53.683000 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-14d999d0-2e7c-4145-9966-4141a371cfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:53.782776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34d199-49f1-4014-b695-74bdfabe2381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:53.783411 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34d199-49f1-4014-b695-74bdfabe2381 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:53.783688 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34d199-49f1-4014-b695-74bdfabe2381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:53.783958 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34d199-49f1-4014-b695-74bdfabe2381 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:53.784634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34d199-49f1-4014-b695-74bdfabe2381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:53.787181 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34d199-49f1-4014-b695-74bdfabe2381 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:53.802967 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 929/1886] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:53.803633 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34d199-49f1-4014-b695-74bdfabe2381 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:53.823398 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34d199-49f1-4014-b695-74bdfabe2381 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:53.831878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7472e-159a-4ef3-af08-de6e01620447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:53.832457 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7472e-159a-4ef3-af08-de6e01620447 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:53.832779 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7472e-159a-4ef3-af08-de6e01620447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:53.833084 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7472e-159a-4ef3-af08-de6e01620447 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:53.833705 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d7472e-159a-4ef3-af08-de6e01620447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:53.836160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d7472e-159a-4ef3-af08-de6e01620447 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:53.855181 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 930/1887] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:53.859217 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7472e-159a-4ef3-af08-de6e01620447 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:53.863113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 958/1888] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:53.864291 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d999d0-2e7c-4145-9966-4141a371cfb5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:53.882922 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7472e-159a-4ef3-af08-de6e01620447 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:53.889623 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d999d0-2e7c-4145-9966-4141a371cfb5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:53.892848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273b391-309e-48ca-9edd-03426aa99109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:53.894374 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273b391-309e-48ca-9edd-03426aa99109 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:53.894904 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273b391-309e-48ca-9edd-03426aa99109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:53.895707 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273b391-309e-48ca-9edd-03426aa99109 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:53.897425 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273b391-309e-48ca-9edd-03426aa99109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:53.897698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41364a5d-19b0-429d-a219-f1f17e5014b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:53.899207 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41364a5d-19b0-429d-a219-f1f17e5014b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:53.899207 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41364a5d-19b0-429d-a219-f1f17e5014b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:53.899207 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41364a5d-19b0-429d-a219-f1f17e5014b2 admin admin] PATH_INFO: `/v3/projects/f4d3053a080144c69afc9c5a0bb206ab/users/ec0698adc28241ecbde97b90bcf4d311/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:53.902476 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273b391-309e-48ca-9edd-03426aa99109 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:53.905421 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41364a5d-19b0-429d-a219-f1f17e5014b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d3053a080144c69afc9c5a0bb206ab, user_id=ec0698adc28241ecbde97b90bcf4d311, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:53.908219 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41364a5d-19b0-429d-a219-f1f17e5014b2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:53.930096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 931/1889] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:53.930096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273b391-309e-48ca-9edd-03426aa99109 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:53.930096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1273b391-309e-48ca-9edd-03426aa99109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:53.956664 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 959/1890] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:53 2022] PUT /identity/v3/projects/f4d3053a080144c69afc9c5a0bb206ab/users/ec0698adc28241ecbde97b90bcf4d311/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:53.956664 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41364a5d-19b0-429d-a219-f1f17e5014b2 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:53.964060 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:54.033758 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273b391-309e-48ca-9edd-03426aa99109 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:54.140054 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7799cd-9605-4ed5-928e-091a0b1bb7d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:54.140758 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7799cd-9605-4ed5-928e-091a0b1bb7d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:54.141020 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7799cd-9605-4ed5-928e-091a0b1bb7d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:54.141357 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7799cd-9605-4ed5-928e-091a0b1bb7d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:54.147575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41364a5d-19b0-429d-a219-f1f17e5014b2 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:54.153512 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498f27e-1dae-4586-bc43-19511801b431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:54.154363 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498f27e-1dae-4586-bc43-19511801b431 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:54.154646 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498f27e-1dae-4586-bc43-19511801b431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:54.154937 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498f27e-1dae-4586-bc43-19511801b431 admin admin] PATH_INFO: `/v3/projects/18d2e765fc8e4c74910752f153671518/users/b3561526f75949b1b7b09f74436b36f5/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:54.173218 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498f27e-1dae-4586-bc43-19511801b431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18d2e765fc8e4c74910752f153671518, user_id=b3561526f75949b1b7b09f74436b36f5, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:54.176183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498f27e-1dae-4586-bc43-19511801b431 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:54.201565 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:54.225560 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 960/1891] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:53 2022] PUT /identity/v3/projects/18d2e765fc8e4c74910752f153671518/users/b3561526f75949b1b7b09f74436b36f5/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:54.227386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce75532-5a1e-423d-a9dc-faf31fd5b0c8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:54.227676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce75532-5a1e-423d-a9dc-faf31fd5b0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:54.228235 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce75532-5a1e-423d-a9dc-faf31fd5b0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:54.261276 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7799cd-9605-4ed5-928e-091a0b1bb7d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:54.265026 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7799cd-9605-4ed5-928e-091a0b1bb7d5 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:54.271326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-fce75532-5a1e-423d-a9dc-faf31fd5b0c8 None None] MFA Rules not processed for user `ec0698adc28241ecbde97b90bcf4d311`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:54.273775 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fce75532-5a1e-423d-a9dc-faf31fd5b0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:54.289200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 932/1892] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:53 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:54.293039 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ba909-05e0-4e48-81df-941eb4cfa653 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:54.293356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ba909-05e0-4e48-81df-941eb4cfa653 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:54.304755 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ba909-05e0-4e48-81df-941eb4cfa653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:54.408935 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-df8ba909-05e0-4e48-81df-941eb4cfa653 None None] MFA Rules not processed for user `b3561526f75949b1b7b09f74436b36f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:54.410051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-df8ba909-05e0-4e48-81df-941eb4cfa653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:54.540914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 933/1893] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:54.548914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ba909-05e0-4e48-81df-941eb4cfa653 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:54.583759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:54.604467 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 961/1894] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:54.621347 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce75532-5a1e-423d-a9dc-faf31fd5b0c8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:54.708442 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ba909-05e0-4e48-81df-941eb4cfa653 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:54.713894 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f653c1-c414-4fc7-a11c-8687a16fb0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:54.714529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f653c1-c414-4fc7-a11c-8687a16fb0d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:54.714804 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f653c1-c414-4fc7-a11c-8687a16fb0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:54.715077 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f653c1-c414-4fc7-a11c-8687a16fb0d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:54.715814 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f653c1-c414-4fc7-a11c-8687a16fb0d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:54.717862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f653c1-c414-4fc7-a11c-8687a16fb0d2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:54.776157 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 934/1895] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:54 2022] POST /identity/v3/projects => generated 375 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:54.780717 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f653c1-c414-4fc7-a11c-8687a16fb0d2 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:54.846434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce75532-5a1e-423d-a9dc-faf31fd5b0c8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:54.930677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f653c1-c414-4fc7-a11c-8687a16fb0d2 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:54.937557 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f6391-6824-4acc-b6a2-e295dac36ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:54.938266 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f6391-6824-4acc-b6a2-e295dac36ffc admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:54.938492 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f6391-6824-4acc-b6a2-e295dac36ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:54.938748 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f6391-6824-4acc-b6a2-e295dac36ffc admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:54.940057 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f6391-6824-4acc-b6a2-e295dac36ffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:54.942274 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f6391-6824-4acc-b6a2-e295dac36ffc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:54.982004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 935/1896] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:54 2022] POST /identity/v3/users => generated 294 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:54.983294 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f6391-6824-4acc-b6a2-e295dac36ffc admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:54.996235 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f6391-6824-4acc-b6a2-e295dac36ffc admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:54.999025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93fbe0-6770-45dd-8c46-16af9daf8e36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:55.000054 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93fbe0-6770-45dd-8c46-16af9daf8e36 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:55.000523 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93fbe0-6770-45dd-8c46-16af9daf8e36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:55.001055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93fbe0-6770-45dd-8c46-16af9daf8e36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:55.002789 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22121a4-1855-4dbe-bc46-a414e98233b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:55.003510 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22121a4-1855-4dbe-bc46-a414e98233b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:55.003864 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22121a4-1855-4dbe-bc46-a414e98233b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:55.004225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22121a4-1855-4dbe-bc46-a414e98233b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:55.005015 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22121a4-1855-4dbe-bc46-a414e98233b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:55.006864 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22121a4-1855-4dbe-bc46-a414e98233b0 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:55.034348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 936/1897] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:35:55.045363 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22121a4-1855-4dbe-bc46-a414e98233b0 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:55.067113 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22121a4-1855-4dbe-bc46-a414e98233b0 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:55.073817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691045f-b956-431c-a4d6-6a6cac8de0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:55.074657 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691045f-b956-431c-a4d6-6a6cac8de0e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:55.075849 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691045f-b956-431c-a4d6-6a6cac8de0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:55.076212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691045f-b956-431c-a4d6-6a6cac8de0e3 admin admin] PATH_INFO: `/v3/projects/f2e1487abfc043548966201627a48663/users/5800c285578f4afdbeadf33e0e03fe88/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:55.101862 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:55.115985 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b691045f-b956-431c-a4d6-6a6cac8de0e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2e1487abfc043548966201627a48663, user_id=5800c285578f4afdbeadf33e0e03fe88, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:55.122912 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b691045f-b956-431c-a4d6-6a6cac8de0e3 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:55.135011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93fbe0-6770-45dd-8c46-16af9daf8e36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:55.138575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93fbe0-6770-45dd-8c46-16af9daf8e36 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:55.159463 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 962/1898] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:55.162240 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 937/1899] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:55 2022] PUT /identity/v3/projects/f2e1487abfc043548966201627a48663/users/5800c285578f4afdbeadf33e0e03fe88/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:55.178309 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93fbe0-6770-45dd-8c46-16af9daf8e36 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:55.199989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93fbe0-6770-45dd-8c46-16af9daf8e36 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:55.241562 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691045f-b956-431c-a4d6-6a6cac8de0e3 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:55.319314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baafcd8-f58c-4d8e-b941-613e0b02bd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:55.319942 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baafcd8-f58c-4d8e-b941-613e0b02bd38 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:55.320372 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baafcd8-f58c-4d8e-b941-613e0b02bd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:55.320723 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baafcd8-f58c-4d8e-b941-613e0b02bd38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:55.321337 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baafcd8-f58c-4d8e-b941-613e0b02bd38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:55.324736 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baafcd8-f58c-4d8e-b941-613e0b02bd38 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:55.344321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 963/1900] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:55.345741 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baafcd8-f58c-4d8e-b941-613e0b02bd38 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:55.363860 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baafcd8-f58c-4d8e-b941-613e0b02bd38 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:55.370936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:55.382477 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37830b-7fd2-4d75-85f4-d9dc200fd156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:55.383641 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37830b-7fd2-4d75-85f4-d9dc200fd156 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:55.386041 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37830b-7fd2-4d75-85f4-d9dc200fd156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:55.386314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37830b-7fd2-4d75-85f4-d9dc200fd156 admin admin] PATH_INFO: `/v3/projects/f2e1487abfc043548966201627a48663/users/5800c285578f4afdbeadf33e0e03fe88/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:55.392236 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37830b-7fd2-4d75-85f4-d9dc200fd156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2e1487abfc043548966201627a48663, user_id=5800c285578f4afdbeadf33e0e03fe88, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:55.395581 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37830b-7fd2-4d75-85f4-d9dc200fd156 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:55.443067 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 964/1901] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:55 2022] PUT /identity/v3/projects/f2e1487abfc043548966201627a48663/users/5800c285578f4afdbeadf33e0e03fe88/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:55.446571 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5a357-34ed-43e1-9e66-9935bfed51a0 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:55.447096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5a357-34ed-43e1-9e66-9935bfed51a0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:55.447285 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5a357-34ed-43e1-9e66-9935bfed51a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:55.451823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691045f-b956-431c-a4d6-6a6cac8de0e3 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:55.525174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-26b5a357-34ed-43e1-9e66-9935bfed51a0 None None] MFA Rules not processed for user `5800c285578f4afdbeadf33e0e03fe88`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:55.529644 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-26b5a357-34ed-43e1-9e66-9935bfed51a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:55.683885 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ae41e-6ceb-42bf-bd14-c4aa6a5c0ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:55.685042 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ae41e-6ceb-42bf-bd14-c4aa6a5c0ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:55.687186 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ae41e-6ceb-42bf-bd14-c4aa6a5c0ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:55.687470 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ae41e-6ceb-42bf-bd14-c4aa6a5c0ffe admin admin] PATH_INFO: `/v3/users/aa6cc259c13a49edaf30659c47c45e0f` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:55.691737 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ae41e-6ceb-42bf-bd14-c4aa6a5c0ffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa6cc259c13a49edaf30659c47c45e0f)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:55.696708 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ae41e-6ceb-42bf-bd14-c4aa6a5c0ffe admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:55.724680 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 965/1902] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:55.740748 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5a357-34ed-43e1-9e66-9935bfed51a0 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:55.813523 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-867ae41e-6ceb-42bf-bd14-c4aa6a5c0ffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa6cc259c13a49edaf30659c47c45e0f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:55.838281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-867ae41e-6ceb-42bf-bd14-c4aa6a5c0ffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa6cc259c13a49edaf30659c47c45e0f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:55.839827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-867ae41e-6ceb-42bf-bd14-c4aa6a5c0ffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa6cc259c13a49edaf30659c47c45e0f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:55.840514 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-867ae41e-6ceb-42bf-bd14-c4aa6a5c0ffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa6cc259c13a49edaf30659c47c45e0f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:55.853385 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-867ae41e-6ceb-42bf-bd14-c4aa6a5c0ffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa6cc259c13a49edaf30659c47c45e0f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:55.881461 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 938/1903] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:35:55 2022] DELETE /identity/v3/users/aa6cc259c13a49edaf30659c47c45e0f => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:35:55.884678 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3da6f-1d52-4197-954d-51ae0c789c8f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:55.888539 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3da6f-1d52-4197-954d-51ae0c789c8f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:55.888948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3da6f-1d52-4197-954d-51ae0c789c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:55.914272 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-74a3da6f-1d52-4197-954d-51ae0c789c8f None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:55.916102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-74a3da6f-1d52-4197-954d-51ae0c789c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:56.001694 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5a357-34ed-43e1-9e66-9935bfed51a0 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:56.035794 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:56.129354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 939/1904] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:56.192439 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f16d6b-6069-4b65-b0a5-e948b13e92b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:56.193749 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f16d6b-6069-4b65-b0a5-e948b13e92b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:56.194244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f16d6b-6069-4b65-b0a5-e948b13e92b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:56.194911 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f16d6b-6069-4b65-b0a5-e948b13e92b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:56.198266 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-56f16d6b-6069-4b65-b0a5-e948b13e92b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:56.220708 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3da6f-1d52-4197-954d-51ae0c789c8f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:56.223759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-74a3da6f-1d52-4197-954d-51ae0c789c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:56.290308 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:56.392549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3da6f-1d52-4197-954d-51ae0c789c8f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:56.406665 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f0170-5789-4bf9-a332-12e69821eca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:56.407738 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f0170-5789-4bf9-a332-12e69821eca7 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:56.408225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f0170-5789-4bf9-a332-12e69821eca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:56.408747 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f0170-5789-4bf9-a332-12e69821eca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:56.416732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f16d6b-6069-4b65-b0a5-e948b13e92b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:56.421336 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f16d6b-6069-4b65-b0a5-e948b13e92b1 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:56.441726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 966/1905] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:56.464775 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f0170-5789-4bf9-a332-12e69821eca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:56.468577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f0170-5789-4bf9-a332-12e69821eca7 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:56.505283 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 940/1906] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:35:56.520171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f16d6b-6069-4b65-b0a5-e948b13e92b1 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:56.522691 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-56f16d6b-6069-4b65-b0a5-e948b13e92b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:56.571805 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f16d6b-6069-4b65-b0a5-e948b13e92b1 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:56.585350 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e456e04-f6c7-4fbd-acae-326a3b87ac79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:56.586470 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e456e04-f6c7-4fbd-acae-326a3b87ac79 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:56.586923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e456e04-f6c7-4fbd-acae-326a3b87ac79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:56.587404 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e456e04-f6c7-4fbd-acae-326a3b87ac79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:56.602150 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9e456e04-f6c7-4fbd-acae-326a3b87ac79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:56.899270 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e456e04-f6c7-4fbd-acae-326a3b87ac79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:56.908033 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e456e04-f6c7-4fbd-acae-326a3b87ac79 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:56.935944 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 967/1907] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:56 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:57.943959 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f0170-5789-4bf9-a332-12e69821eca7 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:57.945762 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-885f0170-5789-4bf9-a332-12e69821eca7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:57.967339 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f0170-5789-4bf9-a332-12e69821eca7 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:57.973989 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69139f-4d47-438b-93b9-64c02b52d6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:57.974997 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69139f-4d47-438b-93b9-64c02b52d6d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:57.975645 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69139f-4d47-438b-93b9-64c02b52d6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:57.976066 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69139f-4d47-438b-93b9-64c02b52d6d4 admin admin] PATH_INFO: `/v3/projects/6972c4056b164f6bac49b4091eb927be` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:57.979195 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69139f-4d47-438b-93b9-64c02b52d6d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6972c4056b164f6bac49b4091eb927be)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:57.983805 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69139f-4d47-438b-93b9-64c02b52d6d4 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:58.130608 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4f69139f-4d47-438b-93b9-64c02b52d6d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6972c4056b164f6bac49b4091eb927be', 'request_id': 'req-4f69139f-4d47-438b-93b9-64c02b52d6d4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:58.177632 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4f69139f-4d47-438b-93b9-64c02b52d6d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6972c4056b164f6bac49b4091eb927be', 'request_id': 'req-4f69139f-4d47-438b-93b9-64c02b52d6d4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:58.208509 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4f69139f-4d47-438b-93b9-64c02b52d6d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6972c4056b164f6bac49b4091eb927be', 'request_id': 'req-4f69139f-4d47-438b-93b9-64c02b52d6d4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:58.296250 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4f69139f-4d47-438b-93b9-64c02b52d6d4 admin admin] The token cache is being invalidate because project 6972c4056b164f6bac49b4091eb927be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:35:58.298169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4f69139f-4d47-438b-93b9-64c02b52d6d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:58.300076 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4f69139f-4d47-438b-93b9-64c02b52d6d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:58.304324 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 941/1908] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:35:57 2022] DELETE /identity/v3/projects/6972c4056b164f6bac49b4091eb927be => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:58.310090 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e456e04-f6c7-4fbd-acae-326a3b87ac79 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:58.322736 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e456e04-f6c7-4fbd-acae-326a3b87ac79 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:58.469757 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c8c48-9ea5-47f9-847f-8dbef537566a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:58.470736 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c8c48-9ea5-47f9-847f-8dbef537566a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:58.471122 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c8c48-9ea5-47f9-847f-8dbef537566a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:58.471553 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c8c48-9ea5-47f9-847f-8dbef537566a admin admin] PATH_INFO: `/v3/users/88687d056c824eae941d31e94e871733` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:58.473231 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c8c48-9ea5-47f9-847f-8dbef537566a admin admin] RBAC: Authorizing `identity:delete_user(user_id=88687d056c824eae941d31e94e871733)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:58.478047 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c8c48-9ea5-47f9-847f-8dbef537566a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:58.486872 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:58.601745 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4d7c8c48-9ea5-47f9-847f-8dbef537566a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88687d056c824eae941d31e94e871733'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:58.662631 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4d7c8c48-9ea5-47f9-847f-8dbef537566a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88687d056c824eae941d31e94e871733'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:58.663891 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4d7c8c48-9ea5-47f9-847f-8dbef537566a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88687d056c824eae941d31e94e871733'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:58.707129 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4d7c8c48-9ea5-47f9-847f-8dbef537566a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88687d056c824eae941d31e94e871733'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:58.745784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4d7c8c48-9ea5-47f9-847f-8dbef537566a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88687d056c824eae941d31e94e871733'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:58.769088 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 968/1909] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:35:58 2022] DELETE /identity/v3/users/88687d056c824eae941d31e94e871733 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:59.455938 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f3b58-406b-4872-94c6-a311d9f020f2 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:59.457018 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f3b58-406b-4872-94c6-a311d9f020f2 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:59.457018 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f3b58-406b-4872-94c6-a311d9f020f2 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:59.458296 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 942/1910] 10.222.0.52 () {54 vars in 921 bytes} [Thu Sep 1 16:35:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:35:59.489734 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bea1a9-097c-4ed9-a307-c5c1bcee09e0 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:59.491581 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bea1a9-097c-4ed9-a307-c5c1bcee09e0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:59.492766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bea1a9-097c-4ed9-a307-c5c1bcee09e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:59.533510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-25bea1a9-097c-4ed9-a307-c5c1bcee09e0 None None] MFA Rules not processed for user `55f389ab3ea046008b44f129113de995`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:59.535561 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-25bea1a9-097c-4ed9-a307-c5c1bcee09e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:59.743650 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 969/1911] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Sep 1 16:35:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:59.995366 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f3b58-406b-4872-94c6-a311d9f020f2 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:59.997512 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f95f3b58-406b-4872-94c6-a311d9f020f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:00.023272 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f3b58-406b-4872-94c6-a311d9f020f2 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:00.035083 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d987b0-b113-4de1-a225-ad8fe0e4e012 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:00.035778 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d987b0-b113-4de1-a225-ad8fe0e4e012 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:00.036062 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d987b0-b113-4de1-a225-ad8fe0e4e012 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:00.036334 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d987b0-b113-4de1-a225-ad8fe0e4e012 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:00.050521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d987b0-b113-4de1-a225-ad8fe0e4e012 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:00.052257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d987b0-b113-4de1-a225-ad8fe0e4e012 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:00.080200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 943/1912] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:00.124969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bea1a9-097c-4ed9-a307-c5c1bcee09e0 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:00.127600 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-25bea1a9-097c-4ed9-a307-c5c1bcee09e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:00.324259 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bea1a9-097c-4ed9-a307-c5c1bcee09e0 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:00.338538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb79c6c-81ce-4436-9d86-827112cca334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:00.339118 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb79c6c-81ce-4436-9d86-827112cca334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:00.339471 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb79c6c-81ce-4436-9d86-827112cca334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:00.339771 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb79c6c-81ce-4436-9d86-827112cca334 admin admin] PATH_INFO: `/v3/projects/5cd0b3a016124cd59ad881e8d4baeaff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:00.341383 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb79c6c-81ce-4436-9d86-827112cca334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cd0b3a016124cd59ad881e8d4baeaff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:00.343754 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb79c6c-81ce-4436-9d86-827112cca334 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:00.419703 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:00.428170 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d987b0-b113-4de1-a225-ad8fe0e4e012 service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:00.430257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f0d987b0-b113-4de1-a225-ad8fe0e4e012 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:00.506048 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fdb79c6c-81ce-4436-9d86-827112cca334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd0b3a016124cd59ad881e8d4baeaff', 'request_id': 'req-fdb79c6c-81ce-4436-9d86-827112cca334'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:00.531173 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fdb79c6c-81ce-4436-9d86-827112cca334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd0b3a016124cd59ad881e8d4baeaff', 'request_id': 'req-fdb79c6c-81ce-4436-9d86-827112cca334'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:00.553198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fdb79c6c-81ce-4436-9d86-827112cca334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd0b3a016124cd59ad881e8d4baeaff', 'request_id': 'req-fdb79c6c-81ce-4436-9d86-827112cca334'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:00.587352 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fdb79c6c-81ce-4436-9d86-827112cca334 admin admin] The token cache is being invalidate because project 5cd0b3a016124cd59ad881e8d4baeaff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:00.587986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fdb79c6c-81ce-4436-9d86-827112cca334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:00.593074 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fdb79c6c-81ce-4436-9d86-827112cca334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:00.602966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 970/1913] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:00 2022] DELETE /identity/v3/projects/5cd0b3a016124cd59ad881e8d4baeaff => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:00.604611 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96502f-0440-4438-8c46-74c41ede1ccf None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:00.605044 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96502f-0440-4438-8c46-74c41ede1ccf None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:00.605322 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96502f-0440-4438-8c46-74c41ede1ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:00.614880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d987b0-b113-4de1-a225-ad8fe0e4e012 service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:00.671672 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-cc96502f-0440-4438-8c46-74c41ede1ccf None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:00.677554 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cc96502f-0440-4438-8c46-74c41ede1ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:00.806958 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:00.843506 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01824e11-7db0-4024-b30e-ec215c2fa4ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:00.844609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01824e11-7db0-4024-b30e-ec215c2fa4ce service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:00.847028 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01824e11-7db0-4024-b30e-ec215c2fa4ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:00.847521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01824e11-7db0-4024-b30e-ec215c2fa4ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:00.859259 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-01824e11-7db0-4024-b30e-ec215c2fa4ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:00.904705 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 971/1914] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:00.907125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71629a5-a1af-4830-b341-9bf6854865c6 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:00.907462 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71629a5-a1af-4830-b341-9bf6854865c6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:00.907730 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71629a5-a1af-4830-b341-9bf6854865c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:00.958316 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c71629a5-a1af-4830-b341-9bf6854865c6 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:00.962266 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c71629a5-a1af-4830-b341-9bf6854865c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:00.978988 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 972/1915] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:00.985005 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71629a5-a1af-4830-b341-9bf6854865c6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:01.007657 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71629a5-a1af-4830-b341-9bf6854865c6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:01.020245 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97909160-fc2d-43ab-8b61-c632e4b632bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:01.021647 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97909160-fc2d-43ab-8b61-c632e4b632bd admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:01.022218 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97909160-fc2d-43ab-8b61-c632e4b632bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:01.022900 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97909160-fc2d-43ab-8b61-c632e4b632bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:01.024125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97909160-fc2d-43ab-8b61-c632e4b632bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:36:01.025105 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97909160-fc2d-43ab-8b61-c632e4b632bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:01.027929 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97909160-fc2d-43ab-8b61-c632e4b632bd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:01.090109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01824e11-7db0-4024-b30e-ec215c2fa4ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:01.094927 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01824e11-7db0-4024-b30e-ec215c2fa4ce service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:01.098267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 973/1916] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:36:01.105445 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97909160-fc2d-43ab-8b61-c632e4b632bd admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:01.146456 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 944/1917] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 719 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:01.171136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97909160-fc2d-43ab-8b61-c632e4b632bd admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:01.192387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46ace0-86fd-4b8c-853e-e043373afe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:01.193228 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46ace0-86fd-4b8c-853e-e043373afe17 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:01.193412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46ace0-86fd-4b8c-853e-e043373afe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:01.194135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46ace0-86fd-4b8c-853e-e043373afe17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:01.196309 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be46ace0-86fd-4b8c-853e-e043373afe17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:01.209336 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be46ace0-86fd-4b8c-853e-e043373afe17 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:01.332311 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 974/1918] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:36:01 2022] POST /identity/v3/projects => generated 383 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:01.336174 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01824e11-7db0-4024-b30e-ec215c2fa4ce service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:01.354484 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01824e11-7db0-4024-b30e-ec215c2fa4ce service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:01.537550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a99d0f-7987-4775-a59d-7c49c58f1174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:01.538673 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a99d0f-7987-4775-a59d-7c49c58f1174 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:01.539658 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a99d0f-7987-4775-a59d-7c49c58f1174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:01.541032 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a99d0f-7987-4775-a59d-7c49c58f1174 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:01.542783 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a99d0f-7987-4775-a59d-7c49c58f1174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:01.548580 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a99d0f-7987-4775-a59d-7c49c58f1174 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:01.609757 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 945/1919] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:36:01 2022] POST /identity/v3/users => generated 292 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:01.614418 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46ace0-86fd-4b8c-853e-e043373afe17 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:01.640030 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46ace0-86fd-4b8c-853e-e043373afe17 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:01.649967 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3378b61-a614-4d24-9822-90515c5af0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:01.651661 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3378b61-a614-4d24-9822-90515c5af0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:01.652457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3378b61-a614-4d24-9822-90515c5af0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:01.653232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3378b61-a614-4d24-9822-90515c5af0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:01.654738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3378b61-a614-4d24-9822-90515c5af0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:01.658224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3378b61-a614-4d24-9822-90515c5af0d9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:01.680283 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 975/1920] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:01.685412 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a99d0f-7987-4775-a59d-7c49c58f1174 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:01.708266 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a99d0f-7987-4775-a59d-7c49c58f1174 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:01.721150 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bb35e-1400-44de-bb10-3c27fbfc6883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:01.722251 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bb35e-1400-44de-bb10-3c27fbfc6883 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:01.722729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bb35e-1400-44de-bb10-3c27fbfc6883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:01.723192 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bb35e-1400-44de-bb10-3c27fbfc6883 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:01.738219 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bb35e-1400-44de-bb10-3c27fbfc6883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:01.744429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bb35e-1400-44de-bb10-3c27fbfc6883 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:01.769129 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 946/1921] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:01.776826 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3378b61-a614-4d24-9822-90515c5af0d9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:01.828500 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3378b61-a614-4d24-9822-90515c5af0d9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:01.846307 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb8c6f-f2f6-4809-97ce-edd58a1be679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:01.847387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb8c6f-f2f6-4809-97ce-edd58a1be679 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:01.847387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb8c6f-f2f6-4809-97ce-edd58a1be679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:01.847740 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb8c6f-f2f6-4809-97ce-edd58a1be679 admin admin] PATH_INFO: `/v3/projects/0ab54e5279d0463193abfe09cff6890a/users/085deeba4be84b498d43a3bc0acca4a6/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:01.914465 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb8c6f-f2f6-4809-97ce-edd58a1be679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ab54e5279d0463193abfe09cff6890a, user_id=085deeba4be84b498d43a3bc0acca4a6, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:01.921982 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb8c6f-f2f6-4809-97ce-edd58a1be679 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:01.970819 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 976/1922] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:01 2022] PUT /identity/v3/projects/0ab54e5279d0463193abfe09cff6890a/users/085deeba4be84b498d43a3bc0acca4a6/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:01.995641 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ca4ff-5373-4900-90c4-189449463950 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:01.996317 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ca4ff-5373-4900-90c4-189449463950 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:01.998206 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ca4ff-5373-4900-90c4-189449463950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:02.130455 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c87ca4ff-5373-4900-90c4-189449463950 None None] MFA Rules not processed for user `085deeba4be84b498d43a3bc0acca4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:02.132707 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c87ca4ff-5373-4900-90c4-189449463950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:02.309340 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 947/1923] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:02.317631 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb8c6f-f2f6-4809-97ce-edd58a1be679 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:02.394573 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:02.424249 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ca4ff-5373-4900-90c4-189449463950 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:02.425829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c87ca4ff-5373-4900-90c4-189449463950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:02.433481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:02.475973 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb8c6f-f2f6-4809-97ce-edd58a1be679 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:02.487457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf0c23-b95c-4fcd-98ba-b217aacbf95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:02.488755 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf0c23-b95c-4fcd-98ba-b217aacbf95e admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:02.489172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf0c23-b95c-4fcd-98ba-b217aacbf95e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:02.489820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf0c23-b95c-4fcd-98ba-b217aacbf95e admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:02.491101 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf0c23-b95c-4fcd-98ba-b217aacbf95e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:02.495192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf0c23-b95c-4fcd-98ba-b217aacbf95e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:02.553928 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ca4ff-5373-4900-90c4-189449463950 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:02.572036 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d1eb7-1120-4a1f-9840-392af1cea966 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:02.573729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d1eb7-1120-4a1f-9840-392af1cea966 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:02.574479 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d1eb7-1120-4a1f-9840-392af1cea966 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:02.575433 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d1eb7-1120-4a1f-9840-392af1cea966 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:02.579758 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 977/1924] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:36:02 2022] POST /identity/v3/projects => generated 383 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:02.581570 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-549d1eb7-1120-4a1f-9840-392af1cea966 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:02.585651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf0c23-b95c-4fcd-98ba-b217aacbf95e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:02.756302 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d1eb7-1120-4a1f-9840-392af1cea966 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:02.764894 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d1eb7-1120-4a1f-9840-392af1cea966 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:02.796493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 948/1925] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:36:02.800596 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf0c23-b95c-4fcd-98ba-b217aacbf95e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:02.821041 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103619f-35c8-4738-ba7a-9570b61c9ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:02.821041 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103619f-35c8-4738-ba7a-9570b61c9ccf admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:02.821041 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103619f-35c8-4738-ba7a-9570b61c9ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:02.821041 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103619f-35c8-4738-ba7a-9570b61c9ccf admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:02.821602 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103619f-35c8-4738-ba7a-9570b61c9ccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:02.836932 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103619f-35c8-4738-ba7a-9570b61c9ccf admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:02.907238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d1eb7-1120-4a1f-9840-392af1cea966 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:02.917451 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 978/1926] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:36:02 2022] POST /identity/v3/users => generated 298 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:02.943960 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d1eb7-1120-4a1f-9840-392af1cea966 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:02.964338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931b82d-a34e-4c9c-ad1d-3429ba9e97d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:02.966675 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931b82d-a34e-4c9c-ad1d-3429ba9e97d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:02.966675 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931b82d-a34e-4c9c-ad1d-3429ba9e97d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:02.967245 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931b82d-a34e-4c9c-ad1d-3429ba9e97d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:02.968678 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931b82d-a34e-4c9c-ad1d-3429ba9e97d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:02.973487 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931b82d-a34e-4c9c-ad1d-3429ba9e97d4 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:03.004471 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 949/1927] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:36:03.011783 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103619f-35c8-4738-ba7a-9570b61c9ccf admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:03.032014 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103619f-35c8-4738-ba7a-9570b61c9ccf admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:03.061523 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ea2ec-f5d7-4c30-b8cf-595e9e277330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:03.063124 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ea2ec-f5d7-4c30-b8cf-595e9e277330 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:03.063866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ea2ec-f5d7-4c30-b8cf-595e9e277330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:03.064576 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ea2ec-f5d7-4c30-b8cf-595e9e277330 admin admin] PATH_INFO: `/v3/projects/25b44348da6249b982886e0a673613d8/users/5c3eccc4683c4dda84c6d777d563fe61/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:03.126450 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ea2ec-f5d7-4c30-b8cf-595e9e277330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b44348da6249b982886e0a673613d8, user_id=5c3eccc4683c4dda84c6d777d563fe61, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:03.136666 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ea2ec-f5d7-4c30-b8cf-595e9e277330 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:03.183696 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 979/1928] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:03 2022] PUT /identity/v3/projects/25b44348da6249b982886e0a673613d8/users/5c3eccc4683c4dda84c6d777d563fe61/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:03.190670 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931b82d-a34e-4c9c-ad1d-3429ba9e97d4 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:03.224311 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931b82d-a34e-4c9c-ad1d-3429ba9e97d4 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:03.421945 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46466e6-59aa-4ad9-8edd-a723bfa4cf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:03.424280 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46466e6-59aa-4ad9-8edd-a723bfa4cf87 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:03.425433 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46466e6-59aa-4ad9-8edd-a723bfa4cf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:03.425741 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46466e6-59aa-4ad9-8edd-a723bfa4cf87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:03.426507 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46466e6-59aa-4ad9-8edd-a723bfa4cf87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:03.428196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46466e6-59aa-4ad9-8edd-a723bfa4cf87 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:03.473501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ea2ec-f5d7-4c30-b8cf-595e9e277330 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:03.474184 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 950/1929] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:03.504598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ea2ec-f5d7-4c30-b8cf-595e9e277330 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:03.513809 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b54984-6657-4c27-bcf4-030b0416fa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:03.515439 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b54984-6657-4c27-bcf4-030b0416fa8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:03.515439 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b54984-6657-4c27-bcf4-030b0416fa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:03.515926 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b54984-6657-4c27-bcf4-030b0416fa8f admin admin] PATH_INFO: `/v3/projects/25b44348da6249b982886e0a673613d8/users/5c3eccc4683c4dda84c6d777d563fe61/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:03.520000 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b54984-6657-4c27-bcf4-030b0416fa8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b44348da6249b982886e0a673613d8, user_id=5c3eccc4683c4dda84c6d777d563fe61, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:03.525166 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b54984-6657-4c27-bcf4-030b0416fa8f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:03.546675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 980/1930] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:03 2022] PUT /identity/v3/projects/25b44348da6249b982886e0a673613d8/users/5c3eccc4683c4dda84c6d777d563fe61/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:03.567596 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300973d-d899-45e0-8213-6986b220a827 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:03.567812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300973d-d899-45e0-8213-6986b220a827 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:03.568260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300973d-d899-45e0-8213-6986b220a827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:03.625666 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3300973d-d899-45e0-8213-6986b220a827 None None] MFA Rules not processed for user `5c3eccc4683c4dda84c6d777d563fe61`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:03.627645 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3300973d-d899-45e0-8213-6986b220a827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:03.710594 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:03.821816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 951/1931] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:03.841016 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b54984-6657-4c27-bcf4-030b0416fa8f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:03.843448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b8b54984-6657-4c27-bcf4-030b0416fa8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:03.990056 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b54984-6657-4c27-bcf4-030b0416fa8f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:04.001243 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6955ae4-50c5-4049-94e4-5cbfd8864331 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:04.002943 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6955ae4-50c5-4049-94e4-5cbfd8864331 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:04.003468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6955ae4-50c5-4049-94e4-5cbfd8864331 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:04.003968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6955ae4-50c5-4049-94e4-5cbfd8864331 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:04.026877 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6955ae4-50c5-4049-94e4-5cbfd8864331 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:04.030384 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6955ae4-50c5-4049-94e4-5cbfd8864331 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:04.071123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 981/1932] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:04.229103 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300973d-d899-45e0-8213-6986b220a827 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:04.247563 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300973d-d899-45e0-8213-6986b220a827 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:04.254449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d483168-aa9f-46e2-a5bb-3d1cfb835397 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:04.256389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d483168-aa9f-46e2-a5bb-3d1cfb835397 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:04.256925 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d483168-aa9f-46e2-a5bb-3d1cfb835397 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:04.257446 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d483168-aa9f-46e2-a5bb-3d1cfb835397 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:04.375810 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d483168-aa9f-46e2-a5bb-3d1cfb835397 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:04.377331 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d483168-aa9f-46e2-a5bb-3d1cfb835397 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:04.392775 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 952/1933] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:05.150583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6955ae4-50c5-4049-94e4-5cbfd8864331 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:05.179487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:05.339457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6955ae4-50c5-4049-94e4-5cbfd8864331 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:05.364924 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31487a5-9822-411a-bcc3-ab73013f7d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:05.369334 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31487a5-9822-411a-bcc3-ab73013f7d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:05.371505 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31487a5-9822-411a-bcc3-ab73013f7d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:05.374489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31487a5-9822-411a-bcc3-ab73013f7d1b admin admin] PATH_INFO: `/v3/users/085deeba4be84b498d43a3bc0acca4a6` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:05.377840 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31487a5-9822-411a-bcc3-ab73013f7d1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=085deeba4be84b498d43a3bc0acca4a6)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:05.393566 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31487a5-9822-411a-bcc3-ab73013f7d1b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:05.606025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f31487a5-9822-411a-bcc3-ab73013f7d1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '085deeba4be84b498d43a3bc0acca4a6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:05.661920 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f31487a5-9822-411a-bcc3-ab73013f7d1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '085deeba4be84b498d43a3bc0acca4a6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:05.663477 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f31487a5-9822-411a-bcc3-ab73013f7d1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '085deeba4be84b498d43a3bc0acca4a6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:05.716562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f31487a5-9822-411a-bcc3-ab73013f7d1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '085deeba4be84b498d43a3bc0acca4a6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:05.752963 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f31487a5-9822-411a-bcc3-ab73013f7d1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '085deeba4be84b498d43a3bc0acca4a6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:05.781934 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 982/1934] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:05 2022] DELETE /identity/v3/users/085deeba4be84b498d43a3bc0acca4a6 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:05.788186 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0e9da-b6fd-447c-924f-79140ef210e3 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:05.788797 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0e9da-b6fd-447c-924f-79140ef210e3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:05.789193 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0e9da-b6fd-447c-924f-79140ef210e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:05.867129 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c4a0e9da-b6fd-447c-924f-79140ef210e3 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:05.869171 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c4a0e9da-b6fd-447c-924f-79140ef210e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:06.041026 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 953/1935] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:06.057097 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31487a5-9822-411a-bcc3-ab73013f7d1b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:06.061590 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f31487a5-9822-411a-bcc3-ab73013f7d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:06.190607 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31487a5-9822-411a-bcc3-ab73013f7d1b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:06.197003 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08fa1b-a8a6-44ef-b104-489744ef07f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:06.197698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08fa1b-a8a6-44ef-b104-489744ef07f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:06.197988 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08fa1b-a8a6-44ef-b104-489744ef07f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:06.198265 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08fa1b-a8a6-44ef-b104-489744ef07f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:06.217109 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08fa1b-a8a6-44ef-b104-489744ef07f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:06.217740 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08fa1b-a8a6-44ef-b104-489744ef07f8 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:06.230051 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 983/1936] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:36:06.547626 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0e9da-b6fd-447c-924f-79140ef210e3 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:06.550817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c4a0e9da-b6fd-447c-924f-79140ef210e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:06.580332 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0e9da-b6fd-447c-924f-79140ef210e3 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:06.593444 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6786a-e7d4-4179-a388-d82b13deb369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:06.594562 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6786a-e7d4-4179-a388-d82b13deb369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:06.595570 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6786a-e7d4-4179-a388-d82b13deb369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:06.596370 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6786a-e7d4-4179-a388-d82b13deb369 admin admin] PATH_INFO: `/v3/users/0b3c5f520cb743d283e08746db4aff8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:06.599706 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6786a-e7d4-4179-a388-d82b13deb369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b3c5f520cb743d283e08746db4aff8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:06.604677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6786a-e7d4-4179-a388-d82b13deb369 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:06.784845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-51f6786a-e7d4-4179-a388-d82b13deb369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b3c5f520cb743d283e08746db4aff8c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:06.814671 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:06.818089 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-51f6786a-e7d4-4179-a388-d82b13deb369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b3c5f520cb743d283e08746db4aff8c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:06.820217 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-51f6786a-e7d4-4179-a388-d82b13deb369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b3c5f520cb743d283e08746db4aff8c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:06.823394 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-51f6786a-e7d4-4179-a388-d82b13deb369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b3c5f520cb743d283e08746db4aff8c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:06.841964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-51f6786a-e7d4-4179-a388-d82b13deb369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b3c5f520cb743d283e08746db4aff8c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:06.878764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 954/1937] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:06 2022] DELETE /identity/v3/users/0b3c5f520cb743d283e08746db4aff8c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:06.886397 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc5d3a-cb01-4cf7-b99c-00ae43b79a74 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:06.886971 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc5d3a-cb01-4cf7-b99c-00ae43b79a74 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:06.888332 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc5d3a-cb01-4cf7-b99c-00ae43b79a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:06.903594 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6786a-e7d4-4179-a388-d82b13deb369 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:06.908283 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-51f6786a-e7d4-4179-a388-d82b13deb369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:06.936535 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-abcc5d3a-cb01-4cf7-b99c-00ae43b79a74 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:06.939671 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-abcc5d3a-cb01-4cf7-b99c-00ae43b79a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:07.033104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6786a-e7d4-4179-a388-d82b13deb369 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:07.042743 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c5cd1-1801-4c0c-a656-2e987f854a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:07.044457 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c5cd1-1801-4c0c-a656-2e987f854a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:07.044987 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c5cd1-1801-4c0c-a656-2e987f854a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:07.045469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c5cd1-1801-4c0c-a656-2e987f854a9c admin admin] PATH_INFO: `/v3/projects/0ab54e5279d0463193abfe09cff6890a` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:07.059049 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:07.060913 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c5cd1-1801-4c0c-a656-2e987f854a9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ab54e5279d0463193abfe09cff6890a)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:07.067891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c5cd1-1801-4c0c-a656-2e987f854a9c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:07.173808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 984/1938] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:07.190069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7a4c5cd1-1801-4c0c-a656-2e987f854a9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ab54e5279d0463193abfe09cff6890a', 'request_id': 'req-7a4c5cd1-1801-4c0c-a656-2e987f854a9c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:07.198981 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7a4c5cd1-1801-4c0c-a656-2e987f854a9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ab54e5279d0463193abfe09cff6890a', 'request_id': 'req-7a4c5cd1-1801-4c0c-a656-2e987f854a9c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:07.211651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc5d3a-cb01-4cf7-b99c-00ae43b79a74 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:07.213320 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-abcc5d3a-cb01-4cf7-b99c-00ae43b79a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:07.222273 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7a4c5cd1-1801-4c0c-a656-2e987f854a9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ab54e5279d0463193abfe09cff6890a', 'request_id': 'req-7a4c5cd1-1801-4c0c-a656-2e987f854a9c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:07.248978 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7a4c5cd1-1801-4c0c-a656-2e987f854a9c admin admin] The token cache is being invalidate because project 0ab54e5279d0463193abfe09cff6890a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:07.249321 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7a4c5cd1-1801-4c0c-a656-2e987f854a9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:07.250073 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7a4c5cd1-1801-4c0c-a656-2e987f854a9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:07.255921 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 955/1939] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:06 2022] DELETE /identity/v3/projects/0ab54e5279d0463193abfe09cff6890a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:07.257076 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c5cd1-1801-4c0c-a656-2e987f854a9c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:07.258946 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7a4c5cd1-1801-4c0c-a656-2e987f854a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:07.360655 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc5d3a-cb01-4cf7-b99c-00ae43b79a74 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:07.374917 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c5cd1-1801-4c0c-a656-2e987f854a9c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:07.381505 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce9df4-81b7-42d9-90ff-c44da5a3099f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:07.382231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce9df4-81b7-42d9-90ff-c44da5a3099f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:07.382518 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce9df4-81b7-42d9-90ff-c44da5a3099f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:07.382916 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce9df4-81b7-42d9-90ff-c44da5a3099f admin admin] PATH_INFO: `/v3/users/5c3eccc4683c4dda84c6d777d563fe61` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:07.384733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce9df4-81b7-42d9-90ff-c44da5a3099f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c3eccc4683c4dda84c6d777d563fe61)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:07.387410 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce9df4-81b7-42d9-90ff-c44da5a3099f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:07.421002 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:07.431148 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f80ca6-ee1b-4f96-a935-c6896be079e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:07.432369 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f80ca6-ee1b-4f96-a935-c6896be079e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:07.432870 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f80ca6-ee1b-4f96-a935-c6896be079e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:07.433306 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f80ca6-ee1b-4f96-a935-c6896be079e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:07.435682 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-96f80ca6-ee1b-4f96-a935-c6896be079e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:07.454747 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f80ca6-ee1b-4f96-a935-c6896be079e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:07.457012 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f80ca6-ee1b-4f96-a935-c6896be079e9 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:07.471714 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 985/1940] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:36:07.526441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e9ce9df4-81b7-42d9-90ff-c44da5a3099f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c3eccc4683c4dda84c6d777d563fe61'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:07.568124 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e9ce9df4-81b7-42d9-90ff-c44da5a3099f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c3eccc4683c4dda84c6d777d563fe61'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:07.568962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e9ce9df4-81b7-42d9-90ff-c44da5a3099f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c3eccc4683c4dda84c6d777d563fe61'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:07.569619 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e9ce9df4-81b7-42d9-90ff-c44da5a3099f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c3eccc4683c4dda84c6d777d563fe61'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:07.588678 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e9ce9df4-81b7-42d9-90ff-c44da5a3099f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c3eccc4683c4dda84c6d777d563fe61'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:07.617216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 956/1941] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:07 2022] DELETE /identity/v3/users/5c3eccc4683c4dda84c6d777d563fe61 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:08.950270 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f80ca6-ee1b-4f96-a935-c6896be079e9 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:08.954064 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-96f80ca6-ee1b-4f96-a935-c6896be079e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:08.977471 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f80ca6-ee1b-4f96-a935-c6896be079e9 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:09.089448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c12cb-05ef-481e-9bfb-93fa721b4aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:09.090122 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c12cb-05ef-481e-9bfb-93fa721b4aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:09.090406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c12cb-05ef-481e-9bfb-93fa721b4aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:09.090660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c12cb-05ef-481e-9bfb-93fa721b4aaf admin admin] PATH_INFO: `/v3/projects/4ccc34afc640426796281f07d7b5eedf` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:09.095798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c12cb-05ef-481e-9bfb-93fa721b4aaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ccc34afc640426796281f07d7b5eedf)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:09.098418 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c12cb-05ef-481e-9bfb-93fa721b4aaf admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:09.204758 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:09.263182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-aa3c12cb-05ef-481e-9bfb-93fa721b4aaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ccc34afc640426796281f07d7b5eedf', 'request_id': 'req-aa3c12cb-05ef-481e-9bfb-93fa721b4aaf'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:09.273657 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-aa3c12cb-05ef-481e-9bfb-93fa721b4aaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ccc34afc640426796281f07d7b5eedf', 'request_id': 'req-aa3c12cb-05ef-481e-9bfb-93fa721b4aaf'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:09.290472 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-aa3c12cb-05ef-481e-9bfb-93fa721b4aaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ccc34afc640426796281f07d7b5eedf', 'request_id': 'req-aa3c12cb-05ef-481e-9bfb-93fa721b4aaf'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:09.317806 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-aa3c12cb-05ef-481e-9bfb-93fa721b4aaf admin admin] The token cache is being invalidate because project 4ccc34afc640426796281f07d7b5eedf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:09.319172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-aa3c12cb-05ef-481e-9bfb-93fa721b4aaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:09.320407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-aa3c12cb-05ef-481e-9bfb-93fa721b4aaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:09.324733 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 986/1942] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:08 2022] DELETE /identity/v3/projects/4ccc34afc640426796281f07d7b5eedf => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:09.331055 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce9df4-81b7-42d9-90ff-c44da5a3099f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:09.333541 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e9ce9df4-81b7-42d9-90ff-c44da5a3099f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:09.367493 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c12cb-05ef-481e-9bfb-93fa721b4aaf admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:09.370180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-aa3c12cb-05ef-481e-9bfb-93fa721b4aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:09.370992 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce9df4-81b7-42d9-90ff-c44da5a3099f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:09.531360 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144631b6-7347-42bf-a311-f605055f5b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:09.533091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144631b6-7347-42bf-a311-f605055f5b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:09.533611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144631b6-7347-42bf-a311-f605055f5b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:09.534041 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144631b6-7347-42bf-a311-f605055f5b6b admin admin] PATH_INFO: `/v3/users/742d17e7f0cb4b92b012e83961973cf7` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:09.535980 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144631b6-7347-42bf-a311-f605055f5b6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=742d17e7f0cb4b92b012e83961973cf7)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:09.543096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144631b6-7347-42bf-a311-f605055f5b6b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:09.565304 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c12cb-05ef-481e-9bfb-93fa721b4aaf admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:09.586939 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21f402-57ca-4e28-be1f-0ee2c3771fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:09.589289 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21f402-57ca-4e28-be1f-0ee2c3771fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:09.589870 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21f402-57ca-4e28-be1f-0ee2c3771fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:09.590336 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21f402-57ca-4e28-be1f-0ee2c3771fa5 admin admin] PATH_INFO: `/v3/projects/25b44348da6249b982886e0a673613d8` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:09.592374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21f402-57ca-4e28-be1f-0ee2c3771fa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25b44348da6249b982886e0a673613d8)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:09.595750 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21f402-57ca-4e28-be1f-0ee2c3771fa5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:09.688217 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-144631b6-7347-42bf-a311-f605055f5b6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '742d17e7f0cb4b92b012e83961973cf7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:09.737563 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4d21f402-57ca-4e28-be1f-0ee2c3771fa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25b44348da6249b982886e0a673613d8', 'request_id': 'req-4d21f402-57ca-4e28-be1f-0ee2c3771fa5'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:09.782221 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4d21f402-57ca-4e28-be1f-0ee2c3771fa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25b44348da6249b982886e0a673613d8', 'request_id': 'req-4d21f402-57ca-4e28-be1f-0ee2c3771fa5'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:09.789108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-144631b6-7347-42bf-a311-f605055f5b6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '742d17e7f0cb4b92b012e83961973cf7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:09.790420 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-144631b6-7347-42bf-a311-f605055f5b6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '742d17e7f0cb4b92b012e83961973cf7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:09.791453 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-144631b6-7347-42bf-a311-f605055f5b6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '742d17e7f0cb4b92b012e83961973cf7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:09.813907 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4d21f402-57ca-4e28-be1f-0ee2c3771fa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25b44348da6249b982886e0a673613d8', 'request_id': 'req-4d21f402-57ca-4e28-be1f-0ee2c3771fa5'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:09.838197 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-144631b6-7347-42bf-a311-f605055f5b6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '742d17e7f0cb4b92b012e83961973cf7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:09.868380 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4d21f402-57ca-4e28-be1f-0ee2c3771fa5 admin admin] The token cache is being invalidate because project 25b44348da6249b982886e0a673613d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:09.868694 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4d21f402-57ca-4e28-be1f-0ee2c3771fa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:09.869869 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4d21f402-57ca-4e28-be1f-0ee2c3771fa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:09.896771 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 987/1944] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:09 2022] DELETE /identity/v3/projects/25b44348da6249b982886e0a673613d8 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:36:09.899287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 957/1944] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:09 2022] DELETE /identity/v3/users/742d17e7f0cb4b92b012e83961973cf7 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:09.903192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa138fa-1a90-4a06-becf-1254b418d87f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:09.903927 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa138fa-1a90-4a06-becf-1254b418d87f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:09.904656 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa138fa-1a90-4a06-becf-1254b418d87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:10.006304 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5aa138fa-1a90-4a06-becf-1254b418d87f None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:10.008859 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5aa138fa-1a90-4a06-becf-1254b418d87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:10.139953 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:10.180146 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 988/1945] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:10.192130 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b311402-2bf4-48f8-acfd-d1d46bc00f93 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:10.192482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b311402-2bf4-48f8-acfd-d1d46bc00f93 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:10.192925 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b311402-2bf4-48f8-acfd-d1d46bc00f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:10.326555 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-6b311402-2bf4-48f8-acfd-d1d46bc00f93 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:10.328757 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6b311402-2bf4-48f8-acfd-d1d46bc00f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:10.355807 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 958/1946] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:10.363973 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa138fa-1a90-4a06-becf-1254b418d87f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:10.384873 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa138fa-1a90-4a06-becf-1254b418d87f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:10.397208 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd55f07-65c5-4a95-a955-c9a1146e00f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:10.398376 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd55f07-65c5-4a95-a955-c9a1146e00f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:10.398885 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd55f07-65c5-4a95-a955-c9a1146e00f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:10.399384 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd55f07-65c5-4a95-a955-c9a1146e00f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:10.400613 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd55f07-65c5-4a95-a955-c9a1146e00f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:36:10.401174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd55f07-65c5-4a95-a955-c9a1146e00f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:10.404813 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd55f07-65c5-4a95-a955-c9a1146e00f3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:10.433854 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 989/1947] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:36:10.444871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b311402-2bf4-48f8-acfd-d1d46bc00f93 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:10.453136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:10.468987 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b311402-2bf4-48f8-acfd-d1d46bc00f93 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:10.476138 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770dc27-a449-46d0-8b6e-c314d35f5138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:10.477263 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770dc27-a449-46d0-8b6e-c314d35f5138 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:10.477766 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770dc27-a449-46d0-8b6e-c314d35f5138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:10.478363 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770dc27-a449-46d0-8b6e-c314d35f5138 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:10.483470 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770dc27-a449-46d0-8b6e-c314d35f5138 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:10.491032 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770dc27-a449-46d0-8b6e-c314d35f5138 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:10.516107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd55f07-65c5-4a95-a955-c9a1146e00f3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:10.520255 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5dd55f07-65c5-4a95-a955-c9a1146e00f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:10.584419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd55f07-65c5-4a95-a955-c9a1146e00f3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:10.606888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbca60-e0da-4a8a-8ae7-d49d4b637cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:10.609442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbca60-e0da-4a8a-8ae7-d49d4b637cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:10.611732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 959/1948] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:36:10 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:10.612581 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbca60-e0da-4a8a-8ae7-d49d4b637cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:10.613396 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbca60-e0da-4a8a-8ae7-d49d4b637cf2 admin admin] PATH_INFO: `/v3/projects/c01bf1f47cf04ea3814cbbcec1daa658` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:10.614470 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770dc27-a449-46d0-8b6e-c314d35f5138 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:10.619406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbca60-e0da-4a8a-8ae7-d49d4b637cf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c01bf1f47cf04ea3814cbbcec1daa658)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:10.630003 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbca60-e0da-4a8a-8ae7-d49d4b637cf2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:10.788723 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bbcbca60-e0da-4a8a-8ae7-d49d4b637cf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c01bf1f47cf04ea3814cbbcec1daa658', 'request_id': 'req-bbcbca60-e0da-4a8a-8ae7-d49d4b637cf2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:10.806041 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770dc27-a449-46d0-8b6e-c314d35f5138 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:10.806387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bbcbca60-e0da-4a8a-8ae7-d49d4b637cf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c01bf1f47cf04ea3814cbbcec1daa658', 'request_id': 'req-bbcbca60-e0da-4a8a-8ae7-d49d4b637cf2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:10.822427 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bbcbca60-e0da-4a8a-8ae7-d49d4b637cf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c01bf1f47cf04ea3814cbbcec1daa658', 'request_id': 'req-bbcbca60-e0da-4a8a-8ae7-d49d4b637cf2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:10.847445 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bbcbca60-e0da-4a8a-8ae7-d49d4b637cf2 admin admin] The token cache is being invalidate because project c01bf1f47cf04ea3814cbbcec1daa658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:10.847927 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bbcbca60-e0da-4a8a-8ae7-d49d4b637cf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:10.849330 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bbcbca60-e0da-4a8a-8ae7-d49d4b637cf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:10.857861 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 990/1949] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:10 2022] DELETE /identity/v3/projects/c01bf1f47cf04ea3814cbbcec1daa658 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:36:10.860289 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbca60-e0da-4a8a-8ae7-d49d4b637cf2 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:10.862355 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bbcbca60-e0da-4a8a-8ae7-d49d4b637cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:10.993011 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800b0ec-e287-4096-9c61-d537c44e2169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:10.994849 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800b0ec-e287-4096-9c61-d537c44e2169 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:10.996756 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800b0ec-e287-4096-9c61-d537c44e2169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:10.998738 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800b0ec-e287-4096-9c61-d537c44e2169 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:11.002644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800b0ec-e287-4096-9c61-d537c44e2169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:11.011801 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800b0ec-e287-4096-9c61-d537c44e2169 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:11.095254 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbca60-e0da-4a8a-8ae7-d49d4b637cf2 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:11.107341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435f8c2-f5e7-4cf3-98ba-a0e1737a6549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:11.108188 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435f8c2-f5e7-4cf3-98ba-a0e1737a6549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:11.108611 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435f8c2-f5e7-4cf3-98ba-a0e1737a6549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:11.109024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435f8c2-f5e7-4cf3-98ba-a0e1737a6549 admin admin] PATH_INFO: `/v3/users/ec0698adc28241ecbde97b90bcf4d311` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:11.110508 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9435f8c2-f5e7-4cf3-98ba-a0e1737a6549 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec0698adc28241ecbde97b90bcf4d311)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:11.112722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9435f8c2-f5e7-4cf3-98ba-a0e1737a6549 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:11.116984 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 960/1950] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:36:10 2022] POST /identity/v3/users => generated 293 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:11.123735 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800b0ec-e287-4096-9c61-d537c44e2169 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:11.126990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0800b0ec-e287-4096-9c61-d537c44e2169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:11.167049 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800b0ec-e287-4096-9c61-d537c44e2169 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:11.190511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd415c6c-1bc1-4dde-9376-a505d336f0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:11.191170 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd415c6c-1bc1-4dde-9376-a505d336f0cc admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:11.191455 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd415c6c-1bc1-4dde-9376-a505d336f0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:11.191733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd415c6c-1bc1-4dde-9376-a505d336f0cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:11.192423 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd415c6c-1bc1-4dde-9376-a505d336f0cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:11.194713 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd415c6c-1bc1-4dde-9376-a505d336f0cc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:11.214653 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9435f8c2-f5e7-4cf3-98ba-a0e1737a6549 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec0698adc28241ecbde97b90bcf4d311'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:11.228285 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 961/1951] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:11.232298 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd415c6c-1bc1-4dde-9376-a505d336f0cc admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:11.239796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:11.241809 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9435f8c2-f5e7-4cf3-98ba-a0e1737a6549 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec0698adc28241ecbde97b90bcf4d311'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:11.243712 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9435f8c2-f5e7-4cf3-98ba-a0e1737a6549 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec0698adc28241ecbde97b90bcf4d311'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:11.251393 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd415c6c-1bc1-4dde-9376-a505d336f0cc admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:11.257876 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9435f8c2-f5e7-4cf3-98ba-a0e1737a6549 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec0698adc28241ecbde97b90bcf4d311'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:11.267316 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c7821-ad29-4b13-ba88-ae2b9c40ddc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:11.267960 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c7821-ad29-4b13-ba88-ae2b9c40ddc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:11.268243 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c7821-ad29-4b13-ba88-ae2b9c40ddc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:11.268712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c7821-ad29-4b13-ba88-ae2b9c40ddc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:11.269237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c7821-ad29-4b13-ba88-ae2b9c40ddc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:11.271183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c7821-ad29-4b13-ba88-ae2b9c40ddc7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:11.275721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9435f8c2-f5e7-4cf3-98ba-a0e1737a6549 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec0698adc28241ecbde97b90bcf4d311'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:11.293175 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 991/1952] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:10 2022] DELETE /identity/v3/users/ec0698adc28241ecbde97b90bcf4d311 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:11.306720 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 962/1953] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:11.322150 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435f8c2-f5e7-4cf3-98ba-a0e1737a6549 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:11.326704 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9435f8c2-f5e7-4cf3-98ba-a0e1737a6549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:11.537634 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435f8c2-f5e7-4cf3-98ba-a0e1737a6549 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:11.560613 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80167e63-2122-44fb-8aa6-96b0e70d21fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:11.561654 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80167e63-2122-44fb-8aa6-96b0e70d21fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:11.562085 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80167e63-2122-44fb-8aa6-96b0e70d21fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:11.562455 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80167e63-2122-44fb-8aa6-96b0e70d21fc admin admin] PATH_INFO: `/v3/projects/36f0eed240f5441bb7e5983d77c669b5/users/b93c1663f3b34ab7b86e4410860d7e3d/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:11.649357 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80167e63-2122-44fb-8aa6-96b0e70d21fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f0eed240f5441bb7e5983d77c669b5, user_id=b93c1663f3b34ab7b86e4410860d7e3d, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:11.653301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80167e63-2122-44fb-8aa6-96b0e70d21fc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:11.675663 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 992/1954] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:11 2022] PUT /identity/v3/projects/36f0eed240f5441bb7e5983d77c669b5/users/b93c1663f3b34ab7b86e4410860d7e3d/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:11.695291 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda9f51-25ed-4d19-9e12-a38cf0fb640a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:11.696793 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda9f51-25ed-4d19-9e12-a38cf0fb640a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:11.697579 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda9f51-25ed-4d19-9e12-a38cf0fb640a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:11.775265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-afda9f51-25ed-4d19-9e12-a38cf0fb640a None None] MFA Rules not processed for user `b93c1663f3b34ab7b86e4410860d7e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:11.778141 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-afda9f51-25ed-4d19-9e12-a38cf0fb640a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:11.939468 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:11.947694 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80167e63-2122-44fb-8aa6-96b0e70d21fc admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:11.955315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-80167e63-2122-44fb-8aa6-96b0e70d21fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:11.982501 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 963/1955] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:11.986797 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda9f51-25ed-4d19-9e12-a38cf0fb640a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:12.161601 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80167e63-2122-44fb-8aa6-96b0e70d21fc admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:12.171440 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda9f51-25ed-4d19-9e12-a38cf0fb640a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:12.171782 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a3d77-626e-4a03-9f31-ce72173720d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:12.172989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a3d77-626e-4a03-9f31-ce72173720d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:12.173480 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a3d77-626e-4a03-9f31-ce72173720d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:12.173951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a3d77-626e-4a03-9f31-ce72173720d7 admin admin] PATH_INFO: `/v3/projects/f4d3053a080144c69afc9c5a0bb206ab` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:12.176186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a3d77-626e-4a03-9f31-ce72173720d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4d3053a080144c69afc9c5a0bb206ab)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:12.180231 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a3d77-626e-4a03-9f31-ce72173720d7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:12.195836 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545414e-c50c-48dd-841a-d9514449cc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:12.197697 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545414e-c50c-48dd-841a-d9514449cc9f admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:12.198463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545414e-c50c-48dd-841a-d9514449cc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:12.199945 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545414e-c50c-48dd-841a-d9514449cc9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:12.202502 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545414e-c50c-48dd-841a-d9514449cc9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:12.210307 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545414e-c50c-48dd-841a-d9514449cc9f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:12.292163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ac7a3d77-626e-4a03-9f31-ce72173720d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4d3053a080144c69afc9c5a0bb206ab', 'request_id': 'req-ac7a3d77-626e-4a03-9f31-ce72173720d7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:12.307127 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 964/1956] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:36:11 2022] POST /identity/v3/projects => generated 383 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:12.307913 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ac7a3d77-626e-4a03-9f31-ce72173720d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4d3053a080144c69afc9c5a0bb206ab', 'request_id': 'req-ac7a3d77-626e-4a03-9f31-ce72173720d7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:12.311977 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545414e-c50c-48dd-841a-d9514449cc9f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:12.328927 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ac7a3d77-626e-4a03-9f31-ce72173720d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4d3053a080144c69afc9c5a0bb206ab', 'request_id': 'req-ac7a3d77-626e-4a03-9f31-ce72173720d7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:12.339178 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:12.360453 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ac7a3d77-626e-4a03-9f31-ce72173720d7 admin admin] The token cache is being invalidate because project f4d3053a080144c69afc9c5a0bb206ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:12.361924 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ac7a3d77-626e-4a03-9f31-ce72173720d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:12.363423 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ac7a3d77-626e-4a03-9f31-ce72173720d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:12.370419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 993/1957] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:11 2022] DELETE /identity/v3/projects/f4d3053a080144c69afc9c5a0bb206ab => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:12.386518 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420e44e-ba7b-4fa5-8af3-9b6618143533 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:12.388789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420e44e-ba7b-4fa5-8af3-9b6618143533 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:12.389668 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420e44e-ba7b-4fa5-8af3-9b6618143533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:12.430175 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f420e44e-ba7b-4fa5-8af3-9b6618143533 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:12.432784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f420e44e-ba7b-4fa5-8af3-9b6618143533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:12.493472 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545414e-c50c-48dd-841a-d9514449cc9f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:12.502817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811289e3-a1b7-41fd-a32d-edb0044934cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:12.503917 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811289e3-a1b7-41fd-a32d-edb0044934cc admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:12.504431 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811289e3-a1b7-41fd-a32d-edb0044934cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:12.504978 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811289e3-a1b7-41fd-a32d-edb0044934cc admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:12.506204 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811289e3-a1b7-41fd-a32d-edb0044934cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:12.510393 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811289e3-a1b7-41fd-a32d-edb0044934cc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:12.556047 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 965/1958] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:36:12 2022] POST /identity/v3/users => generated 298 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:36:12.575151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 994/1959] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:12.575845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811289e3-a1b7-41fd-a32d-edb0044934cc admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:12.576081 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-811289e3-a1b7-41fd-a32d-edb0044934cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:12.577751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62359c-f4c2-43cc-92ea-ebbb31432efb None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:12.578464 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62359c-f4c2-43cc-92ea-ebbb31432efb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:12.578746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62359c-f4c2-43cc-92ea-ebbb31432efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:12.602793 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811289e3-a1b7-41fd-a32d-edb0044934cc admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:12.615627 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6d62359c-f4c2-43cc-92ea-ebbb31432efb None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:12.622955 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6d62359c-f4c2-43cc-92ea-ebbb31432efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:12.657528 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53001f64-a796-4430-8057-ffd52f5a6919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:12.658592 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53001f64-a796-4430-8057-ffd52f5a6919 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:12.659084 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53001f64-a796-4430-8057-ffd52f5a6919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:12.659925 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53001f64-a796-4430-8057-ffd52f5a6919 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:12.661685 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 995/1960] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:12.667490 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53001f64-a796-4430-8057-ffd52f5a6919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:12.667872 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53001f64-a796-4430-8057-ffd52f5a6919 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:12.669149 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62359c-f4c2-43cc-92ea-ebbb31432efb None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:12.722206 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 966/1961] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:12.722743 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62359c-f4c2-43cc-92ea-ebbb31432efb None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:12.725451 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53001f64-a796-4430-8057-ffd52f5a6919 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:12.735171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ee987-b7c5-4576-b24c-6ff716ae06a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:12.742426 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ee987-b7c5-4576-b24c-6ff716ae06a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:12.745547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ee987-b7c5-4576-b24c-6ff716ae06a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:12.746728 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ee987-b7c5-4576-b24c-6ff716ae06a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:12.748752 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ee987-b7c5-4576-b24c-6ff716ae06a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:36:12.750119 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ee987-b7c5-4576-b24c-6ff716ae06a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:12.752442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ee987-b7c5-4576-b24c-6ff716ae06a3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:12.768258 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53001f64-a796-4430-8057-ffd52f5a6919 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:12.789631 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 996/1962] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:36:12.798416 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ee987-b7c5-4576-b24c-6ff716ae06a3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:12.821061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ef830-1a17-425d-b3aa-7aae0b4a7895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:12.822030 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ef830-1a17-425d-b3aa-7aae0b4a7895 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:12.822510 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ef830-1a17-425d-b3aa-7aae0b4a7895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:12.823018 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ef830-1a17-425d-b3aa-7aae0b4a7895 admin admin] PATH_INFO: `/v3/projects/73adf51c3a0d45b2845c7b45ac0fcc6c/users/642dcd7e99564428bca85c12bfb2f3be/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:12.858971 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ee987-b7c5-4576-b24c-6ff716ae06a3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:12.881325 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70954dad-7d34-40d7-9e65-f02360235669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:12.882585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70954dad-7d34-40d7-9e65-f02360235669 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:12.886157 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70954dad-7d34-40d7-9e65-f02360235669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:12.890174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70954dad-7d34-40d7-9e65-f02360235669 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:12.891766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70954dad-7d34-40d7-9e65-f02360235669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:12.902979 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ef830-1a17-425d-b3aa-7aae0b4a7895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73adf51c3a0d45b2845c7b45ac0fcc6c, user_id=642dcd7e99564428bca85c12bfb2f3be, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:12.904381 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70954dad-7d34-40d7-9e65-f02360235669 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:12.909236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ef830-1a17-425d-b3aa-7aae0b4a7895 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:12.964703 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 967/1963] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:12 2022] PUT /identity/v3/projects/73adf51c3a0d45b2845c7b45ac0fcc6c/users/642dcd7e99564428bca85c12bfb2f3be/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:12.976549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ef830-1a17-425d-b3aa-7aae0b4a7895 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:13.099877 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:13.132696 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 997/1964] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:36:12 2022] POST /identity/v3/projects => generated 387 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:13.145368 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70954dad-7d34-40d7-9e65-f02360235669 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:13.238086 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ef830-1a17-425d-b3aa-7aae0b4a7895 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:13.458073 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdc73e-ae3b-43b6-bee9-84d5ab6836be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:13.459785 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdc73e-ae3b-43b6-bee9-84d5ab6836be admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:13.460545 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdc73e-ae3b-43b6-bee9-84d5ab6836be admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:13.461411 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdc73e-ae3b-43b6-bee9-84d5ab6836be admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:13.463708 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffdc73e-ae3b-43b6-bee9-84d5ab6836be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:13.469848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffdc73e-ae3b-43b6-bee9-84d5ab6836be admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:13.470524 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70954dad-7d34-40d7-9e65-f02360235669 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:13.492959 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61490e2f-369b-4f8c-9f45-bd7a9f0b514c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:13.500713 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61490e2f-369b-4f8c-9f45-bd7a9f0b514c admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:13.501559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61490e2f-369b-4f8c-9f45-bd7a9f0b514c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:13.502272 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61490e2f-369b-4f8c-9f45-bd7a9f0b514c admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:13.503207 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 968/1965] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 528 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:13.504681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61490e2f-369b-4f8c-9f45-bd7a9f0b514c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:13.508418 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdc73e-ae3b-43b6-bee9-84d5ab6836be admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:13.515329 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61490e2f-369b-4f8c-9f45-bd7a9f0b514c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:13.536321 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdc73e-ae3b-43b6-bee9-84d5ab6836be admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:13.546732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8d3b5-9a38-48d0-8d2e-a28124e38c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:13.548074 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8d3b5-9a38-48d0-8d2e-a28124e38c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:13.549305 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8d3b5-9a38-48d0-8d2e-a28124e38c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:13.550438 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8d3b5-9a38-48d0-8d2e-a28124e38c21 admin admin] PATH_INFO: `/v3/projects/73adf51c3a0d45b2845c7b45ac0fcc6c/users/642dcd7e99564428bca85c12bfb2f3be/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:13.565642 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8d3b5-9a38-48d0-8d2e-a28124e38c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73adf51c3a0d45b2845c7b45ac0fcc6c, user_id=642dcd7e99564428bca85c12bfb2f3be, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:13.568662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8d3b5-9a38-48d0-8d2e-a28124e38c21 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:13.585741 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 998/1966] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:36:13 2022] POST /identity/v3/users => generated 294 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:13.590316 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61490e2f-369b-4f8c-9f45-bd7a9f0b514c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:13.624050 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 969/1967] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:13 2022] PUT /identity/v3/projects/73adf51c3a0d45b2845c7b45ac0fcc6c/users/642dcd7e99564428bca85c12bfb2f3be/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:13.646041 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61490e2f-369b-4f8c-9f45-bd7a9f0b514c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:13.658205 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7a96f-2675-40f6-8f2c-8c10bfc19410 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:13.659411 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7a96f-2675-40f6-8f2c-8c10bfc19410 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:13.659917 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7a96f-2675-40f6-8f2c-8c10bfc19410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:13.783824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1da7a96f-2675-40f6-8f2c-8c10bfc19410 None None] MFA Rules not processed for user `642dcd7e99564428bca85c12bfb2f3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:13.787771 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1da7a96f-2675-40f6-8f2c-8c10bfc19410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:13.794642 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:13.831300 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abcc35-490c-451e-8097-120eb1152a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:13.832110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abcc35-490c-451e-8097-120eb1152a38 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:13.832515 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abcc35-490c-451e-8097-120eb1152a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:13.832926 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abcc35-490c-451e-8097-120eb1152a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:13.833723 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04abcc35-490c-451e-8097-120eb1152a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:13.840270 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04abcc35-490c-451e-8097-120eb1152a38 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:13.878260 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 999/1968] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:13.879956 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abcc35-490c-451e-8097-120eb1152a38 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:13.900336 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abcc35-490c-451e-8097-120eb1152a38 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:13.915704 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5449a5-6258-49cd-b35b-ff35bc57bea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:13.916347 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5449a5-6258-49cd-b35b-ff35bc57bea6 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:13.916656 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5449a5-6258-49cd-b35b-ff35bc57bea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:13.916924 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5449a5-6258-49cd-b35b-ff35bc57bea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:13.917593 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5449a5-6258-49cd-b35b-ff35bc57bea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:13.919980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5449a5-6258-49cd-b35b-ff35bc57bea6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:13.961172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1000/1969] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:13.967011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5449a5-6258-49cd-b35b-ff35bc57bea6 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:13.982055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5449a5-6258-49cd-b35b-ff35bc57bea6 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:13.993768 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591dbdf4-b02f-45da-8805-2c1b0cd32be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:13.996964 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dbdf4-b02f-45da-8805-2c1b0cd32be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:13.997826 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dbdf4-b02f-45da-8805-2c1b0cd32be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:13.998309 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dbdf4-b02f-45da-8805-2c1b0cd32be8 admin admin] PATH_INFO: `/v3/projects/82810ddf8914439699212261a7cc4747/users/d7121232f8e04bef87a129f367b178ab/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:14.062522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591dbdf4-b02f-45da-8805-2c1b0cd32be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82810ddf8914439699212261a7cc4747, user_id=d7121232f8e04bef87a129f367b178ab, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:14.066243 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591dbdf4-b02f-45da-8805-2c1b0cd32be8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:14.113653 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1001/1970] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:13 2022] PUT /identity/v3/projects/82810ddf8914439699212261a7cc4747/users/d7121232f8e04bef87a129f367b178ab/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:36:14.144465 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70eab50-a0f6-4d2c-9296-2c506bca5a07 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:14.145229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70eab50-a0f6-4d2c-9296-2c506bca5a07 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:14.145713 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70eab50-a0f6-4d2c-9296-2c506bca5a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:14.242042 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e70eab50-a0f6-4d2c-9296-2c506bca5a07 None None] MFA Rules not processed for user `d7121232f8e04bef87a129f367b178ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:14.243835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e70eab50-a0f6-4d2c-9296-2c506bca5a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:14.291544 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 970/1971] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 645 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:14.314401 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7a96f-2675-40f6-8f2c-8c10bfc19410 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:14.318417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1da7a96f-2675-40f6-8f2c-8c10bfc19410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:14.464159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1002/1972] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:14.471288 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70eab50-a0f6-4d2c-9296-2c506bca5a07 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:14.541824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:14.577849 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7a96f-2675-40f6-8f2c-8c10bfc19410 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:14.655547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70eab50-a0f6-4d2c-9296-2c506bca5a07 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:14.674897 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acaa98-ded7-4530-9de6-f5ea6c83bbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:14.675192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acaa98-ded7-4530-9de6-f5ea6c83bbbf admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:14.675381 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acaa98-ded7-4530-9de6-f5ea6c83bbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:14.675663 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acaa98-ded7-4530-9de6-f5ea6c83bbbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:14.676331 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acaa98-ded7-4530-9de6-f5ea6c83bbbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:14.681861 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acaa98-ded7-4530-9de6-f5ea6c83bbbf admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:14.701001 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127550b-82f3-44c5-bb16-c5a4807e5f20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:14.701651 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127550b-82f3-44c5-bb16-c5a4807e5f20 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:14.701928 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127550b-82f3-44c5-bb16-c5a4807e5f20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:14.702199 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127550b-82f3-44c5-bb16-c5a4807e5f20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:14.704322 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1127550b-82f3-44c5-bb16-c5a4807e5f20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:14.793690 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1003/1973] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:36:14 2022] POST /identity/v3/projects => generated 387 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:36:14.800257 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acaa98-ded7-4530-9de6-f5ea6c83bbbf admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:14.858239 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:14.942872 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127550b-82f3-44c5-bb16-c5a4807e5f20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:14.946531 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127550b-82f3-44c5-bb16-c5a4807e5f20 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:14.971157 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acaa98-ded7-4530-9de6-f5ea6c83bbbf admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:14.972826 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 971/1974] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:14.993903 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6241308-55b8-4f53-b272-7bab88523e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:14.998685 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6241308-55b8-4f53-b272-7bab88523e19 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:15.001019 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6241308-55b8-4f53-b272-7bab88523e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:15.001946 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6241308-55b8-4f53-b272-7bab88523e19 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:15.003684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6241308-55b8-4f53-b272-7bab88523e19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:15.010287 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6241308-55b8-4f53-b272-7bab88523e19 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:15.065914 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1004/1975] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:36:14 2022] POST /identity/v3/users => generated 300 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:15.067125 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127550b-82f3-44c5-bb16-c5a4807e5f20 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:15.094178 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127550b-82f3-44c5-bb16-c5a4807e5f20 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:15.112799 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6bc1f-6484-44d1-9f45-c48845a347ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:15.113797 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6bc1f-6484-44d1-9f45-c48845a347ff admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:15.114991 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6bc1f-6484-44d1-9f45-c48845a347ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:15.114991 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6bc1f-6484-44d1-9f45-c48845a347ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:15.114991 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6bc1f-6484-44d1-9f45-c48845a347ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:15.116823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6bc1f-6484-44d1-9f45-c48845a347ff admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:15.160346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6241308-55b8-4f53-b272-7bab88523e19 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:15.161067 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 972/1976] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:36:15.191536 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6241308-55b8-4f53-b272-7bab88523e19 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:15.212835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6633a1e-4050-427e-b4fd-3bb4e969acbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:15.213122 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6633a1e-4050-427e-b4fd-3bb4e969acbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:15.213563 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6633a1e-4050-427e-b4fd-3bb4e969acbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:15.214011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6633a1e-4050-427e-b4fd-3bb4e969acbd admin admin] PATH_INFO: `/v3/projects/fcdac95589474eacb9bd4c020a72687c/users/bdfffd27b48a4d9a9b14e9a513557066/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:15.246669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6633a1e-4050-427e-b4fd-3bb4e969acbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcdac95589474eacb9bd4c020a72687c, user_id=bdfffd27b48a4d9a9b14e9a513557066, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:15.267847 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6633a1e-4050-427e-b4fd-3bb4e969acbd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:15.303839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1005/1977] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:15 2022] PUT /identity/v3/projects/fcdac95589474eacb9bd4c020a72687c/users/bdfffd27b48a4d9a9b14e9a513557066/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:15.305135 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6bc1f-6484-44d1-9f45-c48845a347ff admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:15.317138 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6bc1f-6484-44d1-9f45-c48845a347ff admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:15.474915 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa6d04-d9e0-418d-86f9-e4104bb7e57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:15.476170 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa6d04-d9e0-418d-86f9-e4104bb7e57b admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:15.476691 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa6d04-d9e0-418d-86f9-e4104bb7e57b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:15.477179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa6d04-d9e0-418d-86f9-e4104bb7e57b admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:15.478387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa6d04-d9e0-418d-86f9-e4104bb7e57b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:15.488005 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa6d04-d9e0-418d-86f9-e4104bb7e57b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:15.524829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 973/1978] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:36:15.526691 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6633a1e-4050-427e-b4fd-3bb4e969acbd admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:15.551533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6633a1e-4050-427e-b4fd-3bb4e969acbd admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:15.570998 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff481e8-0948-4002-bf2d-7a132e32f08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:15.571705 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff481e8-0948-4002-bf2d-7a132e32f08a admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:15.573504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff481e8-0948-4002-bf2d-7a132e32f08a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:15.573921 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff481e8-0948-4002-bf2d-7a132e32f08a admin admin] PATH_INFO: `/v3/projects/fcdac95589474eacb9bd4c020a72687c/users/bdfffd27b48a4d9a9b14e9a513557066/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:15.584425 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff481e8-0948-4002-bf2d-7a132e32f08a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcdac95589474eacb9bd4c020a72687c, user_id=bdfffd27b48a4d9a9b14e9a513557066, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:15.593060 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff481e8-0948-4002-bf2d-7a132e32f08a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:15.629831 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1006/1979] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:15 2022] PUT /identity/v3/projects/fcdac95589474eacb9bd4c020a72687c/users/bdfffd27b48a4d9a9b14e9a513557066/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:15.636943 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcf649-10b6-4fa8-8437-0037514034c5 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:15.637443 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcf649-10b6-4fa8-8437-0037514034c5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:15.638233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcf649-10b6-4fa8-8437-0037514034c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:15.773727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-83dcf649-10b6-4fa8-8437-0037514034c5 None None] MFA Rules not processed for user `bdfffd27b48a4d9a9b14e9a513557066`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:15.792278 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-83dcf649-10b6-4fa8-8437-0037514034c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:15.931057 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:16.111505 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 974/1980] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:16.128023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff481e8-0948-4002-bf2d-7a132e32f08a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:16.334306 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff481e8-0948-4002-bf2d-7a132e32f08a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:16.348432 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b238484-c590-49a9-a562-f2dadd6bd026 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:16.350349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b238484-c590-49a9-a562-f2dadd6bd026 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:16.355905 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b238484-c590-49a9-a562-f2dadd6bd026 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:16.357427 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b238484-c590-49a9-a562-f2dadd6bd026 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:16.381999 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b238484-c590-49a9-a562-f2dadd6bd026 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:16.385616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b238484-c590-49a9-a562-f2dadd6bd026 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:16.399294 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1007/1981] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:18.026648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcf649-10b6-4fa8-8437-0037514034c5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:18.031036 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-83dcf649-10b6-4fa8-8437-0037514034c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:18.050064 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b238484-c590-49a9-a562-f2dadd6bd026 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:18.268937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcf649-10b6-4fa8-8437-0037514034c5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:18.283467 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388ff38-b275-48f0-a403-9cf0bfc5aec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:18.287488 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388ff38-b275-48f0-a403-9cf0bfc5aec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:18.289161 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388ff38-b275-48f0-a403-9cf0bfc5aec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:18.289586 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388ff38-b275-48f0-a403-9cf0bfc5aec1 admin admin] PATH_INFO: `/v3/users/b3561526f75949b1b7b09f74436b36f5` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:18.293108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388ff38-b275-48f0-a403-9cf0bfc5aec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3561526f75949b1b7b09f74436b36f5)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:18.295815 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388ff38-b275-48f0-a403-9cf0bfc5aec1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:18.313961 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b238484-c590-49a9-a562-f2dadd6bd026 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:18.329519 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5503c-18ad-4623-a367-d3f241e3b0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:18.330201 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5503c-18ad-4623-a367-d3f241e3b0c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:18.330486 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5503c-18ad-4623-a367-d3f241e3b0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:18.330767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5503c-18ad-4623-a367-d3f241e3b0c5 admin admin] PATH_INFO: `/v3/users/d7121232f8e04bef87a129f367b178ab` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:18.333374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5503c-18ad-4623-a367-d3f241e3b0c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7121232f8e04bef87a129f367b178ab)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:18.337801 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5503c-18ad-4623-a367-d3f241e3b0c5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:18.397889 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:18.438181 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e388ff38-b275-48f0-a403-9cf0bfc5aec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3561526f75949b1b7b09f74436b36f5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:18.486283 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9fe5503c-18ad-4623-a367-d3f241e3b0c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7121232f8e04bef87a129f367b178ab'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:18.490774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e388ff38-b275-48f0-a403-9cf0bfc5aec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3561526f75949b1b7b09f74436b36f5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:18.492236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e388ff38-b275-48f0-a403-9cf0bfc5aec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3561526f75949b1b7b09f74436b36f5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:18.514573 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e388ff38-b275-48f0-a403-9cf0bfc5aec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3561526f75949b1b7b09f74436b36f5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:18.519881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9fe5503c-18ad-4623-a367-d3f241e3b0c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7121232f8e04bef87a129f367b178ab'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:18.523434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9fe5503c-18ad-4623-a367-d3f241e3b0c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7121232f8e04bef87a129f367b178ab'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:18.540485 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e388ff38-b275-48f0-a403-9cf0bfc5aec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3561526f75949b1b7b09f74436b36f5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:18.548157 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9fe5503c-18ad-4623-a367-d3f241e3b0c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7121232f8e04bef87a129f367b178ab'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:18.570984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9fe5503c-18ad-4623-a367-d3f241e3b0c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7121232f8e04bef87a129f367b178ab'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:18.579999 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1008/1983] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:18 2022] DELETE /identity/v3/users/d7121232f8e04bef87a129f367b178ab => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:18.580960 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 975/1983] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:18 2022] DELETE /identity/v3/users/b3561526f75949b1b7b09f74436b36f5 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:18.588552 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd6c81-de0a-40cb-89f9-eb4e7a03da36 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:18.588552 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd6c81-de0a-40cb-89f9-eb4e7a03da36 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:18.588552 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd6c81-de0a-40cb-89f9-eb4e7a03da36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:18.589912 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e906a-ef82-4441-8a6c-7b55f5c7313e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:18.590711 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e906a-ef82-4441-8a6c-7b55f5c7313e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:18.595793 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e906a-ef82-4441-8a6c-7b55f5c7313e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:18.632751 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-65cd6c81-de0a-40cb-89f9-eb4e7a03da36 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:18.634081 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-65cd6c81-de0a-40cb-89f9-eb4e7a03da36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:18.640123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-cc6e906a-ef82-4441-8a6c-7b55f5c7313e None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:18.641710 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cc6e906a-ef82-4441-8a6c-7b55f5c7313e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:18.709789 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:18.753067 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 976/1984] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:18.769996 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd6c81-de0a-40cb-89f9-eb4e7a03da36 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:18.772162 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-65cd6c81-de0a-40cb-89f9-eb4e7a03da36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:18.852747 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1009/1985] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:18.879585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e906a-ef82-4441-8a6c-7b55f5c7313e None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:18.882885 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cc6e906a-ef82-4441-8a6c-7b55f5c7313e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:18.900547 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd6c81-de0a-40cb-89f9-eb4e7a03da36 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:18.907222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d156e3-8a59-4853-8265-cbb712a3dace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:18.908006 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d156e3-8a59-4853-8265-cbb712a3dace service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:18.908289 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d156e3-8a59-4853-8265-cbb712a3dace service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:18.908686 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d156e3-8a59-4853-8265-cbb712a3dace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:18.910738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e906a-ef82-4441-8a6c-7b55f5c7313e None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:18.918284 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db01909-ed9e-4a9c-ba56-a1153296c9f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:18.921243 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db01909-ed9e-4a9c-ba56-a1153296c9f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:18.922282 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db01909-ed9e-4a9c-ba56-a1153296c9f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:18.923138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db01909-ed9e-4a9c-ba56-a1153296c9f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:18.937355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d156e3-8a59-4853-8265-cbb712a3dace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:18.940530 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d156e3-8a59-4853-8265-cbb712a3dace service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:18.973642 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 977/1986] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:18.981200 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db01909-ed9e-4a9c-ba56-a1153296c9f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:18.983710 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db01909-ed9e-4a9c-ba56-a1153296c9f0 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:19.008166 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1010/1987] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:20.128917 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d156e3-8a59-4853-8265-cbb712a3dace service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:20.130392 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-82d156e3-8a59-4853-8265-cbb712a3dace service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:20.153411 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d156e3-8a59-4853-8265-cbb712a3dace service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:20.162112 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38c469-73f6-4242-bbc6-acf920ef58bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:20.162836 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38c469-73f6-4242-bbc6-acf920ef58bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:20.163162 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38c469-73f6-4242-bbc6-acf920ef58bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:20.164471 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38c469-73f6-4242-bbc6-acf920ef58bc admin admin] PATH_INFO: `/v3/projects/18d2e765fc8e4c74910752f153671518` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:20.166056 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38c469-73f6-4242-bbc6-acf920ef58bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=18d2e765fc8e4c74910752f153671518)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:20.168481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38c469-73f6-4242-bbc6-acf920ef58bc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:20.259363 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5c38c469-73f6-4242-bbc6-acf920ef58bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18d2e765fc8e4c74910752f153671518', 'request_id': 'req-5c38c469-73f6-4242-bbc6-acf920ef58bc'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:20.270663 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5c38c469-73f6-4242-bbc6-acf920ef58bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18d2e765fc8e4c74910752f153671518', 'request_id': 'req-5c38c469-73f6-4242-bbc6-acf920ef58bc'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:20.288256 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5c38c469-73f6-4242-bbc6-acf920ef58bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18d2e765fc8e4c74910752f153671518', 'request_id': 'req-5c38c469-73f6-4242-bbc6-acf920ef58bc'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:20.312572 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5c38c469-73f6-4242-bbc6-acf920ef58bc admin admin] The token cache is being invalidate because project 18d2e765fc8e4c74910752f153671518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:20.312906 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5c38c469-73f6-4242-bbc6-acf920ef58bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:20.313716 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5c38c469-73f6-4242-bbc6-acf920ef58bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:20.315879 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 978/1988] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:20 2022] DELETE /identity/v3/projects/18d2e765fc8e4c74910752f153671518 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:36:20.320367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db01909-ed9e-4a9c-ba56-a1153296c9f0 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:20.332802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38c469-73f6-4242-bbc6-acf920ef58bc admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:20.334487 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5c38c469-73f6-4242-bbc6-acf920ef58bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:20.343150 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db01909-ed9e-4a9c-ba56-a1153296c9f0 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:20.463999 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504a697-9d34-4699-afc2-dc92169d8d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:20.464283 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38c469-73f6-4242-bbc6-acf920ef58bc admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:20.465245 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504a697-9d34-4699-afc2-dc92169d8d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:20.465245 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504a697-9d34-4699-afc2-dc92169d8d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:20.465565 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504a697-9d34-4699-afc2-dc92169d8d6b admin admin] PATH_INFO: `/v3/users/5800c285578f4afdbeadf33e0e03fe88` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:20.467859 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504a697-9d34-4699-afc2-dc92169d8d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5800c285578f4afdbeadf33e0e03fe88)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:20.470154 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504a697-9d34-4699-afc2-dc92169d8d6b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:20.474550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817396e-9f8d-4042-8cfc-0c9f1cb993a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:20.475754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817396e-9f8d-4042-8cfc-0c9f1cb993a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:20.477425 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817396e-9f8d-4042-8cfc-0c9f1cb993a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:20.477425 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817396e-9f8d-4042-8cfc-0c9f1cb993a5 admin admin] PATH_INFO: `/v3/projects/82810ddf8914439699212261a7cc4747` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:20.479290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817396e-9f8d-4042-8cfc-0c9f1cb993a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82810ddf8914439699212261a7cc4747)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:20.483374 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817396e-9f8d-4042-8cfc-0c9f1cb993a5 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:20.500934 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:20.506517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:20.582271 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b504a697-9d34-4699-afc2-dc92169d8d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5800c285578f4afdbeadf33e0e03fe88'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:20.628339 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2817396e-9f8d-4042-8cfc-0c9f1cb993a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82810ddf8914439699212261a7cc4747', 'request_id': 'req-2817396e-9f8d-4042-8cfc-0c9f1cb993a5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:20.631746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b504a697-9d34-4699-afc2-dc92169d8d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5800c285578f4afdbeadf33e0e03fe88'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:20.635997 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b504a697-9d34-4699-afc2-dc92169d8d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5800c285578f4afdbeadf33e0e03fe88'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:20.653043 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2817396e-9f8d-4042-8cfc-0c9f1cb993a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82810ddf8914439699212261a7cc4747', 'request_id': 'req-2817396e-9f8d-4042-8cfc-0c9f1cb993a5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:20.657632 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b504a697-9d34-4699-afc2-dc92169d8d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5800c285578f4afdbeadf33e0e03fe88'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:20.670153 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2817396e-9f8d-4042-8cfc-0c9f1cb993a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82810ddf8914439699212261a7cc4747', 'request_id': 'req-2817396e-9f8d-4042-8cfc-0c9f1cb993a5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:20.675012 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b504a697-9d34-4699-afc2-dc92169d8d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5800c285578f4afdbeadf33e0e03fe88'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:20.693215 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1011/1989] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:20 2022] DELETE /identity/v3/users/5800c285578f4afdbeadf33e0e03fe88 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:20.711874 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2817396e-9f8d-4042-8cfc-0c9f1cb993a5 admin admin] The token cache is being invalidate because project 82810ddf8914439699212261a7cc4747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:20.712182 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2817396e-9f8d-4042-8cfc-0c9f1cb993a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:20.713510 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2817396e-9f8d-4042-8cfc-0c9f1cb993a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:20.715814 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 979/1990] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:20 2022] DELETE /identity/v3/projects/82810ddf8914439699212261a7cc4747 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:20.729004 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504a697-9d34-4699-afc2-dc92169d8d6b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:20.729004 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b504a697-9d34-4699-afc2-dc92169d8d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:20.946334 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504a697-9d34-4699-afc2-dc92169d8d6b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:20.958921 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915142c4-4e07-4404-bdcc-4893b8c3ff5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:20.961423 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915142c4-4e07-4404-bdcc-4893b8c3ff5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:20.962024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915142c4-4e07-4404-bdcc-4893b8c3ff5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:20.962594 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915142c4-4e07-4404-bdcc-4893b8c3ff5a admin admin] PATH_INFO: `/v3/users/bdfffd27b48a4d9a9b14e9a513557066` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:20.965302 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915142c4-4e07-4404-bdcc-4893b8c3ff5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdfffd27b48a4d9a9b14e9a513557066)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:20.970144 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915142c4-4e07-4404-bdcc-4893b8c3ff5a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:21.077138 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817396e-9f8d-4042-8cfc-0c9f1cb993a5 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:21.079276 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2817396e-9f8d-4042-8cfc-0c9f1cb993a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:21.093835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-915142c4-4e07-4404-bdcc-4893b8c3ff5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdfffd27b48a4d9a9b14e9a513557066'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:21.113795 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-915142c4-4e07-4404-bdcc-4893b8c3ff5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdfffd27b48a4d9a9b14e9a513557066'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:21.115386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-915142c4-4e07-4404-bdcc-4893b8c3ff5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdfffd27b48a4d9a9b14e9a513557066'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:21.130877 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-915142c4-4e07-4404-bdcc-4893b8c3ff5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdfffd27b48a4d9a9b14e9a513557066'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:21.145676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-915142c4-4e07-4404-bdcc-4893b8c3ff5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdfffd27b48a4d9a9b14e9a513557066'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:21.160036 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1012/1991] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:20 2022] DELETE /identity/v3/users/bdfffd27b48a4d9a9b14e9a513557066 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:21.213209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817396e-9f8d-4042-8cfc-0c9f1cb993a5 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:21.255774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915142c4-4e07-4404-bdcc-4893b8c3ff5a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:21.258977 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-915142c4-4e07-4404-bdcc-4893b8c3ff5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:21.290163 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439f371-55b2-4a5b-9fb2-7c6add8a2172 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:21.291858 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439f371-55b2-4a5b-9fb2-7c6add8a2172 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:21.292691 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439f371-55b2-4a5b-9fb2-7c6add8a2172 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:21.293244 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439f371-55b2-4a5b-9fb2-7c6add8a2172 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:21.298066 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d439f371-55b2-4a5b-9fb2-7c6add8a2172 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:21.315691 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:21.398191 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439f371-55b2-4a5b-9fb2-7c6add8a2172 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:21.401174 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439f371-55b2-4a5b-9fb2-7c6add8a2172 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:21.416660 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 980/1992] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:21.417314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915142c4-4e07-4404-bdcc-4893b8c3ff5a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:21.426593 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5df8dc-ecce-48ef-93c0-d7ebeb01024a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:21.427613 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5df8dc-ecce-48ef-93c0-d7ebeb01024a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:21.427613 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5df8dc-ecce-48ef-93c0-d7ebeb01024a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:21.427613 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5df8dc-ecce-48ef-93c0-d7ebeb01024a admin admin] PATH_INFO: `/v3/projects/f2e1487abfc043548966201627a48663` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:21.428930 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5df8dc-ecce-48ef-93c0-d7ebeb01024a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2e1487abfc043548966201627a48663)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:21.430925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5df8dc-ecce-48ef-93c0-d7ebeb01024a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:21.516729 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0c5df8dc-ecce-48ef-93c0-d7ebeb01024a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2e1487abfc043548966201627a48663', 'request_id': 'req-0c5df8dc-ecce-48ef-93c0-d7ebeb01024a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:21.525370 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0c5df8dc-ecce-48ef-93c0-d7ebeb01024a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2e1487abfc043548966201627a48663', 'request_id': 'req-0c5df8dc-ecce-48ef-93c0-d7ebeb01024a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:21.535480 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0c5df8dc-ecce-48ef-93c0-d7ebeb01024a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2e1487abfc043548966201627a48663', 'request_id': 'req-0c5df8dc-ecce-48ef-93c0-d7ebeb01024a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:21.555562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0c5df8dc-ecce-48ef-93c0-d7ebeb01024a admin admin] The token cache is being invalidate because project f2e1487abfc043548966201627a48663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:21.555839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0c5df8dc-ecce-48ef-93c0-d7ebeb01024a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:21.560545 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0c5df8dc-ecce-48ef-93c0-d7ebeb01024a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:21.560545 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1013/1993] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:21 2022] DELETE /identity/v3/projects/f2e1487abfc043548966201627a48663 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:21.565537 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e6c31-dcbe-42f6-a74e-0464162e9696 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:21.565830 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e6c31-dcbe-42f6-a74e-0464162e9696 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:21.566354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e6c31-dcbe-42f6-a74e-0464162e9696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:21.576504 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:21.593330 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-821e6c31-dcbe-42f6-a74e-0464162e9696 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:21.594591 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-821e6c31-dcbe-42f6-a74e-0464162e9696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:21.601379 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5df8dc-ecce-48ef-93c0-d7ebeb01024a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:21.604434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0c5df8dc-ecce-48ef-93c0-d7ebeb01024a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:21.701380 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 981/1994] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:36:21.709412 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fda560-a24b-4017-8f44-f83a29009285 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:21.709713 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fda560-a24b-4017-8f44-f83a29009285 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:21.709971 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fda560-a24b-4017-8f44-f83a29009285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:21.725570 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5df8dc-ecce-48ef-93c0-d7ebeb01024a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:21.730914 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25541a-0eb9-4bbf-9ad7-dba70acf7f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:21.731579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25541a-0eb9-4bbf-9ad7-dba70acf7f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:21.732543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25541a-0eb9-4bbf-9ad7-dba70acf7f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:21.732543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25541a-0eb9-4bbf-9ad7-dba70acf7f7a admin admin] PATH_INFO: `/v3/projects/fcdac95589474eacb9bd4c020a72687c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:21.733638 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25541a-0eb9-4bbf-9ad7-dba70acf7f7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcdac95589474eacb9bd4c020a72687c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:21.735664 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25541a-0eb9-4bbf-9ad7-dba70acf7f7a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:21.754956 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-62fda560-a24b-4017-8f44-f83a29009285 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:21.757433 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-62fda560-a24b-4017-8f44-f83a29009285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:21.771436 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 982/1995] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:36:21.776656 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fda560-a24b-4017-8f44-f83a29009285 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:21.800768 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fda560-a24b-4017-8f44-f83a29009285 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:21.856067 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7b25541a-0eb9-4bbf-9ad7-dba70acf7f7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcdac95589474eacb9bd4c020a72687c', 'request_id': 'req-7b25541a-0eb9-4bbf-9ad7-dba70acf7f7a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:21.856067 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:21.868430 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7b25541a-0eb9-4bbf-9ad7-dba70acf7f7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcdac95589474eacb9bd4c020a72687c', 'request_id': 'req-7b25541a-0eb9-4bbf-9ad7-dba70acf7f7a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:21.897187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7b25541a-0eb9-4bbf-9ad7-dba70acf7f7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcdac95589474eacb9bd4c020a72687c', 'request_id': 'req-7b25541a-0eb9-4bbf-9ad7-dba70acf7f7a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:21.913067 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7b25541a-0eb9-4bbf-9ad7-dba70acf7f7a admin admin] The token cache is being invalidate because project fcdac95589474eacb9bd4c020a72687c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:21.913067 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7b25541a-0eb9-4bbf-9ad7-dba70acf7f7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:21.913067 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7b25541a-0eb9-4bbf-9ad7-dba70acf7f7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:21.913067 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1014/1996] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:21 2022] DELETE /identity/v3/projects/fcdac95589474eacb9bd4c020a72687c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:21.924661 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26839b02-9277-48e2-8fdc-de5758898eb3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:21.924661 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26839b02-9277-48e2-8fdc-de5758898eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:21.924661 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26839b02-9277-48e2-8fdc-de5758898eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:21.945479 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-26839b02-9277-48e2-8fdc-de5758898eb3 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:21.948530 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-26839b02-9277-48e2-8fdc-de5758898eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:21.977318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d796b35-46fa-464d-84f0-cae1622b40cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:21.978567 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d796b35-46fa-464d-84f0-cae1622b40cd admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:21.979035 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d796b35-46fa-464d-84f0-cae1622b40cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:21.979488 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d796b35-46fa-464d-84f0-cae1622b40cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:21.981243 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d796b35-46fa-464d-84f0-cae1622b40cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:36:21.981688 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d796b35-46fa-464d-84f0-cae1622b40cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:21.985253 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d796b35-46fa-464d-84f0-cae1622b40cd admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:22.010752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 983/1997] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:36:22.020649 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d796b35-46fa-464d-84f0-cae1622b40cd admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:22.023628 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6d796b35-46fa-464d-84f0-cae1622b40cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:22.054699 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1015/1998] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:22.058401 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d796b35-46fa-464d-84f0-cae1622b40cd admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:22.063062 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd1e7e-1c40-4496-9ff8-3d3e8e004200 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:22.063791 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd1e7e-1c40-4496-9ff8-3d3e8e004200 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:22.064536 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd1e7e-1c40-4496-9ff8-3d3e8e004200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:22.068166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba72e21-bb66-4da9-8368-82137e4cec6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:22.069561 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba72e21-bb66-4da9-8368-82137e4cec6a admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:22.070413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba72e21-bb66-4da9-8368-82137e4cec6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:22.071002 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba72e21-bb66-4da9-8368-82137e4cec6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:22.072575 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba72e21-bb66-4da9-8368-82137e4cec6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:22.077585 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba72e21-bb66-4da9-8368-82137e4cec6a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:22.095107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d5dd1e7e-1c40-4496-9ff8-3d3e8e004200 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:22.096364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d5dd1e7e-1c40-4496-9ff8-3d3e8e004200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:22.110017 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1016/1999] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:22.110901 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd1e7e-1c40-4496-9ff8-3d3e8e004200 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:22.125013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd1e7e-1c40-4496-9ff8-3d3e8e004200 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:22.130755 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec460dd-c16e-4c66-8432-85931d0a8466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:22.131491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec460dd-c16e-4c66-8432-85931d0a8466 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:22.131836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec460dd-c16e-4c66-8432-85931d0a8466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:22.132203 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec460dd-c16e-4c66-8432-85931d0a8466 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:22.133022 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec460dd-c16e-4c66-8432-85931d0a8466 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:36:22.133404 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec460dd-c16e-4c66-8432-85931d0a8466 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:22.135156 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec460dd-c16e-4c66-8432-85931d0a8466 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:22.150671 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 984/2000] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:36:22 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:22.152877 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1017/2001] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:36:22.153043 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba72e21-bb66-4da9-8368-82137e4cec6a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:22.155837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec460dd-c16e-4c66-8432-85931d0a8466 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:22.170210 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec460dd-c16e-4c66-8432-85931d0a8466 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:22.244673 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba72e21-bb66-4da9-8368-82137e4cec6a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:22.252219 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34affa-0d0d-4fb4-8de0-1d3fe9f8ed5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:22.253089 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34affa-0d0d-4fb4-8de0-1d3fe9f8ed5b admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:22.253661 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34affa-0d0d-4fb4-8de0-1d3fe9f8ed5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:22.254237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34affa-0d0d-4fb4-8de0-1d3fe9f8ed5b admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:22.255765 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34affa-0d0d-4fb4-8de0-1d3fe9f8ed5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:22.258822 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34affa-0d0d-4fb4-8de0-1d3fe9f8ed5b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:22.266529 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626273f-553f-4c6b-8c60-ba317a14d383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:22.267161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626273f-553f-4c6b-8c60-ba317a14d383 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:22.267588 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626273f-553f-4c6b-8c60-ba317a14d383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:22.267868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626273f-553f-4c6b-8c60-ba317a14d383 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:22.268703 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626273f-553f-4c6b-8c60-ba317a14d383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:22.270694 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626273f-553f-4c6b-8c60-ba317a14d383 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:22.278621 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:22.289227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 985/2002] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:36:22 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:22.292457 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34affa-0d0d-4fb4-8de0-1d3fe9f8ed5b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:22.308150 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1018/2003] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:36:22 2022] POST /identity/v3/projects => generated 363 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:36:22.308321 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34affa-0d0d-4fb4-8de0-1d3fe9f8ed5b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:22.310304 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626273f-553f-4c6b-8c60-ba317a14d383 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:22.370587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:22.377149 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c8ba7-5e12-476e-a1d7-1eaa952d19e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:22.377779 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c8ba7-5e12-476e-a1d7-1eaa952d19e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:22.378203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c8ba7-5e12-476e-a1d7-1eaa952d19e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:22.378512 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c8ba7-5e12-476e-a1d7-1eaa952d19e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:22.379264 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c8ba7-5e12-476e-a1d7-1eaa952d19e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:22.381156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c8ba7-5e12-476e-a1d7-1eaa952d19e1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:22.393978 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 986/2004] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:22.398104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c8ba7-5e12-476e-a1d7-1eaa952d19e1 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:22.399433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626273f-553f-4c6b-8c60-ba317a14d383 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:22.406162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f59f50-a0e8-452c-b361-1f92e75cb478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:22.406757 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f59f50-a0e8-452c-b361-1f92e75cb478 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:22.407055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f59f50-a0e8-452c-b361-1f92e75cb478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:22.407345 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f59f50-a0e8-452c-b361-1f92e75cb478 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:22.408007 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f59f50-a0e8-452c-b361-1f92e75cb478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:22.410063 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f59f50-a0e8-452c-b361-1f92e75cb478 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:22.410225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c8ba7-5e12-476e-a1d7-1eaa952d19e1 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:22.416382 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509ed9f-4c3f-4cfe-887d-882a04599c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:22.417094 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509ed9f-4c3f-4cfe-887d-882a04599c36 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:22.417377 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509ed9f-4c3f-4cfe-887d-882a04599c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:22.417650 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509ed9f-4c3f-4cfe-887d-882a04599c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:22.418429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509ed9f-4c3f-4cfe-887d-882a04599c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:22.420581 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509ed9f-4c3f-4cfe-887d-882a04599c36 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:22.439135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1019/2005] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:36:22 2022] POST /identity/v3/users => generated 282 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:22.439779 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 987/2006] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:36:22.443186 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509ed9f-4c3f-4cfe-887d-882a04599c36 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:22.443397 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f59f50-a0e8-452c-b361-1f92e75cb478 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:22.454003 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f59f50-a0e8-452c-b361-1f92e75cb478 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:22.457433 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509ed9f-4c3f-4cfe-887d-882a04599c36 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:22.459265 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ee6fb-6792-4f82-a659-135a25fa6538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:22.459960 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ee6fb-6792-4f82-a659-135a25fa6538 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:22.460196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ee6fb-6792-4f82-a659-135a25fa6538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:22.460457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ee6fb-6792-4f82-a659-135a25fa6538 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:22.461265 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ee6fb-6792-4f82-a659-135a25fa6538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:22.462917 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ee6fb-6792-4f82-a659-135a25fa6538 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:22.467862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0effdc-482a-47bc-a010-20282f542390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:22.469062 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0effdc-482a-47bc-a010-20282f542390 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:22.469600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0effdc-482a-47bc-a010-20282f542390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:22.470138 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0effdc-482a-47bc-a010-20282f542390 admin admin] PATH_INFO: `/v3/projects/861d5ce3626242498a6e37c89e62061e/users/7dc3673be164495c94c6e07a335be6d3/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:22.475593 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1020/2007] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:22.480635 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ee6fb-6792-4f82-a659-135a25fa6538 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:22.497021 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0effdc-482a-47bc-a010-20282f542390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=861d5ce3626242498a6e37c89e62061e, user_id=7dc3673be164495c94c6e07a335be6d3, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:22.497825 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ee6fb-6792-4f82-a659-135a25fa6538 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:22.504266 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0effdc-482a-47bc-a010-20282f542390 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:22.505662 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84b15a-36b4-411a-aa67-306897634810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:22.506640 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84b15a-36b4-411a-aa67-306897634810 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:22.507107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84b15a-36b4-411a-aa67-306897634810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:22.507555 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84b15a-36b4-411a-aa67-306897634810 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:22.508639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84b15a-36b4-411a-aa67-306897634810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:22.511408 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84b15a-36b4-411a-aa67-306897634810 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:22.533176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 988/2008] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:22 2022] PUT /identity/v3/projects/861d5ce3626242498a6e37c89e62061e/users/7dc3673be164495c94c6e07a335be6d3/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:22.533439 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1021/2009] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:36:22.537329 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0effdc-482a-47bc-a010-20282f542390 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:22.545124 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6feaed-3158-409c-9b59-563e11127117 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:22.545523 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6feaed-3158-409c-9b59-563e11127117 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:22.545830 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6feaed-3158-409c-9b59-563e11127117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:22.578320 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-be6feaed-3158-409c-9b59-563e11127117 None None] MFA Rules not processed for user `7dc3673be164495c94c6e07a335be6d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:22.579477 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-be6feaed-3158-409c-9b59-563e11127117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:22.625536 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0effdc-482a-47bc-a010-20282f542390 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:22.630538 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a9d65-7123-4012-9e38-1e0b4457bef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:22.631280 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a9d65-7123-4012-9e38-1e0b4457bef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:22.631560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a9d65-7123-4012-9e38-1e0b4457bef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:22.631833 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a9d65-7123-4012-9e38-1e0b4457bef7 admin admin] PATH_INFO: `/v3/projects/51e06b85740640529761911e70a5b277/users/13fbff202d3e43c480d12cb26dd885c8/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:22.660832 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a9d65-7123-4012-9e38-1e0b4457bef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51e06b85740640529761911e70a5b277, user_id=13fbff202d3e43c480d12cb26dd885c8, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:22.670321 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a9d65-7123-4012-9e38-1e0b4457bef7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:22.677926 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1022/2010] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:36:22.682929 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6feaed-3158-409c-9b59-563e11127117 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:22.691890 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 989/2011] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:22 2022] PUT /identity/v3/projects/51e06b85740640529761911e70a5b277/users/13fbff202d3e43c480d12cb26dd885c8/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:36:22.698412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6feaed-3158-409c-9b59-563e11127117 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:22.704265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec79f31-376f-4788-b932-844a55b86dfb None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:22.704592 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec79f31-376f-4788-b932-844a55b86dfb None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:22.704906 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec79f31-376f-4788-b932-844a55b86dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:22.743602 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-eec79f31-376f-4788-b932-844a55b86dfb None None] MFA Rules not processed for user `13fbff202d3e43c480d12cb26dd885c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:22.745045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-eec79f31-376f-4788-b932-844a55b86dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:22.786648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:22.793648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e65751-bbda-4fd5-a51d-8ee98c9fd180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:22.795079 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e65751-bbda-4fd5-a51d-8ee98c9fd180 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:22.795400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e65751-bbda-4fd5-a51d-8ee98c9fd180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:22.795672 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e65751-bbda-4fd5-a51d-8ee98c9fd180 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:22.796329 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e65751-bbda-4fd5-a51d-8ee98c9fd180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:22.798560 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e65751-bbda-4fd5-a51d-8ee98c9fd180 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:22.832757 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1023/2012] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:36:22 2022] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:22.837744 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e65751-bbda-4fd5-a51d-8ee98c9fd180 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:22.839614 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-55e65751-bbda-4fd5-a51d-8ee98c9fd180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:22.842364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 990/2013] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:36:22.843435 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec79f31-376f-4788-b932-844a55b86dfb None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:22.859788 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec79f31-376f-4788-b932-844a55b86dfb None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:22.884044 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:22.920334 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e65751-bbda-4fd5-a51d-8ee98c9fd180 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:22.926945 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d741ff-08aa-43e3-b2e5-bd1b4f433be1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:22.927869 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d741ff-08aa-43e3-b2e5-bd1b4f433be1 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:22.928232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d741ff-08aa-43e3-b2e5-bd1b4f433be1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:22.928734 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d741ff-08aa-43e3-b2e5-bd1b4f433be1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:22.932104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-75d741ff-08aa-43e3-b2e5-bd1b4f433be1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:22.954306 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c46514-9b4b-4714-9935-4f7e74d0f124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:22.955322 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c46514-9b4b-4714-9935-4f7e74d0f124 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:22.955810 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c46514-9b4b-4714-9935-4f7e74d0f124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:22.956237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c46514-9b4b-4714-9935-4f7e74d0f124 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:22.957068 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c46514-9b4b-4714-9935-4f7e74d0f124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:22.959435 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c46514-9b4b-4714-9935-4f7e74d0f124 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:22.986227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 991/2014] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:36:22 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:22.987418 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c46514-9b4b-4714-9935-4f7e74d0f124 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:22.989435 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-85c46514-9b4b-4714-9935-4f7e74d0f124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:23.002255 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c46514-9b4b-4714-9935-4f7e74d0f124 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:23.006442 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fcf1c-7e48-4748-9ada-f2aa4b5b6963 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:23.007064 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fcf1c-7e48-4748-9ada-f2aa4b5b6963 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:23.007345 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fcf1c-7e48-4748-9ada-f2aa4b5b6963 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:23.007614 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fcf1c-7e48-4748-9ada-f2aa4b5b6963 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:23.033638 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d741ff-08aa-43e3-b2e5-bd1b4f433be1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:23.036443 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d741ff-08aa-43e3-b2e5-bd1b4f433be1 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:23.058618 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1024/2015] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:23.060550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d741ff-08aa-43e3-b2e5-bd1b4f433be1 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:23.080673 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d741ff-08aa-43e3-b2e5-bd1b4f433be1 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:23.090272 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb25709-81b4-4771-9342-0d8585380d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:23.091883 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb25709-81b4-4771-9342-0d8585380d00 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:23.092536 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb25709-81b4-4771-9342-0d8585380d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:23.093821 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb25709-81b4-4771-9342-0d8585380d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:23.094357 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb25709-81b4-4771-9342-0d8585380d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:23.097527 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb25709-81b4-4771-9342-0d8585380d00 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:23.117056 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1025/2016] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:23.122001 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb25709-81b4-4771-9342-0d8585380d00 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:23.123939 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045fcf1c-7e48-4748-9ada-f2aa4b5b6963 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:23.125763 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045fcf1c-7e48-4748-9ada-f2aa4b5b6963 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:23.140040 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb25709-81b4-4771-9342-0d8585380d00 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:23.140917 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 992/2017] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:23.154126 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ec56e-fce0-4076-8106-5a2b5926edbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:23.155103 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ec56e-fce0-4076-8106-5a2b5926edbe admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:23.155767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ec56e-fce0-4076-8106-5a2b5926edbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:23.156211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ec56e-fce0-4076-8106-5a2b5926edbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:23.157589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ec56e-fce0-4076-8106-5a2b5926edbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:23.159712 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ec56e-fce0-4076-8106-5a2b5926edbe admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:23.179541 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1026/2018] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:36:23.184292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fcf1c-7e48-4748-9ada-f2aa4b5b6963 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:23.205989 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fcf1c-7e48-4748-9ada-f2aa4b5b6963 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:23.214612 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7a21f-6f66-4a54-a9d8-1eb91ebaf5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:23.215753 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7a21f-6f66-4a54-a9d8-1eb91ebaf5c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:23.216829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7a21f-6f66-4a54-a9d8-1eb91ebaf5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:23.217315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7a21f-6f66-4a54-a9d8-1eb91ebaf5c0 admin admin] PATH_INFO: `/v3/projects/db9f338c1fc44374846b749084762f4d/users/69e509b15feb462bb6522d4dbe451c33/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:23.249765 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7a21f-6f66-4a54-a9d8-1eb91ebaf5c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db9f338c1fc44374846b749084762f4d, user_id=69e509b15feb462bb6522d4dbe451c33, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:23.255299 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7a21f-6f66-4a54-a9d8-1eb91ebaf5c0 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:23.290929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 993/2019] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:23 2022] PUT /identity/v3/projects/db9f338c1fc44374846b749084762f4d/users/69e509b15feb462bb6522d4dbe451c33/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:36:23.304411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85319f0-e374-4ac1-8c0c-23d2474a64ca None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:23.306255 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85319f0-e374-4ac1-8c0c-23d2474a64ca None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:23.307064 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85319f0-e374-4ac1-8c0c-23d2474a64ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:23.361377 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c85319f0-e374-4ac1-8c0c-23d2474a64ca None None] MFA Rules not processed for user `69e509b15feb462bb6522d4dbe451c33`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:23.364462 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c85319f0-e374-4ac1-8c0c-23d2474a64ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:23.489424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1027/2020] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:23.496110 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7a21f-6f66-4a54-a9d8-1eb91ebaf5c0 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:23.556851 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:23.633341 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7a21f-6f66-4a54-a9d8-1eb91ebaf5c0 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:23.653798 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62660e-c183-4ecc-b2c2-a5c596ae6244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:23.655822 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62660e-c183-4ecc-b2c2-a5c596ae6244 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:23.656462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62660e-c183-4ecc-b2c2-a5c596ae6244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:23.657847 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62660e-c183-4ecc-b2c2-a5c596ae6244 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:23.658756 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62660e-c183-4ecc-b2c2-a5c596ae6244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:23.663155 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62660e-c183-4ecc-b2c2-a5c596ae6244 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:23.734545 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 994/2021] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:36:23 2022] POST /identity/v3/projects => generated 379 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:23.735046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85319f0-e374-4ac1-8c0c-23d2474a64ca None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:23.767905 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85319f0-e374-4ac1-8c0c-23d2474a64ca None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:23.929877 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:23.973607 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9095cfd-e7a4-4e6b-9015-a5cced1dcec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:23.974687 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9095cfd-e7a4-4e6b-9015-a5cced1dcec8 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:23.975342 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9095cfd-e7a4-4e6b-9015-a5cced1dcec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:23.975835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9095cfd-e7a4-4e6b-9015-a5cced1dcec8 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:23.978317 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9095cfd-e7a4-4e6b-9015-a5cced1dcec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:23.985595 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9095cfd-e7a4-4e6b-9015-a5cced1dcec8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:24.025953 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1028/2022] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:36:23 2022] POST /identity/v3/users => generated 296 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:24.033327 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62660e-c183-4ecc-b2c2-a5c596ae6244 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:24.052735 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62660e-c183-4ecc-b2c2-a5c596ae6244 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:24.062142 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77128ce7-3b94-4312-97c5-5bc1fc09f289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:24.062519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77128ce7-3b94-4312-97c5-5bc1fc09f289 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:24.062955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77128ce7-3b94-4312-97c5-5bc1fc09f289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:24.064020 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77128ce7-3b94-4312-97c5-5bc1fc09f289 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:24.064963 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77128ce7-3b94-4312-97c5-5bc1fc09f289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:24.066849 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77128ce7-3b94-4312-97c5-5bc1fc09f289 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:24.081694 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 995/2023] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:36:24.085760 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9095cfd-e7a4-4e6b-9015-a5cced1dcec8 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:24.098596 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9095cfd-e7a4-4e6b-9015-a5cced1dcec8 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:24.103681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7bbf1-b5f1-465a-805b-d64ffd5087db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:24.104360 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7bbf1-b5f1-465a-805b-d64ffd5087db admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:24.104679 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7bbf1-b5f1-465a-805b-d64ffd5087db admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:24.104937 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7bbf1-b5f1-465a-805b-d64ffd5087db admin admin] PATH_INFO: `/v3/projects/bb2e495f29ad49ba874242cf15665786/users/0eb9ca6f69f74b46be3f815010bf439b/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:24.124262 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7bbf1-b5f1-465a-805b-d64ffd5087db admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb2e495f29ad49ba874242cf15665786, user_id=0eb9ca6f69f74b46be3f815010bf439b, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:24.127326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7bbf1-b5f1-465a-805b-d64ffd5087db admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:24.146336 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1029/2024] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:24 2022] PUT /identity/v3/projects/bb2e495f29ad49ba874242cf15665786/users/0eb9ca6f69f74b46be3f815010bf439b/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:24.151060 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77128ce7-3b94-4312-97c5-5bc1fc09f289 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:24.166427 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77128ce7-3b94-4312-97c5-5bc1fc09f289 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:24.258877 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0e527-e88d-4fd1-9d98-851c244a8147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:24.260009 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0e527-e88d-4fd1-9d98-851c244a8147 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:24.260496 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0e527-e88d-4fd1-9d98-851c244a8147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:24.261004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0e527-e88d-4fd1-9d98-851c244a8147 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:24.262264 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0e527-e88d-4fd1-9d98-851c244a8147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:24.266213 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0e527-e88d-4fd1-9d98-851c244a8147 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:24.282835 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 996/2025] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:24.288681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7bbf1-b5f1-465a-805b-d64ffd5087db admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:24.313227 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7bbf1-b5f1-465a-805b-d64ffd5087db admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:24.321191 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1d339-ed53-4c13-bb74-71d37034ae66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:24.322292 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1d339-ed53-4c13-bb74-71d37034ae66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:24.322623 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1d339-ed53-4c13-bb74-71d37034ae66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:24.322984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1d339-ed53-4c13-bb74-71d37034ae66 admin admin] PATH_INFO: `/v3/projects/bb2e495f29ad49ba874242cf15665786/users/0eb9ca6f69f74b46be3f815010bf439b/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:24.325997 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1d339-ed53-4c13-bb74-71d37034ae66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb2e495f29ad49ba874242cf15665786, user_id=0eb9ca6f69f74b46be3f815010bf439b, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:24.345560 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1d339-ed53-4c13-bb74-71d37034ae66 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:24.345896 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1030/2026] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:24 2022] PUT /identity/v3/projects/bb2e495f29ad49ba874242cf15665786/users/0eb9ca6f69f74b46be3f815010bf439b/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:24.360600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ae204-1f75-408c-875d-f2409c2bd9b7 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:24.361041 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ae204-1f75-408c-875d-f2409c2bd9b7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:24.362226 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ae204-1f75-408c-875d-f2409c2bd9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:24.399706 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-865ae204-1f75-408c-875d-f2409c2bd9b7 None None] MFA Rules not processed for user `0eb9ca6f69f74b46be3f815010bf439b`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:24.401581 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-865ae204-1f75-408c-875d-f2409c2bd9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:24.517981 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 997/2027] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:24 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:36:24.536080 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1d339-ed53-4c13-bb74-71d37034ae66 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:24.644601 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1d339-ed53-4c13-bb74-71d37034ae66 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:24.651798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e338935-6e39-46e4-9777-3265f9959220 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:24.653058 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e338935-6e39-46e4-9777-3265f9959220 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:24.654064 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e338935-6e39-46e4-9777-3265f9959220 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:24.654622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e338935-6e39-46e4-9777-3265f9959220 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:24.670610 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e338935-6e39-46e4-9777-3265f9959220 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:24.672950 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e338935-6e39-46e4-9777-3265f9959220 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:24.691509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1031/2028] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:24 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:24.768516 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ae204-1f75-408c-875d-f2409c2bd9b7 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:24.792515 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ae204-1f75-408c-875d-f2409c2bd9b7 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:24.801070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e28ff-4b36-4794-90ce-75411cc261e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:24.802145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e28ff-4b36-4794-90ce-75411cc261e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:24.802576 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e28ff-4b36-4794-90ce-75411cc261e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:24.803324 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e28ff-4b36-4794-90ce-75411cc261e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:24.879410 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:24.945888 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e28ff-4b36-4794-90ce-75411cc261e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:24.948573 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e28ff-4b36-4794-90ce-75411cc261e5 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:24.981354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 998/2029] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:27.751069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e338935-6e39-46e4-9777-3265f9959220 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:27.754432 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1e338935-6e39-46e4-9777-3265f9959220 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:27.991549 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e338935-6e39-46e4-9777-3265f9959220 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:28.014394 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855c5d8-1067-464c-be4f-86da659b144c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:28.020111 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855c5d8-1067-464c-be4f-86da659b144c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:28.020542 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855c5d8-1067-464c-be4f-86da659b144c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:28.025548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855c5d8-1067-464c-be4f-86da659b144c admin admin] PATH_INFO: `/v3/users/b93c1663f3b34ab7b86e4410860d7e3d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:28.034204 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855c5d8-1067-464c-be4f-86da659b144c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b93c1663f3b34ab7b86e4410860d7e3d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:28.038940 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855c5d8-1067-464c-be4f-86da659b144c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:28.168428 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:28.180141 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6855c5d8-1067-464c-be4f-86da659b144c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b93c1663f3b34ab7b86e4410860d7e3d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:28.225474 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6855c5d8-1067-464c-be4f-86da659b144c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b93c1663f3b34ab7b86e4410860d7e3d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:28.226615 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6855c5d8-1067-464c-be4f-86da659b144c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b93c1663f3b34ab7b86e4410860d7e3d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:28.239432 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6855c5d8-1067-464c-be4f-86da659b144c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b93c1663f3b34ab7b86e4410860d7e3d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:28.253643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6855c5d8-1067-464c-be4f-86da659b144c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b93c1663f3b34ab7b86e4410860d7e3d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:28.271818 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1032/2030] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:27 2022] DELETE /identity/v3/users/b93c1663f3b34ab7b86e4410860d7e3d => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:28.276729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd1704-ea76-4bee-9f3e-c1efb8c46f1d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:28.277554 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd1704-ea76-4bee-9f3e-c1efb8c46f1d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:28.277554 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd1704-ea76-4bee-9f3e-c1efb8c46f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:28.302318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8acd1704-ea76-4bee-9f3e-c1efb8c46f1d None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:28.303675 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8acd1704-ea76-4bee-9f3e-c1efb8c46f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:28.427628 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 999/2031] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:28.445208 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855c5d8-1067-464c-be4f-86da659b144c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:28.447262 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6855c5d8-1067-464c-be4f-86da659b144c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:28.517263 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855c5d8-1067-464c-be4f-86da659b144c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:28.521124 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28200277-1cb3-4b83-ab58-b99041d450a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:28.521755 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28200277-1cb3-4b83-ab58-b99041d450a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:28.522034 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28200277-1cb3-4b83-ab58-b99041d450a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:28.522321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28200277-1cb3-4b83-ab58-b99041d450a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:28.543989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28200277-1cb3-4b83-ab58-b99041d450a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:28.546260 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28200277-1cb3-4b83-ab58-b99041d450a1 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:28.557520 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1033/2032] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:29.274999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd1704-ea76-4bee-9f3e-c1efb8c46f1d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:29.280508 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28200277-1cb3-4b83-ab58-b99041d450a1 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:29.288834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-28200277-1cb3-4b83-ab58-b99041d450a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:29.296441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8acd1704-ea76-4bee-9f3e-c1efb8c46f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:29.311833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28200277-1cb3-4b83-ab58-b99041d450a1 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:29.318920 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcabe38-2bed-423b-adb4-ed9f9b13d0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:29.319835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcabe38-2bed-423b-adb4-ed9f9b13d0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:29.320047 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcabe38-2bed-423b-adb4-ed9f9b13d0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:29.320414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcabe38-2bed-423b-adb4-ed9f9b13d0ee admin admin] PATH_INFO: `/v3/projects/36f0eed240f5441bb7e5983d77c669b5` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:29.321728 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcabe38-2bed-423b-adb4-ed9f9b13d0ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=36f0eed240f5441bb7e5983d77c669b5)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:29.324128 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcabe38-2bed-423b-adb4-ed9f9b13d0ee admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:29.337184 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd1704-ea76-4bee-9f3e-c1efb8c46f1d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:29.367061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce33a0-0ce3-4ad3-9703-e0bb7d07b271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:29.368705 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce33a0-0ce3-4ad3-9703-e0bb7d07b271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:29.369461 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce33a0-0ce3-4ad3-9703-e0bb7d07b271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:29.370683 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce33a0-0ce3-4ad3-9703-e0bb7d07b271 admin admin] PATH_INFO: `/v3/users/7dc3673be164495c94c6e07a335be6d3` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:29.374029 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce33a0-0ce3-4ad3-9703-e0bb7d07b271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc3673be164495c94c6e07a335be6d3)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:29.380103 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce33a0-0ce3-4ad3-9703-e0bb7d07b271 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:29.423035 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ebcabe38-2bed-423b-adb4-ed9f9b13d0ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36f0eed240f5441bb7e5983d77c669b5', 'request_id': 'req-ebcabe38-2bed-423b-adb4-ed9f9b13d0ee'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:29.437617 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ebcabe38-2bed-423b-adb4-ed9f9b13d0ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36f0eed240f5441bb7e5983d77c669b5', 'request_id': 'req-ebcabe38-2bed-423b-adb4-ed9f9b13d0ee'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:29.460440 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ebcabe38-2bed-423b-adb4-ed9f9b13d0ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36f0eed240f5441bb7e5983d77c669b5', 'request_id': 'req-ebcabe38-2bed-423b-adb4-ed9f9b13d0ee'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:29.506510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ebcabe38-2bed-423b-adb4-ed9f9b13d0ee admin admin] The token cache is being invalidate because project 36f0eed240f5441bb7e5983d77c669b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:29.507151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ebcabe38-2bed-423b-adb4-ed9f9b13d0ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:29.509090 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ebcabe38-2bed-423b-adb4-ed9f9b13d0ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:29.520319 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1034/2033] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:29 2022] DELETE /identity/v3/projects/36f0eed240f5441bb7e5983d77c669b5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:36:29.522519 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcabe38-2bed-423b-adb4-ed9f9b13d0ee admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:29.525132 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ebcabe38-2bed-423b-adb4-ed9f9b13d0ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:29.525504 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-97ce33a0-0ce3-4ad3-9703-e0bb7d07b271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc3673be164495c94c6e07a335be6d3'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:29.549176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-97ce33a0-0ce3-4ad3-9703-e0bb7d07b271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc3673be164495c94c6e07a335be6d3'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:29.550659 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-97ce33a0-0ce3-4ad3-9703-e0bb7d07b271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc3673be164495c94c6e07a335be6d3'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:29.551991 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-97ce33a0-0ce3-4ad3-9703-e0bb7d07b271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc3673be164495c94c6e07a335be6d3'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:29.565689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-97ce33a0-0ce3-4ad3-9703-e0bb7d07b271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc3673be164495c94c6e07a335be6d3'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:29.594698 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1000/2034] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:29 2022] DELETE /identity/v3/users/7dc3673be164495c94c6e07a335be6d3 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:29.602498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165a8d6-9231-40ef-9c88-3053a7d76417 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:29.603073 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165a8d6-9231-40ef-9c88-3053a7d76417 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:29.603835 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165a8d6-9231-40ef-9c88-3053a7d76417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:29.633580 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9165a8d6-9231-40ef-9c88-3053a7d76417 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:29.635571 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9165a8d6-9231-40ef-9c88-3053a7d76417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:29.702288 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:29.737869 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:29.738191 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1001/2035] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:29.769592 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165a8d6-9231-40ef-9c88-3053a7d76417 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:29.771314 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9165a8d6-9231-40ef-9c88-3053a7d76417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:29.818687 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcabe38-2bed-423b-adb4-ed9f9b13d0ee admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:29.829898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335a954-2d50-4cb8-a4e0-0470f742b2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:29.832444 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335a954-2d50-4cb8-a4e0-0470f742b2f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:29.833104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335a954-2d50-4cb8-a4e0-0470f742b2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:29.833741 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335a954-2d50-4cb8-a4e0-0470f742b2f5 admin admin] PATH_INFO: `/v3/users/642dcd7e99564428bca85c12bfb2f3be` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:29.835420 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335a954-2d50-4cb8-a4e0-0470f742b2f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=642dcd7e99564428bca85c12bfb2f3be)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:29.839697 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335a954-2d50-4cb8-a4e0-0470f742b2f5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:29.911487 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165a8d6-9231-40ef-9c88-3053a7d76417 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:29.916045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1085e-fcaa-4dd0-809a-ea1f9ab31208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:29.917092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1085e-fcaa-4dd0-809a-ea1f9ab31208 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:29.917590 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1085e-fcaa-4dd0-809a-ea1f9ab31208 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:29.918050 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1085e-fcaa-4dd0-809a-ea1f9ab31208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:29.930237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1085e-fcaa-4dd0-809a-ea1f9ab31208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:29.933733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1085e-fcaa-4dd0-809a-ea1f9ab31208 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:29.950406 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1002/2036] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:36:30.017457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6335a954-2d50-4cb8-a4e0-0470f742b2f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '642dcd7e99564428bca85c12bfb2f3be'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:30.038260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51230dc0-d827-4d6b-b22c-976a97d0f6ad None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:30.038545 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51230dc0-d827-4d6b-b22c-976a97d0f6ad None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:30.038827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51230dc0-d827-4d6b-b22c-976a97d0f6ad None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:30.040893 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1003/2037] 10.222.0.52 () {54 vars in 921 bytes} [Thu Sep 1 16:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:36:30.059680 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6335a954-2d50-4cb8-a4e0-0470f742b2f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '642dcd7e99564428bca85c12bfb2f3be'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:30.061085 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6335a954-2d50-4cb8-a4e0-0470f742b2f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '642dcd7e99564428bca85c12bfb2f3be'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:30.068451 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d0939-d420-4af5-b483-3f028df8135f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:30.069094 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d0939-d420-4af5-b483-3f028df8135f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:30.070039 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d0939-d420-4af5-b483-3f028df8135f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:30.075907 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6335a954-2d50-4cb8-a4e0-0470f742b2f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '642dcd7e99564428bca85c12bfb2f3be'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:30.093382 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6335a954-2d50-4cb8-a4e0-0470f742b2f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '642dcd7e99564428bca85c12bfb2f3be'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:30.106027 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1035/2038] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:29 2022] DELETE /identity/v3/users/642dcd7e99564428bca85c12bfb2f3be => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:30.121533 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-0b9d0939-d420-4af5-b483-3f028df8135f None None] MFA Rules not processed for user `d64fc190fac540259444a531cdbb8d53`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:30.121533 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0b9d0939-d420-4af5-b483-3f028df8135f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:30.279641 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335a954-2d50-4cb8-a4e0-0470f742b2f5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:30.281171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6335a954-2d50-4cb8-a4e0-0470f742b2f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:30.394353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1004/2039] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Sep 1 16:36:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:30.420400 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d0939-d420-4af5-b483-3f028df8135f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:30.422514 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0b9d0939-d420-4af5-b483-3f028df8135f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:30.445119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d0939-d420-4af5-b483-3f028df8135f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:30.455044 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335a954-2d50-4cb8-a4e0-0470f742b2f5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:30.463682 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e302a-b6b7-4bf4-b66f-6cd567962949 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64fc190fac540259444a531cdbb8d53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:30.464709 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e302a-b6b7-4bf4-b66f-6cd567962949 service placement] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:30.465051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e302a-b6b7-4bf4-b66f-6cd567962949 service placement] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:30.467307 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e302a-b6b7-4bf4-b66f-6cd567962949 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:30.472346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79916f77-a682-4e51-82fa-8f898d63acba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:30.473658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79916f77-a682-4e51-82fa-8f898d63acba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:30.474441 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79916f77-a682-4e51-82fa-8f898d63acba admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:30.475082 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79916f77-a682-4e51-82fa-8f898d63acba admin admin] PATH_INFO: `/v3/users/071e0d407c6e4353b491c246700c3e41` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:30.478019 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79916f77-a682-4e51-82fa-8f898d63acba admin admin] RBAC: Authorizing `identity:delete_user(user_id=071e0d407c6e4353b491c246700c3e41)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:30.484317 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79916f77-a682-4e51-82fa-8f898d63acba admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:30.485705 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e302a-b6b7-4bf4-b66f-6cd567962949 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:30.490794 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e302a-b6b7-4bf4-b66f-6cd567962949 service placement] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:30.517558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1005/2040] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:30.648585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-79916f77-a682-4e51-82fa-8f898d63acba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '071e0d407c6e4353b491c246700c3e41'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:30.686060 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-79916f77-a682-4e51-82fa-8f898d63acba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '071e0d407c6e4353b491c246700c3e41'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:30.692762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-79916f77-a682-4e51-82fa-8f898d63acba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '071e0d407c6e4353b491c246700c3e41'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:30.695618 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:30.718884 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-79916f77-a682-4e51-82fa-8f898d63acba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '071e0d407c6e4353b491c246700c3e41'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:30.737585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-79916f77-a682-4e51-82fa-8f898d63acba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '071e0d407c6e4353b491c246700c3e41'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:30.757626 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1036/2041] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:30 2022] DELETE /identity/v3/users/071e0d407c6e4353b491c246700c3e41 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:36:30.964116 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e302a-b6b7-4bf4-b66f-6cd567962949 service placement] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:30.965800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-065e302a-b6b7-4bf4-b66f-6cd567962949 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:30.998004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e302a-b6b7-4bf4-b66f-6cd567962949 service placement] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:30.999565 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79916f77-a682-4e51-82fa-8f898d63acba admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:31.001455 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-79916f77-a682-4e51-82fa-8f898d63acba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:31.145280 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c709e-4604-4a4d-8a1a-b4999f1d8341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:31.146268 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c709e-4604-4a4d-8a1a-b4999f1d8341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:31.146791 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c709e-4604-4a4d-8a1a-b4999f1d8341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:31.147204 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c709e-4604-4a4d-8a1a-b4999f1d8341 admin admin] PATH_INFO: `/v3/projects/73adf51c3a0d45b2845c7b45ac0fcc6c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:31.147938 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79916f77-a682-4e51-82fa-8f898d63acba admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:31.149279 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c709e-4604-4a4d-8a1a-b4999f1d8341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73adf51c3a0d45b2845c7b45ac0fcc6c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:31.152357 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c709e-4604-4a4d-8a1a-b4999f1d8341 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:31.153111 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cff520-271b-449e-aa24-3a22632525b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:31.154142 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cff520-271b-449e-aa24-3a22632525b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:31.154421 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cff520-271b-449e-aa24-3a22632525b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:31.154692 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cff520-271b-449e-aa24-3a22632525b2 admin admin] PATH_INFO: `/v3/projects/861d5ce3626242498a6e37c89e62061e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:31.156044 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cff520-271b-449e-aa24-3a22632525b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=861d5ce3626242498a6e37c89e62061e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:31.158061 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cff520-271b-449e-aa24-3a22632525b2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:31.181361 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:31.230068 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-50cff520-271b-449e-aa24-3a22632525b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '861d5ce3626242498a6e37c89e62061e', 'request_id': 'req-50cff520-271b-449e-aa24-3a22632525b2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:31.239188 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-50cff520-271b-449e-aa24-3a22632525b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '861d5ce3626242498a6e37c89e62061e', 'request_id': 'req-50cff520-271b-449e-aa24-3a22632525b2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:31.240658 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-388c709e-4604-4a4d-8a1a-b4999f1d8341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73adf51c3a0d45b2845c7b45ac0fcc6c', 'request_id': 'req-388c709e-4604-4a4d-8a1a-b4999f1d8341'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:31.251091 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-50cff520-271b-449e-aa24-3a22632525b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '861d5ce3626242498a6e37c89e62061e', 'request_id': 'req-50cff520-271b-449e-aa24-3a22632525b2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:31.251591 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-388c709e-4604-4a4d-8a1a-b4999f1d8341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73adf51c3a0d45b2845c7b45ac0fcc6c', 'request_id': 'req-388c709e-4604-4a4d-8a1a-b4999f1d8341'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:31.259172 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-388c709e-4604-4a4d-8a1a-b4999f1d8341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73adf51c3a0d45b2845c7b45ac0fcc6c', 'request_id': 'req-388c709e-4604-4a4d-8a1a-b4999f1d8341'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:31.267886 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-50cff520-271b-449e-aa24-3a22632525b2 admin admin] The token cache is being invalidate because project 861d5ce3626242498a6e37c89e62061e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:31.268212 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-50cff520-271b-449e-aa24-3a22632525b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:31.268932 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-50cff520-271b-449e-aa24-3a22632525b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:31.270543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1037/2042] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:30 2022] DELETE /identity/v3/projects/861d5ce3626242498a6e37c89e62061e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:31.271357 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cff520-271b-449e-aa24-3a22632525b2 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:31.272924 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-50cff520-271b-449e-aa24-3a22632525b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:31.283420 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-388c709e-4604-4a4d-8a1a-b4999f1d8341 admin admin] The token cache is being invalidate because project 73adf51c3a0d45b2845c7b45ac0fcc6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:31.284120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-388c709e-4604-4a4d-8a1a-b4999f1d8341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:31.284996 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-388c709e-4604-4a4d-8a1a-b4999f1d8341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:31.287327 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1006/2043] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:30 2022] DELETE /identity/v3/projects/73adf51c3a0d45b2845c7b45ac0fcc6c => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:31.288492 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c709e-4604-4a4d-8a1a-b4999f1d8341 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:31.290178 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-388c709e-4604-4a4d-8a1a-b4999f1d8341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:31.348006 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cff520-271b-449e-aa24-3a22632525b2 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:31.366988 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:31.377880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c709e-4604-4a4d-8a1a-b4999f1d8341 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:31.383957 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdda627-8a83-48c5-8364-b50b438f5efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:31.384833 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdda627-8a83-48c5-8364-b50b438f5efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:31.385306 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdda627-8a83-48c5-8364-b50b438f5efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:31.385762 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdda627-8a83-48c5-8364-b50b438f5efe admin admin] PATH_INFO: `/v3/users/69e509b15feb462bb6522d4dbe451c33` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:31.387331 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdda627-8a83-48c5-8364-b50b438f5efe admin admin] RBAC: Authorizing `identity:delete_user(user_id=69e509b15feb462bb6522d4dbe451c33)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:31.390544 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdda627-8a83-48c5-8364-b50b438f5efe admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:31.417752 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18dd98-6a8a-41a8-848f-b2fdb29c0e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:31.418447 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18dd98-6a8a-41a8-848f-b2fdb29c0e4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:31.418658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18dd98-6a8a-41a8-848f-b2fdb29c0e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:31.419012 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18dd98-6a8a-41a8-848f-b2fdb29c0e4c admin admin] PATH_INFO: `/v3/projects/8d258cb405d2424da6fd606bafa774d0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:31.421085 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18dd98-6a8a-41a8-848f-b2fdb29c0e4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d258cb405d2424da6fd606bafa774d0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:31.423067 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18dd98-6a8a-41a8-848f-b2fdb29c0e4c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:31.468514 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fbdda627-8a83-48c5-8364-b50b438f5efe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69e509b15feb462bb6522d4dbe451c33'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:31.478134 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9d18dd98-6a8a-41a8-848f-b2fdb29c0e4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d258cb405d2424da6fd606bafa774d0', 'request_id': 'req-9d18dd98-6a8a-41a8-848f-b2fdb29c0e4c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:31.485524 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9d18dd98-6a8a-41a8-848f-b2fdb29c0e4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d258cb405d2424da6fd606bafa774d0', 'request_id': 'req-9d18dd98-6a8a-41a8-848f-b2fdb29c0e4c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:31.495600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fbdda627-8a83-48c5-8364-b50b438f5efe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69e509b15feb462bb6522d4dbe451c33'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:31.496068 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9d18dd98-6a8a-41a8-848f-b2fdb29c0e4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d258cb405d2424da6fd606bafa774d0', 'request_id': 'req-9d18dd98-6a8a-41a8-848f-b2fdb29c0e4c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:31.496828 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fbdda627-8a83-48c5-8364-b50b438f5efe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69e509b15feb462bb6522d4dbe451c33'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:31.497599 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fbdda627-8a83-48c5-8364-b50b438f5efe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69e509b15feb462bb6522d4dbe451c33'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:31.507607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fbdda627-8a83-48c5-8364-b50b438f5efe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69e509b15feb462bb6522d4dbe451c33'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:31.513197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9d18dd98-6a8a-41a8-848f-b2fdb29c0e4c admin admin] The token cache is being invalidate because project 8d258cb405d2424da6fd606bafa774d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:31.513917 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9d18dd98-6a8a-41a8-848f-b2fdb29c0e4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:31.514693 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9d18dd98-6a8a-41a8-848f-b2fdb29c0e4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:31.517860 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1038/2044] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:31 2022] DELETE /identity/v3/projects/8d258cb405d2424da6fd606bafa774d0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:31.521163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7c71b-04ff-40a0-8ed5-bec8a2f0b205 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:31.521163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7c71b-04ff-40a0-8ed5-bec8a2f0b205 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:31.521163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7c71b-04ff-40a0-8ed5-bec8a2f0b205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:31.531003 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1007/2045] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:31 2022] DELETE /identity/v3/users/69e509b15feb462bb6522d4dbe451c33 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:31.532495 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09e9b1-b6db-4835-bd81-11dfa46cbfad None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:31.532862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09e9b1-b6db-4835-bd81-11dfa46cbfad None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:31.533174 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09e9b1-b6db-4835-bd81-11dfa46cbfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:31.541728 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b7e7c71b-04ff-40a0-8ed5-bec8a2f0b205 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:31.543132 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b7e7c71b-04ff-40a0-8ed5-bec8a2f0b205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:31.558142 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8d09e9b1-b6db-4835-bd81-11dfa46cbfad None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:31.559411 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8d09e9b1-b6db-4835-bd81-11dfa46cbfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:31.576706 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:31.650032 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1039/2046] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:31.654494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1008/2047] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:31.659533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a27852-279d-4ce5-8263-1bf6b5a057f5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:31.659822 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a27852-279d-4ce5-8263-1bf6b5a057f5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:31.660112 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a27852-279d-4ce5-8263-1bf6b5a057f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:31.663174 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06728c8e-b272-455b-ae54-4afd04867cb9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:31.663460 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06728c8e-b272-455b-ae54-4afd04867cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:31.663817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06728c8e-b272-455b-ae54-4afd04867cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:31.685424 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-06728c8e-b272-455b-ae54-4afd04867cb9 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:31.686703 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-06728c8e-b272-455b-ae54-4afd04867cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:31.687589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-78a27852-279d-4ce5-8263-1bf6b5a057f5 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:31.688517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-78a27852-279d-4ce5-8263-1bf6b5a057f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:31.696432 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1009/2048] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:36:31.697559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1040/2049] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:31.701850 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a27852-279d-4ce5-8263-1bf6b5a057f5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:31.703005 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06728c8e-b272-455b-ae54-4afd04867cb9 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:31.712783 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a27852-279d-4ce5-8263-1bf6b5a057f5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:31.713121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06728c8e-b272-455b-ae54-4afd04867cb9 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:31.718709 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24941623-c9d8-4fd1-a94d-59e7191dbd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:31.718983 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84f45f-fe00-4be5-ba45-17db734ab15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:31.719357 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24941623-c9d8-4fd1-a94d-59e7191dbd8e admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:31.719621 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24941623-c9d8-4fd1-a94d-59e7191dbd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:31.719893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24941623-c9d8-4fd1-a94d-59e7191dbd8e admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:31.720565 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24941623-c9d8-4fd1-a94d-59e7191dbd8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:36:31.720736 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84f45f-fe00-4be5-ba45-17db734ab15e admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:31.720915 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24941623-c9d8-4fd1-a94d-59e7191dbd8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:31.721022 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84f45f-fe00-4be5-ba45-17db734ab15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:31.721247 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84f45f-fe00-4be5-ba45-17db734ab15e admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:31.721920 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84f45f-fe00-4be5-ba45-17db734ab15e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:36:31.722841 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24941623-c9d8-4fd1-a94d-59e7191dbd8e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:31.724871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84f45f-fe00-4be5-ba45-17db734ab15e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:31.730363 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84f45f-fe00-4be5-ba45-17db734ab15e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:31.738025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1041/2050] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:36:31.742769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24941623-c9d8-4fd1-a94d-59e7191dbd8e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:31.753889 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24941623-c9d8-4fd1-a94d-59e7191dbd8e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:31.754532 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1010/2051] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:36:31.759640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84f45f-fe00-4be5-ba45-17db734ab15e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:31.764008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f34952-f600-48b3-ad71-776811819396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:31.764919 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f34952-f600-48b3-ad71-776811819396 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:31.765263 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f34952-f600-48b3-ad71-776811819396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:31.765446 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f34952-f600-48b3-ad71-776811819396 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:31.766348 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f34952-f600-48b3-ad71-776811819396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:31.768394 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f34952-f600-48b3-ad71-776811819396 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:31.774331 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84f45f-fe00-4be5-ba45-17db734ab15e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:31.783212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78d1c3-6e9a-4ce9-9442-aaf20bff3a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:31.785914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78d1c3-6e9a-4ce9-9442-aaf20bff3a5e admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:31.786634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78d1c3-6e9a-4ce9-9442-aaf20bff3a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:31.787365 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78d1c3-6e9a-4ce9-9442-aaf20bff3a5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:31.788270 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78d1c3-6e9a-4ce9-9442-aaf20bff3a5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:31.792790 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78d1c3-6e9a-4ce9-9442-aaf20bff3a5e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:31.828281 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1042/2052] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:36:31 2022] POST /identity/v3/projects => generated 375 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:36:31.829769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f34952-f600-48b3-ad71-776811819396 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:31.842369 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:31.876295 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1011/2053] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:36:31 2022] POST /identity/v3/projects => generated 393 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:31.877501 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78d1c3-6e9a-4ce9-9442-aaf20bff3a5e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:31.970700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f34952-f600-48b3-ad71-776811819396 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:32.007046 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78d1c3-6e9a-4ce9-9442-aaf20bff3a5e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:32.021020 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e668a5b-6c0f-4d89-a09e-d35bebf5f4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:32.022348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e668a5b-6c0f-4d89-a09e-d35bebf5f4e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:32.022495 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e668a5b-6c0f-4d89-a09e-d35bebf5f4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:32.022738 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e668a5b-6c0f-4d89-a09e-d35bebf5f4e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:32.024808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e668a5b-6c0f-4d89-a09e-d35bebf5f4e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:32.031844 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e668a5b-6c0f-4d89-a09e-d35bebf5f4e7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:32.058832 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae6db9-999e-4eee-a3af-86ce7a767b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:32.059640 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae6db9-999e-4eee-a3af-86ce7a767b40 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:32.060566 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae6db9-999e-4eee-a3af-86ce7a767b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:32.060955 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae6db9-999e-4eee-a3af-86ce7a767b40 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:32.061604 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae6db9-999e-4eee-a3af-86ce7a767b40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:32.064434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae6db9-999e-4eee-a3af-86ce7a767b40 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:32.094591 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1012/2054] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:36:31 2022] POST /identity/v3/users => generated 297 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:32.095612 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e668a5b-6c0f-4d89-a09e-d35bebf5f4e7 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:32.097562 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9e668a5b-6c0f-4d89-a09e-d35bebf5f4e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:32.124581 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1043/2055] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:36:31 2022] POST /identity/v3/users => generated 288 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:36:32.124581 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae6db9-999e-4eee-a3af-86ce7a767b40 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:32.129587 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e668a5b-6c0f-4d89-a09e-d35bebf5f4e7 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:32.136023 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f1d05-811a-41af-b20b-d3cfcb2755b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:32.136726 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f1d05-811a-41af-b20b-d3cfcb2755b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:32.137015 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f1d05-811a-41af-b20b-d3cfcb2755b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:32.137301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f1d05-811a-41af-b20b-d3cfcb2755b7 admin admin] PATH_INFO: `/v3/projects/db9f338c1fc44374846b749084762f4d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:32.139153 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f1d05-811a-41af-b20b-d3cfcb2755b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db9f338c1fc44374846b749084762f4d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:32.139346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae6db9-999e-4eee-a3af-86ce7a767b40 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:32.141547 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f1d05-811a-41af-b20b-d3cfcb2755b7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:32.145621 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037ba24-c91d-4c0a-9a7a-fc49aebb03a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:32.148143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037ba24-c91d-4c0a-9a7a-fc49aebb03a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:32.148569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037ba24-c91d-4c0a-9a7a-fc49aebb03a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:32.148992 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037ba24-c91d-4c0a-9a7a-fc49aebb03a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:32.149973 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037ba24-c91d-4c0a-9a7a-fc49aebb03a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:32.152101 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037ba24-c91d-4c0a-9a7a-fc49aebb03a7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:32.165628 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1044/2056] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:32.165628 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037ba24-c91d-4c0a-9a7a-fc49aebb03a7 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:32.179420 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037ba24-c91d-4c0a-9a7a-fc49aebb03a7 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:32.190261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3640af-44c6-49dc-9e55-f732ef9e7f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:32.190261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3640af-44c6-49dc-9e55-f732ef9e7f19 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:32.190261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3640af-44c6-49dc-9e55-f732ef9e7f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:32.190261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3640af-44c6-49dc-9e55-f732ef9e7f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:32.191138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3640af-44c6-49dc-9e55-f732ef9e7f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:32.193607 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3640af-44c6-49dc-9e55-f732ef9e7f19 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:32.221201 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1045/2057] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:32.221201 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3640af-44c6-49dc-9e55-f732ef9e7f19 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:32.234923 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-738f1d05-811a-41af-b20b-d3cfcb2755b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db9f338c1fc44374846b749084762f4d', 'request_id': 'req-738f1d05-811a-41af-b20b-d3cfcb2755b7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:32.243863 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-738f1d05-811a-41af-b20b-d3cfcb2755b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db9f338c1fc44374846b749084762f4d', 'request_id': 'req-738f1d05-811a-41af-b20b-d3cfcb2755b7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:32.254127 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:32.256486 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3640af-44c6-49dc-9e55-f732ef9e7f19 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:32.258305 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-738f1d05-811a-41af-b20b-d3cfcb2755b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db9f338c1fc44374846b749084762f4d', 'request_id': 'req-738f1d05-811a-41af-b20b-d3cfcb2755b7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:32.289698 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-738f1d05-811a-41af-b20b-d3cfcb2755b7 admin admin] The token cache is being invalidate because project db9f338c1fc44374846b749084762f4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:32.290137 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-738f1d05-811a-41af-b20b-d3cfcb2755b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:32.290870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-738f1d05-811a-41af-b20b-d3cfcb2755b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:32.293384 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1013/2058] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:32 2022] DELETE /identity/v3/projects/db9f338c1fc44374846b749084762f4d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:32.294236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f1d05-811a-41af-b20b-d3cfcb2755b7 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:32.297410 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-738f1d05-811a-41af-b20b-d3cfcb2755b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:32.398689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f1d05-811a-41af-b20b-d3cfcb2755b7 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:32.408319 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4f571-a015-438f-94c3-4a875d17b1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:32.409534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4f571-a015-438f-94c3-4a875d17b1bf admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:32.410117 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4f571-a015-438f-94c3-4a875d17b1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:32.410684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4f571-a015-438f-94c3-4a875d17b1bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:32.412160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4f571-a015-438f-94c3-4a875d17b1bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:32.413972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4f571-a015-438f-94c3-4a875d17b1bf admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:32.422504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a775901-6d75-41e1-9882-9500a0d19b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:32.425178 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a775901-6d75-41e1-9882-9500a0d19b06 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:32.426434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a775901-6d75-41e1-9882-9500a0d19b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:32.427173 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a775901-6d75-41e1-9882-9500a0d19b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:32.429377 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1014/2059] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:32.430395 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4f571-a015-438f-94c3-4a875d17b1bf admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:32.432278 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cfd4f571-a015-438f-94c3-4a875d17b1bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:32.434600 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a775901-6d75-41e1-9882-9500a0d19b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:32.437580 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a775901-6d75-41e1-9882-9500a0d19b06 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:32.448049 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4f571-a015-438f-94c3-4a875d17b1bf admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:32.464074 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65769408-1b47-4c2f-965f-55cbf47b4022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:32.464954 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65769408-1b47-4c2f-965f-55cbf47b4022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:32.465436 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65769408-1b47-4c2f-965f-55cbf47b4022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:32.465698 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65769408-1b47-4c2f-965f-55cbf47b4022 admin admin] PATH_INFO: `/v3/users/0eb9ca6f69f74b46be3f815010bf439b` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:32.468317 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65769408-1b47-4c2f-965f-55cbf47b4022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eb9ca6f69f74b46be3f815010bf439b)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:32.471015 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65769408-1b47-4c2f-965f-55cbf47b4022 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:32.475172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1046/2060] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:32.477485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a775901-6d75-41e1-9882-9500a0d19b06 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:32.498731 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a775901-6d75-41e1-9882-9500a0d19b06 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:32.505893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2ca37-2d55-4039-be38-e92e9e75310c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:32.506893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2ca37-2d55-4039-be38-e92e9e75310c admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:32.507214 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2ca37-2d55-4039-be38-e92e9e75310c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:32.507717 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2ca37-2d55-4039-be38-e92e9e75310c admin admin] PATH_INFO: `/v3/projects/7fdea3be00c94ea9b198badea9953b6d/users/1a6dc6e07a824c8c8498831e647d1110/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:32.531059 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f2ca37-2d55-4039-be38-e92e9e75310c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fdea3be00c94ea9b198badea9953b6d, user_id=1a6dc6e07a824c8c8498831e647d1110, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:32.535932 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f2ca37-2d55-4039-be38-e92e9e75310c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:32.540831 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:32.545344 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-65769408-1b47-4c2f-965f-55cbf47b4022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eb9ca6f69f74b46be3f815010bf439b'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:32.555244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1047/2061] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:32 2022] PUT /identity/v3/projects/7fdea3be00c94ea9b198badea9953b6d/users/1a6dc6e07a824c8c8498831e647d1110/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:32.560066 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2ca37-2d55-4039-be38-e92e9e75310c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:32.560066 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-75f2ca37-2d55-4039-be38-e92e9e75310c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:32.567235 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-65769408-1b47-4c2f-965f-55cbf47b4022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eb9ca6f69f74b46be3f815010bf439b'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:32.572442 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-65769408-1b47-4c2f-965f-55cbf47b4022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eb9ca6f69f74b46be3f815010bf439b'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:32.573366 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-65769408-1b47-4c2f-965f-55cbf47b4022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eb9ca6f69f74b46be3f815010bf439b'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:32.583202 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-65769408-1b47-4c2f-965f-55cbf47b4022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eb9ca6f69f74b46be3f815010bf439b'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:32.599769 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1015/2062] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:32 2022] DELETE /identity/v3/users/0eb9ca6f69f74b46be3f815010bf439b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:32.601454 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8815c8-db52-465c-9667-9fef4c71ced1 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:32.601755 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8815c8-db52-465c-9667-9fef4c71ced1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:32.602164 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8815c8-db52-465c-9667-9fef4c71ced1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:32.643883 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-7b8815c8-db52-465c-9667-9fef4c71ced1 None None] MFA Rules not processed for user `1a6dc6e07a824c8c8498831e647d1110`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:32.645543 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7b8815c8-db52-465c-9667-9fef4c71ced1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:32.692032 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2ca37-2d55-4039-be38-e92e9e75310c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:32.713734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:32.744303 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1016/2063] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:32.749638 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8815c8-db52-465c-9667-9fef4c71ced1 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:32.751453 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7b8815c8-db52-465c-9667-9fef4c71ced1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:32.812538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89fd2f-5af2-42da-9c94-8a9b2dfdc9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:32.813253 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89fd2f-5af2-42da-9c94-8a9b2dfdc9af admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:32.813538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89fd2f-5af2-42da-9c94-8a9b2dfdc9af admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:32.813838 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89fd2f-5af2-42da-9c94-8a9b2dfdc9af admin admin] PATH_INFO: `/v3/projects/1f3a5aa7aaa04fb7991a5d7904cba03f/users/ed5158b5364c4e10a2128e3d098048ca/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:32.836695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf89fd2f-5af2-42da-9c94-8a9b2dfdc9af admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f3a5aa7aaa04fb7991a5d7904cba03f, user_id=ed5158b5364c4e10a2128e3d098048ca, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:32.840083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf89fd2f-5af2-42da-9c94-8a9b2dfdc9af admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:32.848614 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8815c8-db52-465c-9667-9fef4c71ced1 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:32.853835 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848c79e-ec97-417c-ace4-e669657e63b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:32.854453 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848c79e-ec97-417c-ace4-e669657e63b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:32.854733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848c79e-ec97-417c-ace4-e669657e63b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:32.855110 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848c79e-ec97-417c-ace4-e669657e63b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:32.855652 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848c79e-ec97-417c-ace4-e669657e63b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:32.858328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1048/2064] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:32 2022] PUT /identity/v3/projects/1f3a5aa7aaa04fb7991a5d7904cba03f/users/ed5158b5364c4e10a2128e3d098048ca/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:32.858573 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848c79e-ec97-417c-ace4-e669657e63b1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:32.863526 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb890da-8050-4e49-8ebb-e7424e235c29 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:32.864060 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb890da-8050-4e49-8ebb-e7424e235c29 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:32.864301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb890da-8050-4e49-8ebb-e7424e235c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:32.886772 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1bb890da-8050-4e49-8ebb-e7424e235c29 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:32.888165 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1bb890da-8050-4e49-8ebb-e7424e235c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:32.915544 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1017/2065] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:36:32 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:36:32.922055 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848c79e-ec97-417c-ace4-e669657e63b1 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:33.009189 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1049/2066] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:36:33.022534 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb890da-8050-4e49-8ebb-e7424e235c29 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:33.025310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1bb890da-8050-4e49-8ebb-e7424e235c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:33.035295 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848c79e-ec97-417c-ace4-e669657e63b1 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:33.041125 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d871d-8005-4fef-8ddb-5b9425131426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:33.042060 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d871d-8005-4fef-8ddb-5b9425131426 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:33.042607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d871d-8005-4fef-8ddb-5b9425131426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:33.043052 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d871d-8005-4fef-8ddb-5b9425131426 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:33.043947 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d871d-8005-4fef-8ddb-5b9425131426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:33.046554 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d871d-8005-4fef-8ddb-5b9425131426 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:33.080779 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1018/2067] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:36:32 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:33.084755 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d871d-8005-4fef-8ddb-5b9425131426 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:33.086134 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:33.089851 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-127d871d-8005-4fef-8ddb-5b9425131426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:33.115815 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d871d-8005-4fef-8ddb-5b9425131426 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:33.121369 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96034f9f-08db-4bd0-950c-892dcc3560b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:33.121953 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96034f9f-08db-4bd0-950c-892dcc3560b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:33.122293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96034f9f-08db-4bd0-950c-892dcc3560b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:33.123154 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96034f9f-08db-4bd0-950c-892dcc3560b4 admin admin] PATH_INFO: `/v3/projects/bb2e495f29ad49ba874242cf15665786` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:33.124485 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96034f9f-08db-4bd0-950c-892dcc3560b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb2e495f29ad49ba874242cf15665786)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:33.126544 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96034f9f-08db-4bd0-950c-892dcc3560b4 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:33.137308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb890da-8050-4e49-8ebb-e7424e235c29 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:33.182222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-96034f9f-08db-4bd0-950c-892dcc3560b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb2e495f29ad49ba874242cf15665786', 'request_id': 'req-96034f9f-08db-4bd0-950c-892dcc3560b4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:33.190193 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-96034f9f-08db-4bd0-950c-892dcc3560b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb2e495f29ad49ba874242cf15665786', 'request_id': 'req-96034f9f-08db-4bd0-950c-892dcc3560b4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:33.192722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:33.199208 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-96034f9f-08db-4bd0-950c-892dcc3560b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb2e495f29ad49ba874242cf15665786', 'request_id': 'req-96034f9f-08db-4bd0-950c-892dcc3560b4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:33.202403 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb79e9f-1635-4b9a-ab67-49eff97668a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:33.203024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb79e9f-1635-4b9a-ab67-49eff97668a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:33.203308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb79e9f-1635-4b9a-ab67-49eff97668a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:33.203591 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb79e9f-1635-4b9a-ab67-49eff97668a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:33.217118 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb79e9f-1635-4b9a-ab67-49eff97668a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:33.217442 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-96034f9f-08db-4bd0-950c-892dcc3560b4 admin admin] The token cache is being invalidate because project bb2e495f29ad49ba874242cf15665786 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:33.217442 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-96034f9f-08db-4bd0-950c-892dcc3560b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:33.218131 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-96034f9f-08db-4bd0-950c-892dcc3560b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:33.219034 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb79e9f-1635-4b9a-ab67-49eff97668a2 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:33.219693 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1019/2068] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:33 2022] DELETE /identity/v3/projects/bb2e495f29ad49ba874242cf15665786 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:33.220509 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96034f9f-08db-4bd0-950c-892dcc3560b4 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:33.222027 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-96034f9f-08db-4bd0-950c-892dcc3560b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:33.233633 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1050/2069] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:33.235730 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088f19a-3e0d-4c5e-ad3e-fa07e537281d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:33.236088 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088f19a-3e0d-4c5e-ad3e-fa07e537281d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:33.236583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088f19a-3e0d-4c5e-ad3e-fa07e537281d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:33.261066 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e088f19a-3e0d-4c5e-ad3e-fa07e537281d None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:33.262338 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e088f19a-3e0d-4c5e-ad3e-fa07e537281d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:33.308097 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96034f9f-08db-4bd0-950c-892dcc3560b4 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:33.313644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85282000-962e-4507-85ff-63c0fb2266f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:33.314291 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85282000-962e-4507-85ff-63c0fb2266f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:33.314601 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85282000-962e-4507-85ff-63c0fb2266f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:33.314854 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85282000-962e-4507-85ff-63c0fb2266f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:33.315511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85282000-962e-4507-85ff-63c0fb2266f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:33.317243 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85282000-962e-4507-85ff-63c0fb2266f4 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:33.329050 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1020/2070] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:33.333561 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85282000-962e-4507-85ff-63c0fb2266f4 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:33.344073 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85282000-962e-4507-85ff-63c0fb2266f4 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:33.349391 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4038e-3b27-473e-b1c1-3da2a6976435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:33.350537 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4038e-3b27-473e-b1c1-3da2a6976435 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:33.350537 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4038e-3b27-473e-b1c1-3da2a6976435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:33.350537 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4038e-3b27-473e-b1c1-3da2a6976435 admin admin] PATH_INFO: `/v3/projects/99985e4061ce4e8695b66303d5291ab4/users/1a03dd4450274ed0a3ae9863ed998cb7/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:33.352810 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1051/2071] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:33.358779 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42ff76-c6d1-40bb-93f1-db47bb63b5c2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:33.359118 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42ff76-c6d1-40bb-93f1-db47bb63b5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:33.359346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42ff76-c6d1-40bb-93f1-db47bb63b5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:33.370187 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4038e-3b27-473e-b1c1-3da2a6976435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99985e4061ce4e8695b66303d5291ab4, user_id=1a03dd4450274ed0a3ae9863ed998cb7, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:33.373158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4038e-3b27-473e-b1c1-3da2a6976435 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:33.382082 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7f42ff76-c6d1-40bb-93f1-db47bb63b5c2 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:33.383331 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7f42ff76-c6d1-40bb-93f1-db47bb63b5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:33.392268 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1021/2072] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:33 2022] PUT /identity/v3/projects/99985e4061ce4e8695b66303d5291ab4/users/1a03dd4450274ed0a3ae9863ed998cb7/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:36:33.396386 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4038e-3b27-473e-b1c1-3da2a6976435 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:33.493042 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1052/2073] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:36:33.494828 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42ff76-c6d1-40bb-93f1-db47bb63b5c2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:33.513296 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4038e-3b27-473e-b1c1-3da2a6976435 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:33.522751 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b765ee-703e-4a24-8b4d-aa83b5810622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:33.523787 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b765ee-703e-4a24-8b4d-aa83b5810622 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:33.524172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42ff76-c6d1-40bb-93f1-db47bb63b5c2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:33.524545 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b765ee-703e-4a24-8b4d-aa83b5810622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:33.526720 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b765ee-703e-4a24-8b4d-aa83b5810622 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:33.527791 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b765ee-703e-4a24-8b4d-aa83b5810622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:33.529908 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b765ee-703e-4a24-8b4d-aa83b5810622 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:33.536827 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c91fbe-07ee-4f10-92f1-3b38f01615a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:33.538042 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c91fbe-07ee-4f10-92f1-3b38f01615a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:33.538772 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c91fbe-07ee-4f10-92f1-3b38f01615a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:33.540853 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c91fbe-07ee-4f10-92f1-3b38f01615a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:33.542685 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c91fbe-07ee-4f10-92f1-3b38f01615a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:36:33.543404 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c91fbe-07ee-4f10-92f1-3b38f01615a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:33.557184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c91fbe-07ee-4f10-92f1-3b38f01615a5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:33.565116 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1022/2074] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:36:33.570142 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b765ee-703e-4a24-8b4d-aa83b5810622 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:33.580729 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1053/2075] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:36:33.584585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c91fbe-07ee-4f10-92f1-3b38f01615a5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:33.590926 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b765ee-703e-4a24-8b4d-aa83b5810622 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:33.599418 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b654eb-ae7e-488f-82fa-564b1f573e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:33.600503 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b654eb-ae7e-488f-82fa-564b1f573e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:33.601106 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b654eb-ae7e-488f-82fa-564b1f573e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:33.601560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b654eb-ae7e-488f-82fa-564b1f573e23 admin admin] PATH_INFO: `/v3/projects/99985e4061ce4e8695b66303d5291ab4/users/1a03dd4450274ed0a3ae9863ed998cb7/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:33.604746 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b654eb-ae7e-488f-82fa-564b1f573e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99985e4061ce4e8695b66303d5291ab4, user_id=1a03dd4450274ed0a3ae9863ed998cb7, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:33.609246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c91fbe-07ee-4f10-92f1-3b38f01615a5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:33.611804 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b654eb-ae7e-488f-82fa-564b1f573e23 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:33.618766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cbdaf-d67c-465d-9965-905daf3fb08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:33.620269 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cbdaf-d67c-465d-9965-905daf3fb08c admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:33.621621 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cbdaf-d67c-465d-9965-905daf3fb08c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:33.624884 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cbdaf-d67c-465d-9965-905daf3fb08c admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:33.627494 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cbdaf-d67c-465d-9965-905daf3fb08c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:33.635682 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1023/2076] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:33 2022] PUT /identity/v3/projects/99985e4061ce4e8695b66303d5291ab4/users/1a03dd4450274ed0a3ae9863ed998cb7/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:33.639171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cbdaf-d67c-465d-9965-905daf3fb08c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:33.647917 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5073e-6bba-4d4d-8d4b-922088dc5c17 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:33.648373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5073e-6bba-4d4d-8d4b-922088dc5c17 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:33.648854 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5073e-6bba-4d4d-8d4b-922088dc5c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:33.686114 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:33.718423 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1054/2077] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:36:33 2022] POST /identity/v3/projects => generated 367 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:33.723752 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cbdaf-d67c-465d-9965-905daf3fb08c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:33.727188 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-add5073e-6bba-4d4d-8d4b-922088dc5c17 None None] MFA Rules not processed for user `1a03dd4450274ed0a3ae9863ed998cb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:33.729835 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-add5073e-6bba-4d4d-8d4b-922088dc5c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:33.804730 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:33.859588 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cbdaf-d67c-465d-9965-905daf3fb08c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:33.890583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b7aa2-0613-4279-84fa-ec89cfdd92a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:33.891422 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b7aa2-0613-4279-84fa-ec89cfdd92a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:33.892221 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b7aa2-0613-4279-84fa-ec89cfdd92a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:33.892502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b7aa2-0613-4279-84fa-ec89cfdd92a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:33.893231 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b7aa2-0613-4279-84fa-ec89cfdd92a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:33.899473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b7aa2-0613-4279-84fa-ec89cfdd92a7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:33.951060 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1024/2078] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:36:33.979142 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1055/2079] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:36:33 2022] POST /identity/v3/users => generated 284 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:36:33.981037 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5073e-6bba-4d4d-8d4b-922088dc5c17 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:33.998627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5073e-6bba-4d4d-8d4b-922088dc5c17 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:34.005521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c4293-8e92-4045-8c2f-d641d96adea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:34.006823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c4293-8e92-4045-8c2f-d641d96adea4 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:34.007251 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c4293-8e92-4045-8c2f-d641d96adea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:34.007802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c4293-8e92-4045-8c2f-d641d96adea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:34.008973 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c4293-8e92-4045-8c2f-d641d96adea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:34.011363 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c4293-8e92-4045-8c2f-d641d96adea4 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:34.016522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b7aa2-0613-4279-84fa-ec89cfdd92a7 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:34.019839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a49b7aa2-0613-4279-84fa-ec89cfdd92a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:34.030325 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1025/2080] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:34.036474 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c4293-8e92-4045-8c2f-d641d96adea4 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:34.073706 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c4293-8e92-4045-8c2f-d641d96adea4 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:34.099065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1a0b0-13fa-4ef7-9aec-910c7bb96048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:34.100401 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1a0b0-13fa-4ef7-9aec-910c7bb96048 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:34.102286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1a0b0-13fa-4ef7-9aec-910c7bb96048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:34.106673 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1a0b0-13fa-4ef7-9aec-910c7bb96048 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:34.111153 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1a0b0-13fa-4ef7-9aec-910c7bb96048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:34.120751 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1a0b0-13fa-4ef7-9aec-910c7bb96048 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:34.174731 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1026/2081] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:34.175744 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1a0b0-13fa-4ef7-9aec-910c7bb96048 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:34.179383 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b7aa2-0613-4279-84fa-ec89cfdd92a7 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:34.187387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11676ff-edb7-4fa1-92ee-369dce7d4e4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:34.188021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11676ff-edb7-4fa1-92ee-369dce7d4e4d service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:34.191603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11676ff-edb7-4fa1-92ee-369dce7d4e4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:34.191994 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11676ff-edb7-4fa1-92ee-369dce7d4e4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:34.198573 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a11676ff-edb7-4fa1-92ee-369dce7d4e4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:34.201413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1a0b0-13fa-4ef7-9aec-910c7bb96048 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:34.224923 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfcb58-4880-47e4-b5b0-013b79d7ee53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:34.228216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfcb58-4880-47e4-b5b0-013b79d7ee53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:34.228216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfcb58-4880-47e4-b5b0-013b79d7ee53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:34.228216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfcb58-4880-47e4-b5b0-013b79d7ee53 admin admin] PATH_INFO: `/v3/projects/b947765e05884670bbfa8895ad4f46ba/users/b1fff3ce647c414991e752a1e769c52a/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:34.268957 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfcb58-4880-47e4-b5b0-013b79d7ee53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b947765e05884670bbfa8895ad4f46ba, user_id=b1fff3ce647c414991e752a1e769c52a, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:34.272240 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfcb58-4880-47e4-b5b0-013b79d7ee53 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:34.299501 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1027/2082] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:34 2022] PUT /identity/v3/projects/b947765e05884670bbfa8895ad4f46ba/users/b1fff3ce647c414991e752a1e769c52a/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:34.322825 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352d138-a8a4-4575-b199-60e4c64a578a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:34.323178 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352d138-a8a4-4575-b199-60e4c64a578a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:34.323459 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352d138-a8a4-4575-b199-60e4c64a578a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:34.366755 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2352d138-a8a4-4575-b199-60e4c64a578a None None] MFA Rules not processed for user `b1fff3ce647c414991e752a1e769c52a`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:34.368301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2352d138-a8a4-4575-b199-60e4c64a578a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:34.368566 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11676ff-edb7-4fa1-92ee-369dce7d4e4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:34.371517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11676ff-edb7-4fa1-92ee-369dce7d4e4d service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:34.394250 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1056/2083] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:36:34.473240 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1028/2084] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:34.480165 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11676ff-edb7-4fa1-92ee-369dce7d4e4d service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:34.496959 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11676ff-edb7-4fa1-92ee-369dce7d4e4d service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:34.562760 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:34.647087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0f971-50d8-4588-99a4-e2488654847d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:34.648126 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0f971-50d8-4588-99a4-e2488654847d admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:34.648649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0f971-50d8-4588-99a4-e2488654847d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:34.649142 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0f971-50d8-4588-99a4-e2488654847d admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:34.650315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0f971-50d8-4588-99a4-e2488654847d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:34.655802 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0f971-50d8-4588-99a4-e2488654847d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:34.711201 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1057/2085] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:36:34 2022] POST /identity/v3/projects => generated 365 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:36:34.714193 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352d138-a8a4-4575-b199-60e4c64a578a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:34.756882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352d138-a8a4-4575-b199-60e4c64a578a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:35.006021 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e4cee-ef26-4ac9-91a4-ff8dfbf6699b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:35.008412 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e4cee-ef26-4ac9-91a4-ff8dfbf6699b admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:35.009975 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e4cee-ef26-4ac9-91a4-ff8dfbf6699b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:35.012086 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e4cee-ef26-4ac9-91a4-ff8dfbf6699b admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:35.015158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e4cee-ef26-4ac9-91a4-ff8dfbf6699b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:35.023245 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e4cee-ef26-4ac9-91a4-ff8dfbf6699b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:35.108637 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:35.139055 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1029/2086] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:36:34 2022] POST /identity/v3/users => generated 289 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:36:35.139599 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0f971-50d8-4588-99a4-e2488654847d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:35.177888 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0f971-50d8-4588-99a4-e2488654847d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:35.217150 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ea8a6-d6c8-423e-acf5-f965f6e2d2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:35.218428 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ea8a6-d6c8-423e-acf5-f965f6e2d2ec admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:35.220074 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ea8a6-d6c8-423e-acf5-f965f6e2d2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:35.222214 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ea8a6-d6c8-423e-acf5-f965f6e2d2ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:35.225016 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ea8a6-d6c8-423e-acf5-f965f6e2d2ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:35.235159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ea8a6-d6c8-423e-acf5-f965f6e2d2ec admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:35.309065 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1058/2087] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:35.313154 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e4cee-ef26-4ac9-91a4-ff8dfbf6699b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:35.328074 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e4cee-ef26-4ac9-91a4-ff8dfbf6699b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:35.341121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83366f8c-cd8e-406e-a6e6-5ef42df7e62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:35.345167 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83366f8c-cd8e-406e-a6e6-5ef42df7e62c admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:35.345506 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83366f8c-cd8e-406e-a6e6-5ef42df7e62c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:35.345716 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83366f8c-cd8e-406e-a6e6-5ef42df7e62c admin admin] PATH_INFO: `/v3/projects/0c889e4ed7c3497ab78f1048f7a0138c/users/473cd00f357f4e6baa22c17e9de3c461/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:35.390404 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83366f8c-cd8e-406e-a6e6-5ef42df7e62c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c889e4ed7c3497ab78f1048f7a0138c, user_id=473cd00f357f4e6baa22c17e9de3c461, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:35.393604 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83366f8c-cd8e-406e-a6e6-5ef42df7e62c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:35.444740 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1030/2088] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:35 2022] PUT /identity/v3/projects/0c889e4ed7c3497ab78f1048f7a0138c/users/473cd00f357f4e6baa22c17e9de3c461/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:36:35.449665 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ea8a6-d6c8-423e-acf5-f965f6e2d2ec admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:35.475238 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ea8a6-d6c8-423e-acf5-f965f6e2d2ec admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:35.635674 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6862f6-53fc-41b2-9aaf-5ec12555f7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:35.636963 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6862f6-53fc-41b2-9aaf-5ec12555f7da admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:35.639533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6862f6-53fc-41b2-9aaf-5ec12555f7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:35.639533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6862f6-53fc-41b2-9aaf-5ec12555f7da admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:35.641222 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6862f6-53fc-41b2-9aaf-5ec12555f7da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:35.645467 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6862f6-53fc-41b2-9aaf-5ec12555f7da admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:35.674230 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1059/2089] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:35.679497 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83366f8c-cd8e-406e-a6e6-5ef42df7e62c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:35.703050 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83366f8c-cd8e-406e-a6e6-5ef42df7e62c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:35.712300 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb75a0-5fb6-4823-830a-95e5cc9461aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:35.713056 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb75a0-5fb6-4823-830a-95e5cc9461aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:35.713402 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb75a0-5fb6-4823-830a-95e5cc9461aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:35.713679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb75a0-5fb6-4823-830a-95e5cc9461aa admin admin] PATH_INFO: `/v3/projects/0c889e4ed7c3497ab78f1048f7a0138c/users/473cd00f357f4e6baa22c17e9de3c461/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:35.716057 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb75a0-5fb6-4823-830a-95e5cc9461aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c889e4ed7c3497ab78f1048f7a0138c, user_id=473cd00f357f4e6baa22c17e9de3c461, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:35.718734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb75a0-5fb6-4823-830a-95e5cc9461aa admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:35.739839 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1031/2090] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:35 2022] PUT /identity/v3/projects/0c889e4ed7c3497ab78f1048f7a0138c/users/473cd00f357f4e6baa22c17e9de3c461/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:35.764701 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cdc80-bce6-46fb-bf75-f13ec4f7b2c7 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:35.765005 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cdc80-bce6-46fb-bf75-f13ec4f7b2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:35.765425 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cdc80-bce6-46fb-bf75-f13ec4f7b2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:35.850116 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-889cdc80-bce6-46fb-bf75-f13ec4f7b2c7 None None] MFA Rules not processed for user `473cd00f357f4e6baa22c17e9de3c461`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:35.854131 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-889cdc80-bce6-46fb-bf75-f13ec4f7b2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:36.000331 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1060/2091] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:36.035324 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb75a0-5fb6-4823-830a-95e5cc9461aa admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:36.039024 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5ceb75a0-5fb6-4823-830a-95e5cc9461aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:36.224438 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb75a0-5fb6-4823-830a-95e5cc9461aa admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:36.234171 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f91fe-0dd0-46bf-9b51-85ed1db0408d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:36.235959 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f91fe-0dd0-46bf-9b51-85ed1db0408d service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:36.236882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f91fe-0dd0-46bf-9b51-85ed1db0408d service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:36.237559 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f91fe-0dd0-46bf-9b51-85ed1db0408d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:36.279365 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f91fe-0dd0-46bf-9b51-85ed1db0408d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:36.285591 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f91fe-0dd0-46bf-9b51-85ed1db0408d service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:36.313885 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1032/2092] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:36 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:36.590249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cdc80-bce6-46fb-bf75-f13ec4f7b2c7 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:36.608468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cdc80-bce6-46fb-bf75-f13ec4f7b2c7 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:36.615951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abfd0a-b616-49c1-a210-b1b0195c6074 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:36.618612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abfd0a-b616-49c1-a210-b1b0195c6074 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:36.619760 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abfd0a-b616-49c1-a210-b1b0195c6074 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:36.620418 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abfd0a-b616-49c1-a210-b1b0195c6074 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:36.705869 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:36.781197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abfd0a-b616-49c1-a210-b1b0195c6074 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:36.790725 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abfd0a-b616-49c1-a210-b1b0195c6074 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:36.871190 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1061/2093] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:37.998747 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f91fe-0dd0-46bf-9b51-85ed1db0408d service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:38.161324 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f91fe-0dd0-46bf-9b51-85ed1db0408d service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:38.167002 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb3585-4786-4b68-a454-48d06f602f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:38.168069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb3585-4786-4b68-a454-48d06f602f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:38.168383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb3585-4786-4b68-a454-48d06f602f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:38.168685 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb3585-4786-4b68-a454-48d06f602f0d admin admin] PATH_INFO: `/v3/users/1a6dc6e07a824c8c8498831e647d1110` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:38.170070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb3585-4786-4b68-a454-48d06f602f0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a6dc6e07a824c8c8498831e647d1110)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:38.172113 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb3585-4786-4b68-a454-48d06f602f0d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:38.270184 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7ffb3585-4786-4b68-a454-48d06f602f0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a6dc6e07a824c8c8498831e647d1110'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:38.304758 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7ffb3585-4786-4b68-a454-48d06f602f0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a6dc6e07a824c8c8498831e647d1110'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:38.305759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7ffb3585-4786-4b68-a454-48d06f602f0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a6dc6e07a824c8c8498831e647d1110'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:38.306552 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7ffb3585-4786-4b68-a454-48d06f602f0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a6dc6e07a824c8c8498831e647d1110'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:38.309455 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:38.330138 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7ffb3585-4786-4b68-a454-48d06f602f0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a6dc6e07a824c8c8498831e647d1110'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:38.359874 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1033/2094] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:37 2022] DELETE /identity/v3/users/1a6dc6e07a824c8c8498831e647d1110 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:36:38.369491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cda08-c535-4f66-8a17-2884b14dd42e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:38.370092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cda08-c535-4f66-8a17-2884b14dd42e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:38.370495 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cda08-c535-4f66-8a17-2884b14dd42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:38.412814 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-cb5cda08-c535-4f66-8a17-2884b14dd42e None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:38.414996 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cb5cda08-c535-4f66-8a17-2884b14dd42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:38.524007 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1062/2095] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:38.535970 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb3585-4786-4b68-a454-48d06f602f0d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:38.540485 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7ffb3585-4786-4b68-a454-48d06f602f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:38.662075 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb3585-4786-4b68-a454-48d06f602f0d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:38.673464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e669657-08b9-46a8-8a5b-56ddb08ae0eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:38.674287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e669657-08b9-46a8-8a5b-56ddb08ae0eb service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:38.674678 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e669657-08b9-46a8-8a5b-56ddb08ae0eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:38.675051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e669657-08b9-46a8-8a5b-56ddb08ae0eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:38.688276 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e669657-08b9-46a8-8a5b-56ddb08ae0eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:38.689928 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e669657-08b9-46a8-8a5b-56ddb08ae0eb service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:38.704525 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1034/2096] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:39.223172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cda08-c535-4f66-8a17-2884b14dd42e None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:39.225168 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cb5cda08-c535-4f66-8a17-2884b14dd42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:39.264191 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cda08-c535-4f66-8a17-2884b14dd42e None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:39.272212 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429a8c1-0388-44b3-a8f0-dc5f599f6b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:39.274292 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429a8c1-0388-44b3-a8f0-dc5f599f6b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:39.274991 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429a8c1-0388-44b3-a8f0-dc5f599f6b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:39.275658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429a8c1-0388-44b3-a8f0-dc5f599f6b88 admin admin] PATH_INFO: `/v3/projects/7fdea3be00c94ea9b198badea9953b6d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:39.280487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429a8c1-0388-44b3-a8f0-dc5f599f6b88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fdea3be00c94ea9b198badea9953b6d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:39.285712 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429a8c1-0388-44b3-a8f0-dc5f599f6b88 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:39.429548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e429a8c1-0388-44b3-a8f0-dc5f599f6b88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fdea3be00c94ea9b198badea9953b6d', 'request_id': 'req-e429a8c1-0388-44b3-a8f0-dc5f599f6b88'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:39.443435 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e429a8c1-0388-44b3-a8f0-dc5f599f6b88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fdea3be00c94ea9b198badea9953b6d', 'request_id': 'req-e429a8c1-0388-44b3-a8f0-dc5f599f6b88'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:39.454586 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e429a8c1-0388-44b3-a8f0-dc5f599f6b88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fdea3be00c94ea9b198badea9953b6d', 'request_id': 'req-e429a8c1-0388-44b3-a8f0-dc5f599f6b88'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:39.475878 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e429a8c1-0388-44b3-a8f0-dc5f599f6b88 admin admin] The token cache is being invalidate because project 7fdea3be00c94ea9b198badea9953b6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:39.477161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e429a8c1-0388-44b3-a8f0-dc5f599f6b88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:39.478274 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e429a8c1-0388-44b3-a8f0-dc5f599f6b88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:39.482747 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1063/2097] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:39 2022] DELETE /identity/v3/projects/7fdea3be00c94ea9b198badea9953b6d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:39.488722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e669657-08b9-46a8-8a5b-56ddb08ae0eb service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:39.508541 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e669657-08b9-46a8-8a5b-56ddb08ae0eb service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:39.632204 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d497f26-28d0-4ab8-b706-09d3fca359c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:39.633393 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d497f26-28d0-4ab8-b706-09d3fca359c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:39.633812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d497f26-28d0-4ab8-b706-09d3fca359c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:39.634996 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d497f26-28d0-4ab8-b706-09d3fca359c2 admin admin] PATH_INFO: `/v3/users/1a03dd4450274ed0a3ae9863ed998cb7` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:39.638219 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d497f26-28d0-4ab8-b706-09d3fca359c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a03dd4450274ed0a3ae9863ed998cb7)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:39.642711 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d497f26-28d0-4ab8-b706-09d3fca359c2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:39.793304 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-1d497f26-28d0-4ab8-b706-09d3fca359c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a03dd4450274ed0a3ae9863ed998cb7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:39.845332 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-1d497f26-28d0-4ab8-b706-09d3fca359c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a03dd4450274ed0a3ae9863ed998cb7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:39.846616 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-1d497f26-28d0-4ab8-b706-09d3fca359c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a03dd4450274ed0a3ae9863ed998cb7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:39.851148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-1d497f26-28d0-4ab8-b706-09d3fca359c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a03dd4450274ed0a3ae9863ed998cb7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:39.882170 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-1d497f26-28d0-4ab8-b706-09d3fca359c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a03dd4450274ed0a3ae9863ed998cb7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:39.964782 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1035/2098] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:39 2022] DELETE /identity/v3/users/1a03dd4450274ed0a3ae9863ed998cb7 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:40.961340 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429a8c1-0388-44b3-a8f0-dc5f599f6b88 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:40.964660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e429a8c1-0388-44b3-a8f0-dc5f599f6b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:41.010624 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429a8c1-0388-44b3-a8f0-dc5f599f6b88 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:41.221578 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:41.270551 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b48e2-90e0-42b9-8b9f-98847590b0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:41.271501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b48e2-90e0-42b9-8b9f-98847590b0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:41.271959 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b48e2-90e0-42b9-8b9f-98847590b0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:41.272330 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b48e2-90e0-42b9-8b9f-98847590b0b6 admin admin] PATH_INFO: `/v3/projects/99985e4061ce4e8695b66303d5291ab4` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:41.281103 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b48e2-90e0-42b9-8b9f-98847590b0b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99985e4061ce4e8695b66303d5291ab4)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:41.290789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b48e2-90e0-42b9-8b9f-98847590b0b6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:41.425611 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-083b48e2-90e0-42b9-8b9f-98847590b0b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99985e4061ce4e8695b66303d5291ab4', 'request_id': 'req-083b48e2-90e0-42b9-8b9f-98847590b0b6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:41.455101 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-083b48e2-90e0-42b9-8b9f-98847590b0b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99985e4061ce4e8695b66303d5291ab4', 'request_id': 'req-083b48e2-90e0-42b9-8b9f-98847590b0b6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:41.471695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-083b48e2-90e0-42b9-8b9f-98847590b0b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99985e4061ce4e8695b66303d5291ab4', 'request_id': 'req-083b48e2-90e0-42b9-8b9f-98847590b0b6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:41.516879 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-083b48e2-90e0-42b9-8b9f-98847590b0b6 admin admin] The token cache is being invalidate because project 99985e4061ce4e8695b66303d5291ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:41.517675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-083b48e2-90e0-42b9-8b9f-98847590b0b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:41.520346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-083b48e2-90e0-42b9-8b9f-98847590b0b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:41.529701 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1064/2099] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:40 2022] DELETE /identity/v3/projects/99985e4061ce4e8695b66303d5291ab4 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:36:41.537862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd6ed9-c42b-48c9-8378-b27a76407770 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:41.539745 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd6ed9-c42b-48c9-8378-b27a76407770 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:41.540561 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd6ed9-c42b-48c9-8378-b27a76407770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:41.576915 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:41.617379 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f2dd6ed9-c42b-48c9-8378-b27a76407770 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:41.619698 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f2dd6ed9-c42b-48c9-8378-b27a76407770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:41.810738 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1036/2100] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:41.819570 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9602b0-daa3-4b42-9a66-5880516979ec None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:41.820114 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9602b0-daa3-4b42-9a66-5880516979ec None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:41.820517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9602b0-daa3-4b42-9a66-5880516979ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:41.873662 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-cb9602b0-daa3-4b42-9a66-5880516979ec None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:41.874944 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cb9602b0-daa3-4b42-9a66-5880516979ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:41.901620 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39ef6d-04a6-4ec7-903a-fa75ea5587a9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:41.902287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39ef6d-04a6-4ec7-903a-fa75ea5587a9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:41.902722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39ef6d-04a6-4ec7-903a-fa75ea5587a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:41.918591 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1065/2101] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:41.920874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9602b0-daa3-4b42-9a66-5880516979ec None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:41.949774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9602b0-daa3-4b42-9a66-5880516979ec None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:41.965230 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6345be-5766-4e9c-b2b8-fe57fefeb6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:41.966899 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6345be-5766-4e9c-b2b8-fe57fefeb6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:41.967364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6345be-5766-4e9c-b2b8-fe57fefeb6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:41.967819 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6345be-5766-4e9c-b2b8-fe57fefeb6e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:41.969150 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6345be-5766-4e9c-b2b8-fe57fefeb6e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:36:41.970140 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6345be-5766-4e9c-b2b8-fe57fefeb6e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:41.973688 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6345be-5766-4e9c-b2b8-fe57fefeb6e1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:41.982006 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2a39ef6d-04a6-4ec7-903a-fa75ea5587a9 None None] MFA Rules not processed for user `ed5158b5364c4e10a2128e3d098048ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:41.984359 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2a39ef6d-04a6-4ec7-903a-fa75ea5587a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:42.003245 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1066/2102] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:36:42.010758 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6345be-5766-4e9c-b2b8-fe57fefeb6e1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:42.047309 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6345be-5766-4e9c-b2b8-fe57fefeb6e1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:42.057638 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d618ca7-444b-4c2f-a833-ade9f0622673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:42.058869 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d618ca7-444b-4c2f-a833-ade9f0622673 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:42.059327 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d618ca7-444b-4c2f-a833-ade9f0622673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:42.060056 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d618ca7-444b-4c2f-a833-ade9f0622673 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:42.061156 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d618ca7-444b-4c2f-a833-ade9f0622673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:42.064477 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d618ca7-444b-4c2f-a833-ade9f0622673 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:42.170234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1067/2103] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:36:42 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:42.173693 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d618ca7-444b-4c2f-a833-ade9f0622673 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:42.198719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1037/2104] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:36:42.220007 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c323024-31d6-4638-b32b-85f586466ee9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:42.228656 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c323024-31d6-4638-b32b-85f586466ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:42.228656 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c323024-31d6-4638-b32b-85f586466ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:42.256433 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2c323024-31d6-4638-b32b-85f586466ee9 None None] MFA Rules not processed for user `ed5158b5364c4e10a2128e3d098048ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:42.258045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2c323024-31d6-4638-b32b-85f586466ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:42.380249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d618ca7-444b-4c2f-a833-ade9f0622673 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:42.387019 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b95528-ec6d-462a-abd7-cd2ada7cbb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:42.387706 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b95528-ec6d-462a-abd7-cd2ada7cbb6e admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:42.388085 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b95528-ec6d-462a-abd7-cd2ada7cbb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:42.388551 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b95528-ec6d-462a-abd7-cd2ada7cbb6e admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:42.389604 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b95528-ec6d-462a-abd7-cd2ada7cbb6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:42.392408 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b95528-ec6d-462a-abd7-cd2ada7cbb6e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:42.451767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1068/2105] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:36:42 2022] POST /identity/v3/users => generated 292 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:36:42.453161 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1038/2106] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:42.457549 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b95528-ec6d-462a-abd7-cd2ada7cbb6e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:42.480300 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c323024-31d6-4638-b32b-85f586466ee9 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:42.483971 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2c323024-31d6-4638-b32b-85f586466ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:42.484924 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b95528-ec6d-462a-abd7-cd2ada7cbb6e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:42.498960 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc33c1e-03f1-4c18-955c-850a98595f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:42.499824 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc33c1e-03f1-4c18-955c-850a98595f35 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:42.500101 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc33c1e-03f1-4c18-955c-850a98595f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:42.500371 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc33c1e-03f1-4c18-955c-850a98595f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:42.501203 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc33c1e-03f1-4c18-955c-850a98595f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:42.503852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc33c1e-03f1-4c18-955c-850a98595f35 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:42.523845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1069/2107] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:42.525524 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc33c1e-03f1-4c18-955c-850a98595f35 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:42.550519 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc33c1e-03f1-4c18-955c-850a98595f35 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:42.562668 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069cdf5-8f21-460d-a2d1-760f5a3ee28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:42.563311 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069cdf5-8f21-460d-a2d1-760f5a3ee28e admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:42.563588 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069cdf5-8f21-460d-a2d1-760f5a3ee28e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:42.563859 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069cdf5-8f21-460d-a2d1-760f5a3ee28e admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:42.564881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7069cdf5-8f21-460d-a2d1-760f5a3ee28e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:42.566975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7069cdf5-8f21-460d-a2d1-760f5a3ee28e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:42.595124 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1070/2108] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:42.600350 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069cdf5-8f21-460d-a2d1-760f5a3ee28e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:42.635141 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069cdf5-8f21-460d-a2d1-760f5a3ee28e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:42.653017 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed60f7-764c-453d-bec4-437cb6ddcaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:42.656228 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed60f7-764c-453d-bec4-437cb6ddcaac admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:42.656528 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed60f7-764c-453d-bec4-437cb6ddcaac admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:42.657930 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed60f7-764c-453d-bec4-437cb6ddcaac admin admin] PATH_INFO: `/v3/projects/8e8eb2f1d7e1423c93b47914c90553f0/users/4f61b87034974b79a964fd242db8585f/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:42.663991 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:42.673513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:42.721473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed60f7-764c-453d-bec4-437cb6ddcaac admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e8eb2f1d7e1423c93b47914c90553f0, user_id=4f61b87034974b79a964fd242db8585f, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:42.729185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed60f7-764c-453d-bec4-437cb6ddcaac admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:42.742120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c323024-31d6-4638-b32b-85f586466ee9 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:42.751679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81514a7-8bf8-4c29-827f-b4b838e36854 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:42.752317 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81514a7-8bf8-4c29-827f-b4b838e36854 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:42.752594 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81514a7-8bf8-4c29-827f-b4b838e36854 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:42.752993 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81514a7-8bf8-4c29-827f-b4b838e36854 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:42.763200 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1071/2109] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:42 2022] PUT /identity/v3/projects/8e8eb2f1d7e1423c93b47914c90553f0/users/4f61b87034974b79a964fd242db8585f/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:42.766678 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81514a7-8bf8-4c29-827f-b4b838e36854 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:42.770326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de435d1-28aa-48e0-a0fc-a955a8987b8e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:42.771437 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de435d1-28aa-48e0-a0fc-a955a8987b8e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:42.771598 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81514a7-8bf8-4c29-827f-b4b838e36854 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:42.772526 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de435d1-28aa-48e0-a0fc-a955a8987b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:42.784339 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1039/2110] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:42 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:42.811979 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4de435d1-28aa-48e0-a0fc-a955a8987b8e None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:42.813676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4de435d1-28aa-48e0-a0fc-a955a8987b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:42.952691 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1072/2111] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:36:42.961913 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81514a7-8bf8-4c29-827f-b4b838e36854 service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:42.963758 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a81514a7-8bf8-4c29-827f-b4b838e36854 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:43.173274 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81514a7-8bf8-4c29-827f-b4b838e36854 service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:43.277058 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878166f1-c6ec-49f3-82a8-d9e0d443f1ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:43.278008 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878166f1-c6ec-49f3-82a8-d9e0d443f1ef service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:43.278528 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878166f1-c6ec-49f3-82a8-d9e0d443f1ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:43.278781 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878166f1-c6ec-49f3-82a8-d9e0d443f1ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:43.295417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878166f1-c6ec-49f3-82a8-d9e0d443f1ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:43.297558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878166f1-c6ec-49f3-82a8-d9e0d443f1ef service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:43.314539 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1040/2112] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:44.430105 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480576a9-b45e-4eb1-b6e6-eebaa32e0782 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:44.430105 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480576a9-b45e-4eb1-b6e6-eebaa32e0782 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:44.430105 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480576a9-b45e-4eb1-b6e6-eebaa32e0782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:44.503122 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-480576a9-b45e-4eb1-b6e6-eebaa32e0782 None None] MFA Rules not processed for user `ed5158b5364c4e10a2128e3d098048ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:44.506518 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-480576a9-b45e-4eb1-b6e6-eebaa32e0782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:44.516836 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878166f1-c6ec-49f3-82a8-d9e0d443f1ef service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:44.519479 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-878166f1-c6ec-49f3-82a8-d9e0d443f1ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:44.577498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878166f1-c6ec-49f3-82a8-d9e0d443f1ef service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:44.602978 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1476448-c5f2-4615-9abf-1cc274048ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:44.603811 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1476448-c5f2-4615-9abf-1cc274048ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:44.604100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1476448-c5f2-4615-9abf-1cc274048ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:44.604390 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1476448-c5f2-4615-9abf-1cc274048ac5 admin admin] PATH_INFO: `/v3/users/b1fff3ce647c414991e752a1e769c52a` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:44.608472 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1476448-c5f2-4615-9abf-1cc274048ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1fff3ce647c414991e752a1e769c52a)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:44.610480 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1476448-c5f2-4615-9abf-1cc274048ac5 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:44.670570 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1073/2113] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:44.742916 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d1476448-c5f2-4615-9abf-1cc274048ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1fff3ce647c414991e752a1e769c52a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:44.765706 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d1476448-c5f2-4615-9abf-1cc274048ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1fff3ce647c414991e752a1e769c52a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:44.766615 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d1476448-c5f2-4615-9abf-1cc274048ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1fff3ce647c414991e752a1e769c52a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:44.767368 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d1476448-c5f2-4615-9abf-1cc274048ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1fff3ce647c414991e752a1e769c52a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:44.778453 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d1476448-c5f2-4615-9abf-1cc274048ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1fff3ce647c414991e752a1e769c52a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:44.804662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:44.847573 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1041/2114] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:44 2022] DELETE /identity/v3/users/b1fff3ce647c414991e752a1e769c52a => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:36:44.853636 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994e59a-44e7-4cc8-867b-083c17cc5032 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:44.855310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994e59a-44e7-4cc8-867b-083c17cc5032 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:44.855657 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994e59a-44e7-4cc8-867b-083c17cc5032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:44.898706 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e994e59a-44e7-4cc8-867b-083c17cc5032 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:44.901234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e994e59a-44e7-4cc8-867b-083c17cc5032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:45.052882 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1074/2115] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:45.076494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1476448-c5f2-4615-9abf-1cc274048ac5 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:45.084798 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d1476448-c5f2-4615-9abf-1cc274048ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:45.177883 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17673694-70df-43cb-bf46-f4b1e66f9b8b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:45.177883 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17673694-70df-43cb-bf46-f4b1e66f9b8b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:45.177883 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17673694-70df-43cb-bf46-f4b1e66f9b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:45.204605 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1476448-c5f2-4615-9abf-1cc274048ac5 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:45.209353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d41edd-2cf2-4f1b-a651-a6d72e52e03c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:45.209865 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d41edd-2cf2-4f1b-a651-a6d72e52e03c service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:45.210349 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d41edd-2cf2-4f1b-a651-a6d72e52e03c service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:45.210505 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d41edd-2cf2-4f1b-a651-a6d72e52e03c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:45.224253 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d41edd-2cf2-4f1b-a651-a6d72e52e03c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:45.227185 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d41edd-2cf2-4f1b-a651-a6d72e52e03c service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:45.249902 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-17673694-70df-43cb-bf46-f4b1e66f9b8b None None] MFA Rules not processed for user `4f61b87034974b79a964fd242db8585f`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:45.251238 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-17673694-70df-43cb-bf46-f4b1e66f9b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:45.257308 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1042/2116] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:45.322529 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:45.481847 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1075/2117] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:45.539926 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d41edd-2cf2-4f1b-a651-a6d72e52e03c service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:45.541361 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-19d41edd-2cf2-4f1b-a651-a6d72e52e03c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:45.860817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d41edd-2cf2-4f1b-a651-a6d72e52e03c service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:45.904783 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8da5c3-794c-485b-a104-9ac586e3966b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:45.907490 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8da5c3-794c-485b-a104-9ac586e3966b service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:45.910009 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8da5c3-794c-485b-a104-9ac586e3966b service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:45.910839 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8da5c3-794c-485b-a104-9ac586e3966b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:45.984469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8da5c3-794c-485b-a104-9ac586e3966b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:45.986041 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8da5c3-794c-485b-a104-9ac586e3966b service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:46.036893 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1043/2118] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:46.276917 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17673694-70df-43cb-bf46-f4b1e66f9b8b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:46.280746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-17673694-70df-43cb-bf46-f4b1e66f9b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:46.382675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17673694-70df-43cb-bf46-f4b1e66f9b8b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:46.398069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9cd9d5-d5ad-417f-9b31-14cf7f540a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:46.398737 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cd9d5-d5ad-417f-9b31-14cf7f540a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:46.399021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cd9d5-d5ad-417f-9b31-14cf7f540a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:46.399359 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cd9d5-d5ad-417f-9b31-14cf7f540a6a admin admin] PATH_INFO: `/v3/projects/b947765e05884670bbfa8895ad4f46ba` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:46.402001 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9cd9d5-d5ad-417f-9b31-14cf7f540a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b947765e05884670bbfa8895ad4f46ba)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:46.406741 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9cd9d5-d5ad-417f-9b31-14cf7f540a6a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:46.496488 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6c9cd9d5-d5ad-417f-9b31-14cf7f540a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b947765e05884670bbfa8895ad4f46ba', 'request_id': 'req-6c9cd9d5-d5ad-417f-9b31-14cf7f540a6a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:46.513063 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6c9cd9d5-d5ad-417f-9b31-14cf7f540a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b947765e05884670bbfa8895ad4f46ba', 'request_id': 'req-6c9cd9d5-d5ad-417f-9b31-14cf7f540a6a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:46.528292 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6c9cd9d5-d5ad-417f-9b31-14cf7f540a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b947765e05884670bbfa8895ad4f46ba', 'request_id': 'req-6c9cd9d5-d5ad-417f-9b31-14cf7f540a6a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:46.553255 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6c9cd9d5-d5ad-417f-9b31-14cf7f540a6a admin admin] The token cache is being invalidate because project b947765e05884670bbfa8895ad4f46ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:46.553898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6c9cd9d5-d5ad-417f-9b31-14cf7f540a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:46.554772 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6c9cd9d5-d5ad-417f-9b31-14cf7f540a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:46.557346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1076/2119] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:46 2022] DELETE /identity/v3/projects/b947765e05884670bbfa8895ad4f46ba => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:46.563084 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8da5c3-794c-485b-a104-9ac586e3966b service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:46.584795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8da5c3-794c-485b-a104-9ac586e3966b service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:46.731951 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b6b16-495d-4d33-95df-af07102243f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:46.734447 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b6b16-495d-4d33-95df-af07102243f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:46.734756 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b6b16-495d-4d33-95df-af07102243f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:46.735037 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b6b16-495d-4d33-95df-af07102243f2 admin admin] PATH_INFO: `/v3/users/473cd00f357f4e6baa22c17e9de3c461` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:46.737004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b6b16-495d-4d33-95df-af07102243f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=473cd00f357f4e6baa22c17e9de3c461)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:46.739688 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b6b16-495d-4d33-95df-af07102243f2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:46.872664 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:46.892776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-de7b6b16-495d-4d33-95df-af07102243f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '473cd00f357f4e6baa22c17e9de3c461'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:46.941742 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-de7b6b16-495d-4d33-95df-af07102243f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '473cd00f357f4e6baa22c17e9de3c461'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:46.942891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-de7b6b16-495d-4d33-95df-af07102243f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '473cd00f357f4e6baa22c17e9de3c461'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:46.944177 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-de7b6b16-495d-4d33-95df-af07102243f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '473cd00f357f4e6baa22c17e9de3c461'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:46.966060 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-de7b6b16-495d-4d33-95df-af07102243f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '473cd00f357f4e6baa22c17e9de3c461'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:46.986322 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1044/2120] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:46 2022] DELETE /identity/v3/users/473cd00f357f4e6baa22c17e9de3c461 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:36:47.709019 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9cd9d5-d5ad-417f-9b31-14cf7f540a6a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:47.711906 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6c9cd9d5-d5ad-417f-9b31-14cf7f540a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:47.743182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9cd9d5-d5ad-417f-9b31-14cf7f540a6a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:47.961342 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d19195-b2a4-4d7f-829d-4df08c9a6c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:47.962795 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d19195-b2a4-4d7f-829d-4df08c9a6c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:47.963294 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d19195-b2a4-4d7f-829d-4df08c9a6c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:47.963804 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d19195-b2a4-4d7f-829d-4df08c9a6c77 admin admin] PATH_INFO: `/v3/projects/0c889e4ed7c3497ab78f1048f7a0138c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:47.966485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d19195-b2a4-4d7f-829d-4df08c9a6c77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c889e4ed7c3497ab78f1048f7a0138c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:47.968596 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d19195-b2a4-4d7f-829d-4df08c9a6c77 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:48.126967 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:48.157168 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-67d19195-b2a4-4d7f-829d-4df08c9a6c77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c889e4ed7c3497ab78f1048f7a0138c', 'request_id': 'req-67d19195-b2a4-4d7f-829d-4df08c9a6c77'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:48.171507 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc99c55-2cc2-4a25-8112-deb6f2220d08 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:48.174753 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc99c55-2cc2-4a25-8112-deb6f2220d08 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:48.175516 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc99c55-2cc2-4a25-8112-deb6f2220d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:48.218684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-67d19195-b2a4-4d7f-829d-4df08c9a6c77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c889e4ed7c3497ab78f1048f7a0138c', 'request_id': 'req-67d19195-b2a4-4d7f-829d-4df08c9a6c77'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:48.243642 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-67d19195-b2a4-4d7f-829d-4df08c9a6c77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c889e4ed7c3497ab78f1048f7a0138c', 'request_id': 'req-67d19195-b2a4-4d7f-829d-4df08c9a6c77'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:48.259623 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-cdc99c55-2cc2-4a25-8112-deb6f2220d08 None None] MFA Rules not processed for user `4f61b87034974b79a964fd242db8585f`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:48.281910 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cdc99c55-2cc2-4a25-8112-deb6f2220d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:48.315881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-67d19195-b2a4-4d7f-829d-4df08c9a6c77 admin admin] The token cache is being invalidate because project 0c889e4ed7c3497ab78f1048f7a0138c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:48.317038 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-67d19195-b2a4-4d7f-829d-4df08c9a6c77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:48.326142 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-67d19195-b2a4-4d7f-829d-4df08c9a6c77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:48.340451 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1077/2121] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:47 2022] DELETE /identity/v3/projects/0c889e4ed7c3497ab78f1048f7a0138c => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:48.343730 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5d04c-a6f0-4194-9d30-84041e1f489d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:48.344450 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5d04c-a6f0-4194-9d30-84041e1f489d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:48.345544 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5d04c-a6f0-4194-9d30-84041e1f489d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:48.426196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6af5d04c-a6f0-4194-9d30-84041e1f489d None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:48.429913 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6af5d04c-a6f0-4194-9d30-84041e1f489d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:48.518863 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1045/2122] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:36:48.661908 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1078/2123] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:48.676852 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721bdae-1310-4096-a0cc-491a6014614d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:48.677685 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721bdae-1310-4096-a0cc-491a6014614d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:48.678169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721bdae-1310-4096-a0cc-491a6014614d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:48.751610 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-0721bdae-1310-4096-a0cc-491a6014614d None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:48.759205 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0721bdae-1310-4096-a0cc-491a6014614d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:48.804268 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5d04c-a6f0-4194-9d30-84041e1f489d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:48.804845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1046/2124] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:48.820665 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5d04c-a6f0-4194-9d30-84041e1f489d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:48.828345 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271d837-4021-4dd6-ab66-5e500e7271d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:48.829517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271d837-4021-4dd6-ab66-5e500e7271d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:48.831499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271d837-4021-4dd6-ab66-5e500e7271d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:48.832414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271d837-4021-4dd6-ab66-5e500e7271d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:48.833622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271d837-4021-4dd6-ab66-5e500e7271d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:36:48.834192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271d837-4021-4dd6-ab66-5e500e7271d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:48.836427 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271d837-4021-4dd6-ab66-5e500e7271d5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:48.860324 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1079/2125] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:36:48.866847 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721bdae-1310-4096-a0cc-491a6014614d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:48.886556 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721bdae-1310-4096-a0cc-491a6014614d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:48.898931 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012fc79-e93f-4b02-b60b-d9ab8a3383f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:48.900755 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012fc79-e93f-4b02-b60b-d9ab8a3383f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:48.901658 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012fc79-e93f-4b02-b60b-d9ab8a3383f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:48.902335 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012fc79-e93f-4b02-b60b-d9ab8a3383f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:48.903298 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012fc79-e93f-4b02-b60b-d9ab8a3383f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:48.907847 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012fc79-e93f-4b02-b60b-d9ab8a3383f9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:48.987396 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1047/2126] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:36:48 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:48.991993 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271d837-4021-4dd6-ab66-5e500e7271d5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:49.021300 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271d837-4021-4dd6-ab66-5e500e7271d5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:49.145893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42074fd9-c8b9-4e9e-8fa6-c853f5c2d0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:49.147059 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42074fd9-c8b9-4e9e-8fa6-c853f5c2d0ab admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:49.147629 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42074fd9-c8b9-4e9e-8fa6-c853f5c2d0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:49.148182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42074fd9-c8b9-4e9e-8fa6-c853f5c2d0ab admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:49.149706 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42074fd9-c8b9-4e9e-8fa6-c853f5c2d0ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:49.164975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42074fd9-c8b9-4e9e-8fa6-c853f5c2d0ab admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:49.251054 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1080/2127] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:36:48 2022] POST /identity/v3/users => generated 292 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:49.252585 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012fc79-e93f-4b02-b60b-d9ab8a3383f9 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:49.270259 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012fc79-e93f-4b02-b60b-d9ab8a3383f9 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:49.290596 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a4c2f-3754-4b39-871c-280e88421c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:49.294813 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a4c2f-3754-4b39-871c-280e88421c61 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:49.295486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a4c2f-3754-4b39-871c-280e88421c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:49.296553 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a4c2f-3754-4b39-871c-280e88421c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:49.297808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a4c2f-3754-4b39-871c-280e88421c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:49.299974 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a4c2f-3754-4b39-871c-280e88421c61 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:49.329437 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1048/2128] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:49.334428 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42074fd9-c8b9-4e9e-8fa6-c853f5c2d0ab admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:49.349559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42074fd9-c8b9-4e9e-8fa6-c853f5c2d0ab admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:49.355489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5367dd-9309-4ed9-b7fe-38195d1c48e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:49.356677 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5367dd-9309-4ed9-b7fe-38195d1c48e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:49.356677 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5367dd-9309-4ed9-b7fe-38195d1c48e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:49.356877 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5367dd-9309-4ed9-b7fe-38195d1c48e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:49.361740 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5367dd-9309-4ed9-b7fe-38195d1c48e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:49.366372 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5367dd-9309-4ed9-b7fe-38195d1c48e0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:49.396668 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1081/2129] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:49.400952 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a4c2f-3754-4b39-871c-280e88421c61 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:49.413567 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a4c2f-3754-4b39-871c-280e88421c61 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:49.420480 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb8cb6-88a1-4a44-ae73-7de62b243595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:49.421475 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb8cb6-88a1-4a44-ae73-7de62b243595 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:49.422058 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb8cb6-88a1-4a44-ae73-7de62b243595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:49.422168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb8cb6-88a1-4a44-ae73-7de62b243595 admin admin] PATH_INFO: `/v3/projects/52187fd97817417987fba0b20f48e26b/users/c99fb47eda3c4204aa61e0f078bfa4df/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:49.535380 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb8cb6-88a1-4a44-ae73-7de62b243595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52187fd97817417987fba0b20f48e26b, user_id=c99fb47eda3c4204aa61e0f078bfa4df, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:49.540486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb8cb6-88a1-4a44-ae73-7de62b243595 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:49.635168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1049/2130] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:49 2022] PUT /identity/v3/projects/52187fd97817417987fba0b20f48e26b/users/c99fb47eda3c4204aa61e0f078bfa4df/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:49.644455 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e31e93-2c21-443b-af48-e5ca3b6bc33d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:49.645301 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e31e93-2c21-443b-af48-e5ca3b6bc33d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:49.646824 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e31e93-2c21-443b-af48-e5ca3b6bc33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:49.847691 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-72e31e93-2c21-443b-af48-e5ca3b6bc33d None None] MFA Rules not processed for user `c99fb47eda3c4204aa61e0f078bfa4df`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:49.850040 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-72e31e93-2c21-443b-af48-e5ca3b6bc33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:49.990116 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:50.117858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1082/2131] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:50.132662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb8cb6-88a1-4a44-ae73-7de62b243595 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:50.135469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b6bb8cb6-88a1-4a44-ae73-7de62b243595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:50.355357 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb8cb6-88a1-4a44-ae73-7de62b243595 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:50.363054 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acd5a9-5a81-4963-a699-63f610f24ff0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:50.364513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acd5a9-5a81-4963-a699-63f610f24ff0 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:50.366653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acd5a9-5a81-4963-a699-63f610f24ff0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:50.367370 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acd5a9-5a81-4963-a699-63f610f24ff0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:50.393103 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acd5a9-5a81-4963-a699-63f610f24ff0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:50.408109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acd5a9-5a81-4963-a699-63f610f24ff0 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:50.477460 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1050/2132] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:56.314272 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e31e93-2c21-443b-af48-e5ca3b6bc33d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:56.319380 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-72e31e93-2c21-443b-af48-e5ca3b6bc33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:56.480555 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e31e93-2c21-443b-af48-e5ca3b6bc33d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:56.487805 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82deb4-81d5-44cf-90d4-91dcec1d8672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:56.488834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82deb4-81d5-44cf-90d4-91dcec1d8672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:56.489370 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82deb4-81d5-44cf-90d4-91dcec1d8672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:56.489848 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82deb4-81d5-44cf-90d4-91dcec1d8672 admin admin] PATH_INFO: `/v3/users/74c07ca9deb64410b29beaead7223ff6` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:56.491516 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82deb4-81d5-44cf-90d4-91dcec1d8672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74c07ca9deb64410b29beaead7223ff6)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:56.494506 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82deb4-81d5-44cf-90d4-91dcec1d8672 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:56.644212 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3d82deb4-81d5-44cf-90d4-91dcec1d8672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74c07ca9deb64410b29beaead7223ff6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:56.709413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3d82deb4-81d5-44cf-90d4-91dcec1d8672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74c07ca9deb64410b29beaead7223ff6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:56.710227 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3d82deb4-81d5-44cf-90d4-91dcec1d8672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74c07ca9deb64410b29beaead7223ff6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:56.740940 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3d82deb4-81d5-44cf-90d4-91dcec1d8672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74c07ca9deb64410b29beaead7223ff6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:56.757634 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3d82deb4-81d5-44cf-90d4-91dcec1d8672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74c07ca9deb64410b29beaead7223ff6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:56.790631 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1083/2133] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:56 2022] DELETE /identity/v3/users/74c07ca9deb64410b29beaead7223ff6 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:36:57.704568 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acd5a9-5a81-4963-a699-63f610f24ff0 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:57.719521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:57.756724 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acd5a9-5a81-4963-a699-63f610f24ff0 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:57.893226 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7210e4-b6de-48f9-9b99-904ace14b428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:57.894517 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7210e4-b6de-48f9-9b99-904ace14b428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:57.895019 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7210e4-b6de-48f9-9b99-904ace14b428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:57.895768 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7210e4-b6de-48f9-9b99-904ace14b428 admin admin] PATH_INFO: `/v3/projects/3406aadf651f451bb21a3ac2ce2bcb49` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:57.898703 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7210e4-b6de-48f9-9b99-904ace14b428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3406aadf651f451bb21a3ac2ce2bcb49)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:57.905460 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7210e4-b6de-48f9-9b99-904ace14b428 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:58.026568 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ca7210e4-b6de-48f9-9b99-904ace14b428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3406aadf651f451bb21a3ac2ce2bcb49', 'request_id': 'req-ca7210e4-b6de-48f9-9b99-904ace14b428'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:58.038848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ca7210e4-b6de-48f9-9b99-904ace14b428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3406aadf651f451bb21a3ac2ce2bcb49', 'request_id': 'req-ca7210e4-b6de-48f9-9b99-904ace14b428'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:58.051656 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ca7210e4-b6de-48f9-9b99-904ace14b428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3406aadf651f451bb21a3ac2ce2bcb49', 'request_id': 'req-ca7210e4-b6de-48f9-9b99-904ace14b428'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:58.130144 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ca7210e4-b6de-48f9-9b99-904ace14b428 admin admin] The token cache is being invalidate because project 3406aadf651f451bb21a3ac2ce2bcb49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:58.131712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ca7210e4-b6de-48f9-9b99-904ace14b428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:58.132685 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ca7210e4-b6de-48f9-9b99-904ace14b428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:58.135708 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1051/2134] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:57 2022] DELETE /identity/v3/projects/3406aadf651f451bb21a3ac2ce2bcb49 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:58.142821 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82deb4-81d5-44cf-90d4-91dcec1d8672 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:58.146891 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3d82deb4-81d5-44cf-90d4-91dcec1d8672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:58.168968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82deb4-81d5-44cf-90d4-91dcec1d8672 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:58.306596 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:58.347091 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73523dd2-6695-4631-b4c5-c72708b622f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:58.348535 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73523dd2-6695-4631-b4c5-c72708b622f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:58.349152 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73523dd2-6695-4631-b4c5-c72708b622f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:58.349769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73523dd2-6695-4631-b4c5-c72708b622f0 admin admin] PATH_INFO: `/v3/users/c1ebbdddfed74f2eb519f5344b2377ac` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:58.351448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73523dd2-6695-4631-b4c5-c72708b622f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1ebbdddfed74f2eb519f5344b2377ac)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:58.354216 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73523dd2-6695-4631-b4c5-c72708b622f0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:58.380199 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7210e4-b6de-48f9-9b99-904ace14b428 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:58.382196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ca7210e4-b6de-48f9-9b99-904ace14b428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:58.414035 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7210e4-b6de-48f9-9b99-904ace14b428 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:58.431673 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7416e9-49d7-4804-937c-2f0d656c6265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:58.436303 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7416e9-49d7-4804-937c-2f0d656c6265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:58.436852 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7416e9-49d7-4804-937c-2f0d656c6265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:58.439548 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7416e9-49d7-4804-937c-2f0d656c6265 admin admin] PATH_INFO: `/v3/users/c99fb47eda3c4204aa61e0f078bfa4df` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:58.441268 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7416e9-49d7-4804-937c-2f0d656c6265 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c99fb47eda3c4204aa61e0f078bfa4df)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:58.459481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7416e9-49d7-4804-937c-2f0d656c6265 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:58.503705 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-73523dd2-6695-4631-b4c5-c72708b622f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1ebbdddfed74f2eb519f5344b2377ac'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:58.564344 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-73523dd2-6695-4631-b4c5-c72708b622f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1ebbdddfed74f2eb519f5344b2377ac'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:58.569138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-73523dd2-6695-4631-b4c5-c72708b622f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1ebbdddfed74f2eb519f5344b2377ac'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:58.593212 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-73523dd2-6695-4631-b4c5-c72708b622f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1ebbdddfed74f2eb519f5344b2377ac'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:58.627700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-73523dd2-6695-4631-b4c5-c72708b622f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1ebbdddfed74f2eb519f5344b2377ac'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:58.649367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1084/2135] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:58 2022] DELETE /identity/v3/users/c1ebbdddfed74f2eb519f5344b2377ac => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:36:58.656094 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ff7416e9-49d7-4804-937c-2f0d656c6265 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c99fb47eda3c4204aa61e0f078bfa4df'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:58.691170 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ff7416e9-49d7-4804-937c-2f0d656c6265 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c99fb47eda3c4204aa61e0f078bfa4df'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:58.691964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ff7416e9-49d7-4804-937c-2f0d656c6265 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c99fb47eda3c4204aa61e0f078bfa4df'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:58.698485 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ff7416e9-49d7-4804-937c-2f0d656c6265 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c99fb47eda3c4204aa61e0f078bfa4df'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:58.712889 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ff7416e9-49d7-4804-937c-2f0d656c6265 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c99fb47eda3c4204aa61e0f078bfa4df'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:58.764921 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1052/2136] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:58 2022] DELETE /identity/v3/users/c99fb47eda3c4204aa61e0f078bfa4df => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:36:58.769591 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46708854-9068-41e2-8804-6e271b1587c7 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:58.770526 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46708854-9068-41e2-8804-6e271b1587c7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:58.770841 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46708854-9068-41e2-8804-6e271b1587c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:58.797166 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-46708854-9068-41e2-8804-6e271b1587c7 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:58.798444 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-46708854-9068-41e2-8804-6e271b1587c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:58.921590 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1085/2137] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:58.933393 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7416e9-49d7-4804-937c-2f0d656c6265 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:58.935124 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ff7416e9-49d7-4804-937c-2f0d656c6265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:58.954023 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:59.028863 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7416e9-49d7-4804-937c-2f0d656c6265 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:59.034996 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67290e07-64e6-46c7-b44b-b1baae436bb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:59.035942 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67290e07-64e6-46c7-b44b-b1baae436bb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:59.036410 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67290e07-64e6-46c7-b44b-b1baae436bb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:59.036901 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67290e07-64e6-46c7-b44b-b1baae436bb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:59.050461 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67290e07-64e6-46c7-b44b-b1baae436bb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:59.052326 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67290e07-64e6-46c7-b44b-b1baae436bb8 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:59.102954 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1053/2138] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:36:59.241523 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46708854-9068-41e2-8804-6e271b1587c7 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:59.243162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-46708854-9068-41e2-8804-6e271b1587c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:59.262357 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46708854-9068-41e2-8804-6e271b1587c7 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:59.278870 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588c07a-5c78-40e5-b676-eeee0cece6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:59.280582 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588c07a-5c78-40e5-b676-eeee0cece6c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:59.281262 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588c07a-5c78-40e5-b676-eeee0cece6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:59.282489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588c07a-5c78-40e5-b676-eeee0cece6c3 admin admin] PATH_INFO: `/v3/projects/c83cbb47a1634acf97172ef502524743` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:59.287049 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588c07a-5c78-40e5-b676-eeee0cece6c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c83cbb47a1634acf97172ef502524743)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:59.289555 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588c07a-5c78-40e5-b676-eeee0cece6c3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:59.503775 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c588c07a-5c78-40e5-b676-eeee0cece6c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c83cbb47a1634acf97172ef502524743', 'request_id': 'req-c588c07a-5c78-40e5-b676-eeee0cece6c3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:59.519899 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c588c07a-5c78-40e5-b676-eeee0cece6c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c83cbb47a1634acf97172ef502524743', 'request_id': 'req-c588c07a-5c78-40e5-b676-eeee0cece6c3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:59.535562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c588c07a-5c78-40e5-b676-eeee0cece6c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c83cbb47a1634acf97172ef502524743', 'request_id': 'req-c588c07a-5c78-40e5-b676-eeee0cece6c3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:59.540858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:59.577076 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c588c07a-5c78-40e5-b676-eeee0cece6c3 admin admin] The token cache is being invalidate because project c83cbb47a1634acf97172ef502524743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:59.577579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c588c07a-5c78-40e5-b676-eeee0cece6c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:59.579532 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c588c07a-5c78-40e5-b676-eeee0cece6c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:59.584517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1086/2139] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:59 2022] DELETE /identity/v3/projects/c83cbb47a1634acf97172ef502524743 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:36:59.592783 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1acae-5c22-49a1-93be-ea0195ea1728 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:59.593254 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1acae-5c22-49a1-93be-ea0195ea1728 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:59.593737 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1acae-5c22-49a1-93be-ea0195ea1728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:59.651081 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-14b1acae-5c22-49a1-93be-ea0195ea1728 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:59.653264 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-14b1acae-5c22-49a1-93be-ea0195ea1728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:59.878409 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1054/2140] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:59.892451 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1505a2d-e564-421d-b4d7-8dc79ff166eb None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:59.893117 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1505a2d-e564-421d-b4d7-8dc79ff166eb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:59.893604 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1505a2d-e564-421d-b4d7-8dc79ff166eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:59.974006 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a1505a2d-e564-421d-b4d7-8dc79ff166eb None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:59.975574 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a1505a2d-e564-421d-b4d7-8dc79ff166eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:00.012908 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1087/2141] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 01 16:37:00.020669 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1acae-5c22-49a1-93be-ea0195ea1728 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:00.050953 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1acae-5c22-49a1-93be-ea0195ea1728 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:00.065118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c04887-8abc-420c-9eda-2019a7a5b69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:00.066174 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c04887-8abc-420c-9eda-2019a7a5b69f admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:00.067061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c04887-8abc-420c-9eda-2019a7a5b69f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:00.069816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c04887-8abc-420c-9eda-2019a7a5b69f admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:00.077582 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c04887-8abc-420c-9eda-2019a7a5b69f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:37:00.078304 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c04887-8abc-420c-9eda-2019a7a5b69f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:00.084909 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c04887-8abc-420c-9eda-2019a7a5b69f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:00.130601 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1055/2142] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:37:00.137188 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1505a2d-e564-421d-b4d7-8dc79ff166eb None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:00.168679 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1505a2d-e564-421d-b4d7-8dc79ff166eb None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:00.189242 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da64cb4-7855-40e7-8e4e-a0b691f17bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:00.190407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da64cb4-7855-40e7-8e4e-a0b691f17bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:00.192556 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da64cb4-7855-40e7-8e4e-a0b691f17bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:00.194513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da64cb4-7855-40e7-8e4e-a0b691f17bc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:00.195958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da64cb4-7855-40e7-8e4e-a0b691f17bc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:00.200112 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da64cb4-7855-40e7-8e4e-a0b691f17bc1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:00.253299 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c04887-8abc-420c-9eda-2019a7a5b69f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:00.257070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-08c04887-8abc-420c-9eda-2019a7a5b69f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:00.317433 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c04887-8abc-420c-9eda-2019a7a5b69f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:00.327993 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1088/2143] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:00 2022] POST /identity/v3/projects => generated 371 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:00.331450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c57e2-089c-4684-844a-e91d92fd02e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:00.334169 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da64cb4-7855-40e7-8e4e-a0b691f17bc1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:00.336102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c57e2-089c-4684-844a-e91d92fd02e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:00.339707 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c57e2-089c-4684-844a-e91d92fd02e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:00.341024 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c57e2-089c-4684-844a-e91d92fd02e7 admin admin] PATH_INFO: `/v3/projects/52187fd97817417987fba0b20f48e26b` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:00.345875 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c57e2-089c-4684-844a-e91d92fd02e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52187fd97817417987fba0b20f48e26b)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:00.352263 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c57e2-089c-4684-844a-e91d92fd02e7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:00.556825 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-212c57e2-089c-4684-844a-e91d92fd02e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52187fd97817417987fba0b20f48e26b', 'request_id': 'req-212c57e2-089c-4684-844a-e91d92fd02e7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:00.587401 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-212c57e2-089c-4684-844a-e91d92fd02e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52187fd97817417987fba0b20f48e26b', 'request_id': 'req-212c57e2-089c-4684-844a-e91d92fd02e7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:00.618290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-212c57e2-089c-4684-844a-e91d92fd02e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52187fd97817417987fba0b20f48e26b', 'request_id': 'req-212c57e2-089c-4684-844a-e91d92fd02e7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:00.622125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da64cb4-7855-40e7-8e4e-a0b691f17bc1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:00.667757 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-212c57e2-089c-4684-844a-e91d92fd02e7 admin admin] The token cache is being invalidate because project 52187fd97817417987fba0b20f48e26b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:00.672775 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-212c57e2-089c-4684-844a-e91d92fd02e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:00.676260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-212c57e2-089c-4684-844a-e91d92fd02e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:00.684906 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1056/2144] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:00 2022] DELETE /identity/v3/projects/52187fd97817417987fba0b20f48e26b => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:37:00.693967 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44fd4d-700a-4f0f-9f61-ea949315c66f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:00.694958 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44fd4d-700a-4f0f-9f61-ea949315c66f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:00.695742 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44fd4d-700a-4f0f-9f61-ea949315c66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:00.787548 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1a44fd4d-700a-4f0f-9f61-ea949315c66f None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:00.789439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1a44fd4d-700a-4f0f-9f61-ea949315c66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:00.901041 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:00.913342 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412fe74-1c92-4daf-b528-e63aa339c28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:00.914591 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412fe74-1c92-4daf-b528-e63aa339c28b admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:00.915175 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412fe74-1c92-4daf-b528-e63aa339c28b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:00.915662 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412fe74-1c92-4daf-b528-e63aa339c28b admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:00.916971 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412fe74-1c92-4daf-b528-e63aa339c28b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:00.921082 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412fe74-1c92-4daf-b528-e63aa339c28b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:01.025044 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1089/2145] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:00 2022] POST /identity/v3/users => generated 286 bytes in 692 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:37:01.031174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412fe74-1c92-4daf-b528-e63aa339c28b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:01.047484 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5412fe74-1c92-4daf-b528-e63aa339c28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:01.068001 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412fe74-1c92-4daf-b528-e63aa339c28b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:01.078715 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1057/2146] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:01.090917 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea79a52-9382-43e6-9777-4d18d530d583 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:01.091095 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea79a52-9382-43e6-9777-4d18d530d583 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:01.091359 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea79a52-9382-43e6-9777-4d18d530d583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:01.093275 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec49f5-97ad-4a66-b3fe-c36912261a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:01.094634 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec49f5-97ad-4a66-b3fe-c36912261a53 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:01.095346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec49f5-97ad-4a66-b3fe-c36912261a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:01.096063 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec49f5-97ad-4a66-b3fe-c36912261a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:01.097460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec49f5-97ad-4a66-b3fe-c36912261a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:01.105747 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec49f5-97ad-4a66-b3fe-c36912261a53 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:01.142137 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5ea79a52-9382-43e6-9777-4d18d530d583 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:01.143431 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5ea79a52-9382-43e6-9777-4d18d530d583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:01.153059 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1090/2147] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:01.160004 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec49f5-97ad-4a66-b3fe-c36912261a53 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:01.163087 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1058/2148] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:37:01.167989 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea79a52-9382-43e6-9777-4d18d530d583 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:01.184052 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea79a52-9382-43e6-9777-4d18d530d583 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:01.191483 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec49f5-97ad-4a66-b3fe-c36912261a53 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:01.195816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f94d43-8f7c-4448-a88d-d52469bc0d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:01.196446 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f94d43-8f7c-4448-a88d-d52469bc0d6b admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:01.196760 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f94d43-8f7c-4448-a88d-d52469bc0d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:01.197037 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f94d43-8f7c-4448-a88d-d52469bc0d6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:01.197922 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f94d43-8f7c-4448-a88d-d52469bc0d6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:37:01.198217 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f94d43-8f7c-4448-a88d-d52469bc0d6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:01.201744 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f94d43-8f7c-4448-a88d-d52469bc0d6b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:01.205531 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2c690-18c1-4598-a12f-4df6e6d10792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:01.206252 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2c690-18c1-4598-a12f-4df6e6d10792 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:01.208472 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2c690-18c1-4598-a12f-4df6e6d10792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:01.209211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2c690-18c1-4598-a12f-4df6e6d10792 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:01.217509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2c690-18c1-4598-a12f-4df6e6d10792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:01.219988 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2c690-18c1-4598-a12f-4df6e6d10792 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:01.233288 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1059/2149] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:37:01.237549 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1091/2150] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:37:01.237815 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f94d43-8f7c-4448-a88d-d52469bc0d6b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:01.244139 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2c690-18c1-4598-a12f-4df6e6d10792 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:01.248890 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f94d43-8f7c-4448-a88d-d52469bc0d6b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:01.257624 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d93b31-af59-4c9e-a8e9-cae59176c59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:01.258262 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d93b31-af59-4c9e-a8e9-cae59176c59f admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:01.258543 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d93b31-af59-4c9e-a8e9-cae59176c59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:01.258818 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d93b31-af59-4c9e-a8e9-cae59176c59f admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:01.259481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d93b31-af59-4c9e-a8e9-cae59176c59f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:01.261564 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d93b31-af59-4c9e-a8e9-cae59176c59f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:01.269018 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2c690-18c1-4598-a12f-4df6e6d10792 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:01.277841 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1615e2f-bf72-479c-9822-c6782d7608c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:01.279094 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1615e2f-bf72-479c-9822-c6782d7608c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:01.280042 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1615e2f-bf72-479c-9822-c6782d7608c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:01.280348 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1615e2f-bf72-479c-9822-c6782d7608c6 admin admin] PATH_INFO: `/v3/projects/f73a3c6d397641f4a9735e3ac76c5010/users/bc32125d720741bda114622ba112f597/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:01.299803 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1060/2151] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:01 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:37:01.303364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1615e2f-bf72-479c-9822-c6782d7608c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f73a3c6d397641f4a9735e3ac76c5010, user_id=bc32125d720741bda114622ba112f597, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:01.303364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1615e2f-bf72-479c-9822-c6782d7608c6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:01.304797 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d93b31-af59-4c9e-a8e9-cae59176c59f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:01.344887 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1092/2152] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:01 2022] PUT /identity/v3/projects/f73a3c6d397641f4a9735e3ac76c5010/users/bc32125d720741bda114622ba112f597/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:37:01.349632 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c48065-fec6-4c01-9636-27f08cf44b92 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:01.350106 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c48065-fec6-4c01-9636-27f08cf44b92 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:01.353007 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c48065-fec6-4c01-9636-27f08cf44b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:01.405170 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=94,keystone:DELETE=1,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:01.411472 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-02c48065-fec6-4c01-9636-27f08cf44b92 None None] MFA Rules not processed for user `bc32125d720741bda114622ba112f597`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:01.413986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-02c48065-fec6-4c01-9636-27f08cf44b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:01.431287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d93b31-af59-4c9e-a8e9-cae59176c59f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:01.539351 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c90ba8-54cb-4bd5-9d71-9a43321b1e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:01.540302 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c90ba8-54cb-4bd5-9d71-9a43321b1e47 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:01.540800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c90ba8-54cb-4bd5-9d71-9a43321b1e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:01.541244 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c90ba8-54cb-4bd5-9d71-9a43321b1e47 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:01.542409 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c90ba8-54cb-4bd5-9d71-9a43321b1e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:01.547063 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c90ba8-54cb-4bd5-9d71-9a43321b1e47 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:01.562305 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1093/2153] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:01.578094 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c48065-fec6-4c01-9636-27f08cf44b92 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:01.581264 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-02c48065-fec6-4c01-9636-27f08cf44b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:01.586038 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1061/2154] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:01 2022] POST /identity/v3/users => generated 289 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:01.595657 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c90ba8-54cb-4bd5-9d71-9a43321b1e47 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:01.617755 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c90ba8-54cb-4bd5-9d71-9a43321b1e47 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:01.632448 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9eea9-8a2c-432d-b8f4-c7aafa5aa34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:01.633330 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9eea9-8a2c-432d-b8f4-c7aafa5aa34f admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:01.633835 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9eea9-8a2c-432d-b8f4-c7aafa5aa34f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:01.634258 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9eea9-8a2c-432d-b8f4-c7aafa5aa34f admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:01.635012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9eea9-8a2c-432d-b8f4-c7aafa5aa34f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:01.636809 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9eea9-8a2c-432d-b8f4-c7aafa5aa34f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:01.650597 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1062/2155] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:01.655723 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9eea9-8a2c-432d-b8f4-c7aafa5aa34f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:01.663676 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:01.670451 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9eea9-8a2c-432d-b8f4-c7aafa5aa34f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:01.682065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfa94e-9771-41bc-a99d-1ae2ab50476c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:01.684059 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfa94e-9771-41bc-a99d-1ae2ab50476c admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:01.685047 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfa94e-9771-41bc-a99d-1ae2ab50476c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:01.686172 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfa94e-9771-41bc-a99d-1ae2ab50476c admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:01.687060 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cfa94e-9771-41bc-a99d-1ae2ab50476c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:01.689994 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cfa94e-9771-41bc-a99d-1ae2ab50476c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:01.708593 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c48065-fec6-4c01-9636-27f08cf44b92 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:01.711967 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1063/2156] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:01.713402 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfa94e-9771-41bc-a99d-1ae2ab50476c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:01.727157 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfa94e-9771-41bc-a99d-1ae2ab50476c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:01.731087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec8fecc-ca7a-48cd-81fc-fbc39f287d09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:01.731796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8fecc-ca7a-48cd-81fc-fbc39f287d09 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:01.734061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d319e3-5f6e-4286-a068-3cbfaa5e9442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:01.734904 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d319e3-5f6e-4286-a068-3cbfaa5e9442 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:01.735255 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d319e3-5f6e-4286-a068-3cbfaa5e9442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:01.735720 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d319e3-5f6e-4286-a068-3cbfaa5e9442 admin admin] PATH_INFO: `/v3/projects/82b27e4b8b294543b482a950f424d443/users/36f027e43fa14ffdae3468e821b5a400/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:01.748972 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8fecc-ca7a-48cd-81fc-fbc39f287d09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:01.748972 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8fecc-ca7a-48cd-81fc-fbc39f287d09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:01.757141 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d319e3-5f6e-4286-a068-3cbfaa5e9442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82b27e4b8b294543b482a950f424d443, user_id=36f027e43fa14ffdae3468e821b5a400, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:01.766521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d319e3-5f6e-4286-a068-3cbfaa5e9442 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:01.773943 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec8fecc-ca7a-48cd-81fc-fbc39f287d09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:01.775985 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec8fecc-ca7a-48cd-81fc-fbc39f287d09 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:01.792417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1064/2157] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:01 2022] PUT /identity/v3/projects/82b27e4b8b294543b482a950f424d443/users/36f027e43fa14ffdae3468e821b5a400/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:01.798798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1094/2158] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:37:01.811986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1067c-7637-41bc-9987-ae20e6a23aef None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:01.817718 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1067c-7637-41bc-9987-ae20e6a23aef None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:01.818263 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1067c-7637-41bc-9987-ae20e6a23aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:01.830886 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec8fecc-ca7a-48cd-81fc-fbc39f287d09 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:01.848776 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec8fecc-ca7a-48cd-81fc-fbc39f287d09 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:01.866099 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-cab1067c-7637-41bc-9987-ae20e6a23aef None None] MFA Rules not processed for user `36f027e43fa14ffdae3468e821b5a400`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:01.867350 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cab1067c-7637-41bc-9987-ae20e6a23aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:01.951431 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60347968-9679-4d25-85de-8466cc4e33e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:01.952242 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60347968-9679-4d25-85de-8466cc4e33e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:01.952533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60347968-9679-4d25-85de-8466cc4e33e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:01.953163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60347968-9679-4d25-85de-8466cc4e33e5 admin admin] PATH_INFO: `/v3/users/bc32125d720741bda114622ba112f597` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:01.954862 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60347968-9679-4d25-85de-8466cc4e33e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc32125d720741bda114622ba112f597)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:01.957571 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60347968-9679-4d25-85de-8466cc4e33e5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:01.991116 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1065/2159] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:02.015326 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1067c-7637-41bc-9987-ae20e6a23aef None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:02.016816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cab1067c-7637-41bc-9987-ae20e6a23aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:02.031617 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-60347968-9679-4d25-85de-8466cc4e33e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc32125d720741bda114622ba112f597'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:02.033635 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:02.071481 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-60347968-9679-4d25-85de-8466cc4e33e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc32125d720741bda114622ba112f597'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:02.072421 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-60347968-9679-4d25-85de-8466cc4e33e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc32125d720741bda114622ba112f597'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:02.088445 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-60347968-9679-4d25-85de-8466cc4e33e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc32125d720741bda114622ba112f597'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:02.123890 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-60347968-9679-4d25-85de-8466cc4e33e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc32125d720741bda114622ba112f597'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:02.143396 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1095/2160] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:01 2022] DELETE /identity/v3/users/bc32125d720741bda114622ba112f597 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:02.143926 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1067c-7637-41bc-9987-ae20e6a23aef None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:02.153157 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f03341-001a-4eb2-8222-4e14dde20831 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:02.153714 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f03341-001a-4eb2-8222-4e14dde20831 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:02.154845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f03341-001a-4eb2-8222-4e14dde20831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:02.211538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-29f03341-001a-4eb2-8222-4e14dde20831 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:02.213545 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-29f03341-001a-4eb2-8222-4e14dde20831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:02.232484 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f7fa1-504d-4410-99e9-a2d47977441d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:02.233171 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f7fa1-504d-4410-99e9-a2d47977441d service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:02.233454 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f7fa1-504d-4410-99e9-a2d47977441d service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:02.234522 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f7fa1-504d-4410-99e9-a2d47977441d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:02.235906 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-918f7fa1-504d-4410-99e9-a2d47977441d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:02.304078 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:02.337109 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1096/2161] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:02.354022 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f03341-001a-4eb2-8222-4e14dde20831 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:02.355969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-29f03341-001a-4eb2-8222-4e14dde20831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:02.385141 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f7fa1-504d-4410-99e9-a2d47977441d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:02.390083 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f7fa1-504d-4410-99e9-a2d47977441d service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:02.410821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1066/2162] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:02.430705 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f03341-001a-4eb2-8222-4e14dde20831 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:02.435187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b49be-d8a9-4836-965e-6a642e120c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:02.436847 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b49be-d8a9-4836-965e-6a642e120c12 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:02.437141 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b49be-d8a9-4836-965e-6a642e120c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:02.437520 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b49be-d8a9-4836-965e-6a642e120c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:02.455634 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b49be-d8a9-4836-965e-6a642e120c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:02.457604 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b49be-d8a9-4836-965e-6a642e120c12 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:02.478132 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1097/2163] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:03.179834 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f7fa1-504d-4410-99e9-a2d47977441d service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:03.181762 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-918f7fa1-504d-4410-99e9-a2d47977441d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:03.219951 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f7fa1-504d-4410-99e9-a2d47977441d service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:03.238035 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96d1c8-c4c3-4f0d-a3af-fb6457b29fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:03.238280 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96d1c8-c4c3-4f0d-a3af-fb6457b29fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:03.238566 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96d1c8-c4c3-4f0d-a3af-fb6457b29fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:03.238845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96d1c8-c4c3-4f0d-a3af-fb6457b29fd9 admin admin] PATH_INFO: `/v3/projects/f73a3c6d397641f4a9735e3ac76c5010` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:03.240122 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96d1c8-c4c3-4f0d-a3af-fb6457b29fd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f73a3c6d397641f4a9735e3ac76c5010)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:03.242453 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96d1c8-c4c3-4f0d-a3af-fb6457b29fd9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:03.372552 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3d96d1c8-c4c3-4f0d-a3af-fb6457b29fd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f73a3c6d397641f4a9735e3ac76c5010', 'request_id': 'req-3d96d1c8-c4c3-4f0d-a3af-fb6457b29fd9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:03.386298 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3d96d1c8-c4c3-4f0d-a3af-fb6457b29fd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f73a3c6d397641f4a9735e3ac76c5010', 'request_id': 'req-3d96d1c8-c4c3-4f0d-a3af-fb6457b29fd9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:03.402233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3d96d1c8-c4c3-4f0d-a3af-fb6457b29fd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f73a3c6d397641f4a9735e3ac76c5010', 'request_id': 'req-3d96d1c8-c4c3-4f0d-a3af-fb6457b29fd9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:03.451184 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3d96d1c8-c4c3-4f0d-a3af-fb6457b29fd9 admin admin] The token cache is being invalidate because project f73a3c6d397641f4a9735e3ac76c5010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:03.451797 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3d96d1c8-c4c3-4f0d-a3af-fb6457b29fd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:03.452792 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3d96d1c8-c4c3-4f0d-a3af-fb6457b29fd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:03.456160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1067/2164] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:03 2022] DELETE /identity/v3/projects/f73a3c6d397641f4a9735e3ac76c5010 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:03.460575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475c1ea-4ac4-4f40-bf6f-4f3133fdc892 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:03.463282 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475c1ea-4ac4-4f40-bf6f-4f3133fdc892 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:03.463282 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475c1ea-4ac4-4f40-bf6f-4f3133fdc892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:03.496017 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0475c1ea-4ac4-4f40-bf6f-4f3133fdc892 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:03.499033 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0475c1ea-4ac4-4f40-bf6f-4f3133fdc892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:03.642137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1098/2165] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:03.645238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a12034-b6a2-4df6-b904-ea29a69b31ba None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:03.645867 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a12034-b6a2-4df6-b904-ea29a69b31ba None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:03.646606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a12034-b6a2-4df6-b904-ea29a69b31ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:03.686875 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f4a12034-b6a2-4df6-b904-ea29a69b31ba None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:03.688294 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f4a12034-b6a2-4df6-b904-ea29a69b31ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:03.699397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1068/2166] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:03.705656 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475c1ea-4ac4-4f40-bf6f-4f3133fdc892 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:03.722717 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475c1ea-4ac4-4f40-bf6f-4f3133fdc892 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:03.730543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e9a34-2507-4dc5-b026-ef7d674c9141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:03.731420 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e9a34-2507-4dc5-b026-ef7d674c9141 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:03.731899 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e9a34-2507-4dc5-b026-ef7d674c9141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:03.733417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e9a34-2507-4dc5-b026-ef7d674c9141 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:03.734538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e9a34-2507-4dc5-b026-ef7d674c9141 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:37:03.735145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e9a34-2507-4dc5-b026-ef7d674c9141 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:03.737527 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e9a34-2507-4dc5-b026-ef7d674c9141 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:03.741725 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:03.759998 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1099/2167] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:37:03.766892 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a12034-b6a2-4df6-b904-ea29a69b31ba None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:03.778683 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a12034-b6a2-4df6-b904-ea29a69b31ba None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:03.785036 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a65dd-98ba-40fb-a538-d7414f687e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:03.785888 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a65dd-98ba-40fb-a538-d7414f687e5b admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:03.786446 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a65dd-98ba-40fb-a538-d7414f687e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:03.786827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a65dd-98ba-40fb-a538-d7414f687e5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:03.787645 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a65dd-98ba-40fb-a538-d7414f687e5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:03.790461 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a65dd-98ba-40fb-a538-d7414f687e5b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:03.886729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1069/2168] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:03 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:03.894980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e9a34-2507-4dc5-b026-ef7d674c9141 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:03.914032 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e9a34-2507-4dc5-b026-ef7d674c9141 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:04.002971 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295d8f4-5a23-4c56-aae4-776c1b0d70ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:04.003935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295d8f4-5a23-4c56-aae4-776c1b0d70ff admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:04.004286 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295d8f4-5a23-4c56-aae4-776c1b0d70ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:04.004720 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295d8f4-5a23-4c56-aae4-776c1b0d70ff admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:04.005613 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295d8f4-5a23-4c56-aae4-776c1b0d70ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:04.007871 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295d8f4-5a23-4c56-aae4-776c1b0d70ff admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:04.041049 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1100/2169] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:03 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:04.044059 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a65dd-98ba-40fb-a538-d7414f687e5b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:04.065105 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a65dd-98ba-40fb-a538-d7414f687e5b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:04.071465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83477d-b1ea-45fc-a348-436ebecb2a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:04.072221 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83477d-b1ea-45fc-a348-436ebecb2a0b admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:04.072564 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83477d-b1ea-45fc-a348-436ebecb2a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:04.072981 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83477d-b1ea-45fc-a348-436ebecb2a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:04.073774 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83477d-b1ea-45fc-a348-436ebecb2a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:04.076692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83477d-b1ea-45fc-a348-436ebecb2a0b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:04.098196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1070/2170] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:04.102976 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295d8f4-5a23-4c56-aae4-776c1b0d70ff admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:04.123666 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295d8f4-5a23-4c56-aae4-776c1b0d70ff admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:04.133376 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d19e10-78e4-40a6-bcb4-bffce555a1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:04.134418 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d19e10-78e4-40a6-bcb4-bffce555a1ea admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:04.135143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d19e10-78e4-40a6-bcb4-bffce555a1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:04.136600 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d19e10-78e4-40a6-bcb4-bffce555a1ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:04.137006 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d19e10-78e4-40a6-bcb4-bffce555a1ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:04.141198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d19e10-78e4-40a6-bcb4-bffce555a1ea admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:04.169304 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1101/2171] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:04.172263 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83477d-b1ea-45fc-a348-436ebecb2a0b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:04.191586 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83477d-b1ea-45fc-a348-436ebecb2a0b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:04.201512 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e3793-6e4b-42a4-98b5-98fb371742b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:04.202965 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e3793-6e4b-42a4-98b5-98fb371742b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:04.203719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e3793-6e4b-42a4-98b5-98fb371742b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:04.204799 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e3793-6e4b-42a4-98b5-98fb371742b2 admin admin] PATH_INFO: `/v3/projects/3551650fa3e7451f846bd51cc2bd67e4/users/e84bd63e8fa0446b872be11785309652/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:04.239314 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e3793-6e4b-42a4-98b5-98fb371742b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3551650fa3e7451f846bd51cc2bd67e4, user_id=e84bd63e8fa0446b872be11785309652, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:04.245139 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e3793-6e4b-42a4-98b5-98fb371742b2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:04.290211 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1071/2172] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:04 2022] PUT /identity/v3/projects/3551650fa3e7451f846bd51cc2bd67e4/users/e84bd63e8fa0446b872be11785309652/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:04.297951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957db9de-35a1-4e1e-a426-aed80b086643 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:04.298641 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957db9de-35a1-4e1e-a426-aed80b086643 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:04.299190 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957db9de-35a1-4e1e-a426-aed80b086643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:04.363206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-957db9de-35a1-4e1e-a426-aed80b086643 None None] MFA Rules not processed for user `e84bd63e8fa0446b872be11785309652`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:04.365414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-957db9de-35a1-4e1e-a426-aed80b086643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:04.538594 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1102/2173] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:04.564099 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e3793-6e4b-42a4-98b5-98fb371742b2 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:04.566792 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f57e3793-6e4b-42a4-98b5-98fb371742b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:04.682678 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:04.727445 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e3793-6e4b-42a4-98b5-98fb371742b2 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:04.732065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3481b-b467-48d4-9a36-c749e079e52f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2feb3132ad9497aaae8720ed170ef3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:04.733391 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3481b-b467-48d4-9a36-c749e079e52f service glance] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:04.733795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3481b-b467-48d4-9a36-c749e079e52f service glance] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:04.734482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3481b-b467-48d4-9a36-c749e079e52f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:04.758744 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3481b-b467-48d4-9a36-c749e079e52f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:04.762925 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3481b-b467-48d4-9a36-c749e079e52f service glance] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:04.783073 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1072/2174] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:05.095112 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c401034-3f27-4545-a102-d9fe236b6100 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:05.095707 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c401034-3f27-4545-a102-d9fe236b6100 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:05.096787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c401034-3f27-4545-a102-d9fe236b6100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:05.155862 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8c401034-3f27-4545-a102-d9fe236b6100 None None] MFA Rules not processed for user `054b27e46b8648979d8777e90748722d`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:05.159771 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8c401034-3f27-4545-a102-d9fe236b6100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:05.288967 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1103/2175] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:06.293124 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3481b-b467-48d4-9a36-c749e079e52f service glance] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:06.299670 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-79f3481b-b467-48d4-9a36-c749e079e52f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:06.504264 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3481b-b467-48d4-9a36-c749e079e52f service glance] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:06.515274 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07171335-0e8e-4a2e-8257-7d3ca42255ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:06.516272 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07171335-0e8e-4a2e-8257-7d3ca42255ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:06.516472 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07171335-0e8e-4a2e-8257-7d3ca42255ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:06.517005 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07171335-0e8e-4a2e-8257-7d3ca42255ad admin admin] PATH_INFO: `/v3/users/13fbff202d3e43c480d12cb26dd885c8` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:06.519125 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07171335-0e8e-4a2e-8257-7d3ca42255ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=13fbff202d3e43c480d12cb26dd885c8)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:06.528323 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07171335-0e8e-4a2e-8257-7d3ca42255ad admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:06.690293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-07171335-0e8e-4a2e-8257-7d3ca42255ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13fbff202d3e43c480d12cb26dd885c8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:06.769694 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-07171335-0e8e-4a2e-8257-7d3ca42255ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13fbff202d3e43c480d12cb26dd885c8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:06.770953 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-07171335-0e8e-4a2e-8257-7d3ca42255ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13fbff202d3e43c480d12cb26dd885c8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:06.781462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-07171335-0e8e-4a2e-8257-7d3ca42255ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13fbff202d3e43c480d12cb26dd885c8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:06.793880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-07171335-0e8e-4a2e-8257-7d3ca42255ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13fbff202d3e43c480d12cb26dd885c8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:06.819380 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1073/2176] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:06 2022] DELETE /identity/v3/users/13fbff202d3e43c480d12cb26dd885c8 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:06.826002 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e480d8-0c3f-4bc7-8125-0ee9e5a47aa9 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:06.828421 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e480d8-0c3f-4bc7-8125-0ee9e5a47aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:06.829327 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e480d8-0c3f-4bc7-8125-0ee9e5a47aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:06.891765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f5e480d8-0c3f-4bc7-8125-0ee9e5a47aa9 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:06.893291 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f5e480d8-0c3f-4bc7-8125-0ee9e5a47aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:06.900836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:06.984099 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1104/2177] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:06.995923 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07171335-0e8e-4a2e-8257-7d3ca42255ad admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:06.997673 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-07171335-0e8e-4a2e-8257-7d3ca42255ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:07.175968 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07171335-0e8e-4a2e-8257-7d3ca42255ad admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:07.187813 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc3336-ffb8-4cc5-b76b-b73f3a1f8712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:07.189639 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc3336-ffb8-4cc5-b76b-b73f3a1f8712 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:07.190401 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc3336-ffb8-4cc5-b76b-b73f3a1f8712 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:07.191736 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc3336-ffb8-4cc5-b76b-b73f3a1f8712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:07.205601 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:07.212598 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc3336-ffb8-4cc5-b76b-b73f3a1f8712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:07.215336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc3336-ffb8-4cc5-b76b-b73f3a1f8712 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:07.246873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1074/2178] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:08.030311 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e480d8-0c3f-4bc7-8125-0ee9e5a47aa9 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:08.032559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f5e480d8-0c3f-4bc7-8125-0ee9e5a47aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:08.058391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e480d8-0c3f-4bc7-8125-0ee9e5a47aa9 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:08.083094 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516223ab-4f0e-4a9d-9710-2914c4402f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:08.083918 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516223ab-4f0e-4a9d-9710-2914c4402f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:08.084233 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516223ab-4f0e-4a9d-9710-2914c4402f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:08.084552 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516223ab-4f0e-4a9d-9710-2914c4402f8d admin admin] PATH_INFO: `/v3/projects/51e06b85740640529761911e70a5b277` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:08.086223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516223ab-4f0e-4a9d-9710-2914c4402f8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=51e06b85740640529761911e70a5b277)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:08.089032 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516223ab-4f0e-4a9d-9710-2914c4402f8d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:08.149529 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-516223ab-4f0e-4a9d-9710-2914c4402f8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51e06b85740640529761911e70a5b277', 'request_id': 'req-516223ab-4f0e-4a9d-9710-2914c4402f8d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:08.157098 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-516223ab-4f0e-4a9d-9710-2914c4402f8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51e06b85740640529761911e70a5b277', 'request_id': 'req-516223ab-4f0e-4a9d-9710-2914c4402f8d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:08.167448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-516223ab-4f0e-4a9d-9710-2914c4402f8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51e06b85740640529761911e70a5b277', 'request_id': 'req-516223ab-4f0e-4a9d-9710-2914c4402f8d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:08.182730 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-516223ab-4f0e-4a9d-9710-2914c4402f8d admin admin] The token cache is being invalidate because project 51e06b85740640529761911e70a5b277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:08.183036 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-516223ab-4f0e-4a9d-9710-2914c4402f8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:08.183904 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-516223ab-4f0e-4a9d-9710-2914c4402f8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:08.186072 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1105/2179] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:08 2022] DELETE /identity/v3/projects/51e06b85740640529761911e70a5b277 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:08.191545 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fadbb-25f1-4055-ab8f-1fa0ad04657e None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:08.192171 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fadbb-25f1-4055-ab8f-1fa0ad04657e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:08.192171 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fadbb-25f1-4055-ab8f-1fa0ad04657e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:08.214567 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e70fadbb-25f1-4055-ab8f-1fa0ad04657e None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:08.215825 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e70fadbb-25f1-4055-ab8f-1fa0ad04657e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:08.304569 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1075/2180] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:08.313959 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269c3ca-1234-4415-9919-1693bbd327bb None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:08.314342 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269c3ca-1234-4415-9919-1693bbd327bb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:08.314833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269c3ca-1234-4415-9919-1693bbd327bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:08.351141 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c269c3ca-1234-4415-9919-1693bbd327bb None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:08.352680 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c269c3ca-1234-4415-9919-1693bbd327bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:08.361734 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1106/2181] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:08.366453 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70fadbb-25f1-4055-ab8f-1fa0ad04657e None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:08.377939 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70fadbb-25f1-4055-ab8f-1fa0ad04657e None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:08.392293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af721b51-01b8-4674-ba95-50cd6b28b67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:08.393027 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af721b51-01b8-4674-ba95-50cd6b28b67f admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:08.393308 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af721b51-01b8-4674-ba95-50cd6b28b67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:08.393581 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af721b51-01b8-4674-ba95-50cd6b28b67f admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:08.394257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af721b51-01b8-4674-ba95-50cd6b28b67f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:37:08.394561 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af721b51-01b8-4674-ba95-50cd6b28b67f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:08.396229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af721b51-01b8-4674-ba95-50cd6b28b67f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:08.414534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1076/2182] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:37:08.420506 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269c3ca-1234-4415-9919-1693bbd327bb None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:08.435858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269c3ca-1234-4415-9919-1693bbd327bb None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:08.442017 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655b8e3-2485-4157-8066-9f86a73d0e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:08.442778 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655b8e3-2485-4157-8066-9f86a73d0e1d admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:08.443137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655b8e3-2485-4157-8066-9f86a73d0e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:08.443390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655b8e3-2485-4157-8066-9f86a73d0e1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:08.444131 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655b8e3-2485-4157-8066-9f86a73d0e1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:08.446539 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655b8e3-2485-4157-8066-9f86a73d0e1d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:08.492691 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1107/2183] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:08 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:08.498534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af721b51-01b8-4674-ba95-50cd6b28b67f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:08.517090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af721b51-01b8-4674-ba95-50cd6b28b67f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:08.605096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b957a9e-5eb1-4d3a-bc06-434ec572700a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:08.605846 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b957a9e-5eb1-4d3a-bc06-434ec572700a admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:08.606217 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b957a9e-5eb1-4d3a-bc06-434ec572700a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:08.606599 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b957a9e-5eb1-4d3a-bc06-434ec572700a admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:08.608001 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b957a9e-5eb1-4d3a-bc06-434ec572700a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:08.610167 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b957a9e-5eb1-4d3a-bc06-434ec572700a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:08.636698 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1077/2184] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:08 2022] POST /identity/v3/users => generated 287 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:08.643512 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655b8e3-2485-4157-8066-9f86a73d0e1d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:08.657600 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655b8e3-2485-4157-8066-9f86a73d0e1d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:08.662814 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2534c-fb07-4272-ac1c-5f5afdfa7fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:08.663296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2534c-fb07-4272-ac1c-5f5afdfa7fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:08.663594 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2534c-fb07-4272-ac1c-5f5afdfa7fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:08.663992 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2534c-fb07-4272-ac1c-5f5afdfa7fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:08.664808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2534c-fb07-4272-ac1c-5f5afdfa7fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:08.666766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2534c-fb07-4272-ac1c-5f5afdfa7fa2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:08.679463 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1108/2185] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:08.683704 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b957a9e-5eb1-4d3a-bc06-434ec572700a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:08.694879 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b957a9e-5eb1-4d3a-bc06-434ec572700a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:08.700217 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708495bd-6654-451f-bbea-188251febb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:08.701557 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708495bd-6654-451f-bbea-188251febb30 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:08.701855 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708495bd-6654-451f-bbea-188251febb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:08.702133 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708495bd-6654-451f-bbea-188251febb30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:08.702799 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708495bd-6654-451f-bbea-188251febb30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:08.704474 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708495bd-6654-451f-bbea-188251febb30 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:08.716612 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1078/2186] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:08.721771 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2534c-fb07-4272-ac1c-5f5afdfa7fa2 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:08.733882 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2534c-fb07-4272-ac1c-5f5afdfa7fa2 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:08.739410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019235a-5f8e-44ea-9e48-01f1f223619d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:08.740097 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019235a-5f8e-44ea-9e48-01f1f223619d admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:08.740383 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019235a-5f8e-44ea-9e48-01f1f223619d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:08.740692 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019235a-5f8e-44ea-9e48-01f1f223619d admin admin] PATH_INFO: `/v3/projects/36fcfac4eac3419b83a7ddd28d6880f5/users/068c4abbe8db4aceab62bbc6bbf10f7b/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:08.771652 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019235a-5f8e-44ea-9e48-01f1f223619d admin admin] RBAC: Authorizing `identity:create_grant(project_id=36fcfac4eac3419b83a7ddd28d6880f5, user_id=068c4abbe8db4aceab62bbc6bbf10f7b, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:08.775189 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019235a-5f8e-44ea-9e48-01f1f223619d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:08.805917 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1109/2187] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:08 2022] PUT /identity/v3/projects/36fcfac4eac3419b83a7ddd28d6880f5/users/068c4abbe8db4aceab62bbc6bbf10f7b/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:08.812670 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997c7ec-2828-4a19-83af-48b2c72d12bc None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:08.813145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997c7ec-2828-4a19-83af-48b2c72d12bc None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:08.813925 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997c7ec-2828-4a19-83af-48b2c72d12bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:08.860131 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c997c7ec-2828-4a19-83af-48b2c72d12bc None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:08.864105 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c997c7ec-2828-4a19-83af-48b2c72d12bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:09.065995 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:09.091542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1079/2188] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:09.099371 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019235a-5f8e-44ea-9e48-01f1f223619d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:09.102674 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b019235a-5f8e-44ea-9e48-01f1f223619d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:09.173703 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:09.264072 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019235a-5f8e-44ea-9e48-01f1f223619d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:09.284771 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5e587-9057-4b62-bffb-3622bdb20e47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:09.286622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5e587-9057-4b62-bffb-3622bdb20e47 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:09.287135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5e587-9057-4b62-bffb-3622bdb20e47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:09.287634 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5e587-9057-4b62-bffb-3622bdb20e47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:09.326841 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5e587-9057-4b62-bffb-3622bdb20e47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:09.328577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5e587-9057-4b62-bffb-3622bdb20e47 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:09.346210 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1110/2189] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:16.985408 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997c7ec-2828-4a19-83af-48b2c72d12bc None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:16.988023 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c997c7ec-2828-4a19-83af-48b2c72d12bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:17.010796 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997c7ec-2828-4a19-83af-48b2c72d12bc None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:17.022082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e28fd1-4e18-45e2-8a37-aa5a2fcda6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:17.023787 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e28fd1-4e18-45e2-8a37-aa5a2fcda6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:17.024526 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e28fd1-4e18-45e2-8a37-aa5a2fcda6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:17.038619 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e28fd1-4e18-45e2-8a37-aa5a2fcda6a2 admin admin] PATH_INFO: `/v3/users/36f027e43fa14ffdae3468e821b5a400` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:17.042107 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e28fd1-4e18-45e2-8a37-aa5a2fcda6a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36f027e43fa14ffdae3468e821b5a400)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:17.048174 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e28fd1-4e18-45e2-8a37-aa5a2fcda6a2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:17.161363 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-35e28fd1-4e18-45e2-8a37-aa5a2fcda6a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36f027e43fa14ffdae3468e821b5a400'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:17.192506 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-35e28fd1-4e18-45e2-8a37-aa5a2fcda6a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36f027e43fa14ffdae3468e821b5a400'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:17.193806 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-35e28fd1-4e18-45e2-8a37-aa5a2fcda6a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36f027e43fa14ffdae3468e821b5a400'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:17.194923 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-35e28fd1-4e18-45e2-8a37-aa5a2fcda6a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36f027e43fa14ffdae3468e821b5a400'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:17.225945 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-35e28fd1-4e18-45e2-8a37-aa5a2fcda6a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36f027e43fa14ffdae3468e821b5a400'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:17.272176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1080/2190] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:16 2022] DELETE /identity/v3/users/36f027e43fa14ffdae3468e821b5a400 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:17.279552 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d947c11-d6ab-4f20-81ec-7f440dacef33 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:17.281932 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d947c11-d6ab-4f20-81ec-7f440dacef33 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:17.282715 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d947c11-d6ab-4f20-81ec-7f440dacef33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:17.387858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5d947c11-d6ab-4f20-81ec-7f440dacef33 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:17.395880 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5d947c11-d6ab-4f20-81ec-7f440dacef33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:17.569522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1111/2191] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:17.651191 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e28fd1-4e18-45e2-8a37-aa5a2fcda6a2 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:17.656333 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-35e28fd1-4e18-45e2-8a37-aa5a2fcda6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:17.909770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e28fd1-4e18-45e2-8a37-aa5a2fcda6a2 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:17.930930 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d338ed3-9787-4e78-8cbc-73766d7ccc9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:17.931586 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d338ed3-9787-4e78-8cbc-73766d7ccc9e service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:17.931887 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d338ed3-9787-4e78-8cbc-73766d7ccc9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:17.932177 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d338ed3-9787-4e78-8cbc-73766d7ccc9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:17.975066 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d338ed3-9787-4e78-8cbc-73766d7ccc9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:17.978756 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d338ed3-9787-4e78-8cbc-73766d7ccc9e service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:18.007592 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1081/2192] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:18.778821 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d947c11-d6ab-4f20-81ec-7f440dacef33 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:18.781759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5d947c11-d6ab-4f20-81ec-7f440dacef33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:18.827819 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d947c11-d6ab-4f20-81ec-7f440dacef33 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:18.849864 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceda997-ea8c-43ed-bbbb-9ec9d00c304a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:18.851588 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceda997-ea8c-43ed-bbbb-9ec9d00c304a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:18.852191 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceda997-ea8c-43ed-bbbb-9ec9d00c304a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:18.852807 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceda997-ea8c-43ed-bbbb-9ec9d00c304a admin admin] PATH_INFO: `/v3/projects/82b27e4b8b294543b482a950f424d443` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:18.856783 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceda997-ea8c-43ed-bbbb-9ec9d00c304a admin admin] RBAC: Authorizing `identity:delete_project(project_id=82b27e4b8b294543b482a950f424d443)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:18.862063 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceda997-ea8c-43ed-bbbb-9ec9d00c304a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:19.121212 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5ceda997-ea8c-43ed-bbbb-9ec9d00c304a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82b27e4b8b294543b482a950f424d443', 'request_id': 'req-5ceda997-ea8c-43ed-bbbb-9ec9d00c304a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:19.150310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5ceda997-ea8c-43ed-bbbb-9ec9d00c304a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82b27e4b8b294543b482a950f424d443', 'request_id': 'req-5ceda997-ea8c-43ed-bbbb-9ec9d00c304a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:19.174635 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5ceda997-ea8c-43ed-bbbb-9ec9d00c304a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82b27e4b8b294543b482a950f424d443', 'request_id': 'req-5ceda997-ea8c-43ed-bbbb-9ec9d00c304a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:19.197470 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5ceda997-ea8c-43ed-bbbb-9ec9d00c304a admin admin] The token cache is being invalidate because project 82b27e4b8b294543b482a950f424d443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:19.197828 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5ceda997-ea8c-43ed-bbbb-9ec9d00c304a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:19.202252 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5ceda997-ea8c-43ed-bbbb-9ec9d00c304a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:19.204748 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1112/2193] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:18 2022] DELETE /identity/v3/projects/82b27e4b8b294543b482a950f424d443 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:19.212396 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463f7d0-2d6b-49ac-ae64-4d2cf423e60a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:19.213130 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463f7d0-2d6b-49ac-ae64-4d2cf423e60a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:19.213947 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463f7d0-2d6b-49ac-ae64-4d2cf423e60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:19.242430 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8463f7d0-2d6b-49ac-ae64-4d2cf423e60a None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:19.244545 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8463f7d0-2d6b-49ac-ae64-4d2cf423e60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:19.432265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1082/2194] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:19.521412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc4fbd-888e-4860-b9c9-8ba598457c24 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:19.521706 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc4fbd-888e-4860-b9c9-8ba598457c24 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:19.521977 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc4fbd-888e-4860-b9c9-8ba598457c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:19.586501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-19cc4fbd-888e-4860-b9c9-8ba598457c24 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:19.588036 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-19cc4fbd-888e-4860-b9c9-8ba598457c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:19.630672 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1113/2195] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:19.637464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463f7d0-2d6b-49ac-ae64-4d2cf423e60a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:19.674799 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463f7d0-2d6b-49ac-ae64-4d2cf423e60a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:19.687088 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988ab7c-a869-4d46-9b57-6d1465fd7472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:19.687726 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988ab7c-a869-4d46-9b57-6d1465fd7472 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:19.687995 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988ab7c-a869-4d46-9b57-6d1465fd7472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:19.688280 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988ab7c-a869-4d46-9b57-6d1465fd7472 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:19.689006 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988ab7c-a869-4d46-9b57-6d1465fd7472 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:37:19.689341 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988ab7c-a869-4d46-9b57-6d1465fd7472 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:19.690996 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988ab7c-a869-4d46-9b57-6d1465fd7472 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:19.721976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1083/2196] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:37:19.723022 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc4fbd-888e-4860-b9c9-8ba598457c24 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:19.762879 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc4fbd-888e-4860-b9c9-8ba598457c24 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:19.798210 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2253bd5-1b42-4fd4-a08e-09b97ed5c2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:19.800710 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2253bd5-1b42-4fd4-a08e-09b97ed5c2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:19.801602 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2253bd5-1b42-4fd4-a08e-09b97ed5c2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:19.802426 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2253bd5-1b42-4fd4-a08e-09b97ed5c2e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:19.804187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2253bd5-1b42-4fd4-a08e-09b97ed5c2e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:19.808793 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2253bd5-1b42-4fd4-a08e-09b97ed5c2e6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:19.954886 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1114/2197] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:19 2022] POST /identity/v3/projects => generated 373 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:37:19.961528 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2253bd5-1b42-4fd4-a08e-09b97ed5c2e6 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:19.964780 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f77a5-af3c-4194-8f17-85e174de131c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:19.974339 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f77a5-af3c-4194-8f17-85e174de131c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:19.975051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f77a5-af3c-4194-8f17-85e174de131c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:20.000409 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:20.050402 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:20.137674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-7e7f77a5-af3c-4194-8f17-85e174de131c None None] MFA Rules not processed for user `068c4abbe8db4aceab62bbc6bbf10f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:20.144442 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7e7f77a5-af3c-4194-8f17-85e174de131c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:20.252374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2253bd5-1b42-4fd4-a08e-09b97ed5c2e6 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:20.280228 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10998e-c13e-48c9-be55-47e283964acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:20.281524 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10998e-c13e-48c9-be55-47e283964acf admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:20.282225 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10998e-c13e-48c9-be55-47e283964acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:20.282727 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10998e-c13e-48c9-be55-47e283964acf admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:20.284100 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10998e-c13e-48c9-be55-47e283964acf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:20.292082 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10998e-c13e-48c9-be55-47e283964acf admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:20.382332 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1115/2198] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:19 2022] POST /identity/v3/users => generated 287 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:37:20.390643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10998e-c13e-48c9-be55-47e283964acf admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:20.414675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10998e-c13e-48c9-be55-47e283964acf admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:20.439147 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054044e8-2eda-41df-b317-b2880148406d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:20.440142 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054044e8-2eda-41df-b317-b2880148406d admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:20.440716 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054044e8-2eda-41df-b317-b2880148406d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:20.441100 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054044e8-2eda-41df-b317-b2880148406d admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:20.442279 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054044e8-2eda-41df-b317-b2880148406d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:20.446043 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054044e8-2eda-41df-b317-b2880148406d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:20.465733 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1116/2199] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:37:20.480746 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1084/2200] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 526 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:20.488690 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f77a5-af3c-4194-8f17-85e174de131c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:20.491128 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7e7f77a5-af3c-4194-8f17-85e174de131c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:20.495003 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054044e8-2eda-41df-b317-b2880148406d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:20.517509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054044e8-2eda-41df-b317-b2880148406d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:20.526503 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a5d7c-5f3d-4881-9e08-ac36d1034266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:20.527388 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a5d7c-5f3d-4881-9e08-ac36d1034266 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:20.527840 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a5d7c-5f3d-4881-9e08-ac36d1034266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:20.528259 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a5d7c-5f3d-4881-9e08-ac36d1034266 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:20.529155 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a5d7c-5f3d-4881-9e08-ac36d1034266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:20.530608 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f77a5-af3c-4194-8f17-85e174de131c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:20.531395 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a5d7c-5f3d-4881-9e08-ac36d1034266 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:20.544134 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8abaa-0eb1-4464-87d4-df94b2c7b9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:20.545984 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8abaa-0eb1-4464-87d4-df94b2c7b9a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:20.546538 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8abaa-0eb1-4464-87d4-df94b2c7b9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:20.547541 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8abaa-0eb1-4464-87d4-df94b2c7b9a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:20.548442 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8abaa-0eb1-4464-87d4-df94b2c7b9a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:20.550680 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8abaa-0eb1-4464-87d4-df94b2c7b9a1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:20.579355 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1117/2201] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:20.587243 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a5d7c-5f3d-4881-9e08-ac36d1034266 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:20.624684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a5d7c-5f3d-4881-9e08-ac36d1034266 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:20.627280 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1085/2202] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:20 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:20.632700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8abaa-0eb1-4464-87d4-df94b2c7b9a1 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:20.889899 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8abaa-0eb1-4464-87d4-df94b2c7b9a1 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:20.906427 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0c2ca-7ee3-44ef-8021-45c087b54fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:20.907330 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0c2ca-7ee3-44ef-8021-45c087b54fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:20.907714 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0c2ca-7ee3-44ef-8021-45c087b54fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:20.908111 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0c2ca-7ee3-44ef-8021-45c087b54fb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:20.909055 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0c2ca-7ee3-44ef-8021-45c087b54fb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:20.912662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0c2ca-7ee3-44ef-8021-45c087b54fb9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:20.940237 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff26cd-b364-4620-82fb-ae8f814f5c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:20.941687 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1086/2203] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:20 2022] POST /identity/v3/users => generated 293 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:20.941895 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff26cd-b364-4620-82fb-ae8f814f5c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:20.942350 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff26cd-b364-4620-82fb-ae8f814f5c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:20.942729 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff26cd-b364-4620-82fb-ae8f814f5c53 admin admin] PATH_INFO: `/v3/projects/4fbfb6f90d0449e7a4d2dd47a22d5329/users/c9e00255a2524a8780cb8074292c0cac/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:20.946045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0c2ca-7ee3-44ef-8021-45c087b54fb9 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:20.958995 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0c2ca-7ee3-44ef-8021-45c087b54fb9 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:20.995510 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb3f65-4f53-4a54-b6f7-666c24986d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:20.997350 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb3f65-4f53-4a54-b6f7-666c24986d72 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:21.000537 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb3f65-4f53-4a54-b6f7-666c24986d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:21.001278 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb3f65-4f53-4a54-b6f7-666c24986d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:21.001766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff26cd-b364-4620-82fb-ae8f814f5c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fbfb6f90d0449e7a4d2dd47a22d5329, user_id=c9e00255a2524a8780cb8074292c0cac, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:21.002239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb3f65-4f53-4a54-b6f7-666c24986d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:21.004461 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb3f65-4f53-4a54-b6f7-666c24986d72 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:21.007924 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff26cd-b364-4620-82fb-ae8f814f5c53 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:21.039743 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1087/2204] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:21.044429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb3f65-4f53-4a54-b6f7-666c24986d72 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:21.064769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1118/2205] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:20 2022] PUT /identity/v3/projects/4fbfb6f90d0449e7a4d2dd47a22d5329/users/c9e00255a2524a8780cb8074292c0cac/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:21.074968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09f5a2-f436-434f-9785-265890126ef2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:21.075562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09f5a2-f436-434f-9785-265890126ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:21.082662 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09f5a2-f436-434f-9785-265890126ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:21.101773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb3f65-4f53-4a54-b6f7-666c24986d72 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:21.137070 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3a09f5a2-f436-434f-9785-265890126ef2 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:21.140073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3a09f5a2-f436-434f-9785-265890126ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:21.262743 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:21.298526 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2af974-fdcc-417b-8dec-a9fe5805c3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:21.299535 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2af974-fdcc-417b-8dec-a9fe5805c3c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:21.299991 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2af974-fdcc-417b-8dec-a9fe5805c3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:21.300605 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2af974-fdcc-417b-8dec-a9fe5805c3c2 admin admin] PATH_INFO: `/v3/projects/c3721df054404b3d96635ee84277a4be/users/31edcd7d57e64ab69b21f8e9628f7663/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:21.316643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1119/2206] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:21.327993 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2af974-fdcc-417b-8dec-a9fe5805c3c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3721df054404b3d96635ee84277a4be, user_id=31edcd7d57e64ab69b21f8e9628f7663, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:21.330256 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2af974-fdcc-417b-8dec-a9fe5805c3c2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:21.333263 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09f5a2-f436-434f-9785-265890126ef2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:21.337368 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3a09f5a2-f436-434f-9785-265890126ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:21.373252 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1088/2207] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:21 2022] PUT /identity/v3/projects/c3721df054404b3d96635ee84277a4be/users/31edcd7d57e64ab69b21f8e9628f7663/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:21.374996 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2af974-fdcc-417b-8dec-a9fe5805c3c2 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:21.402478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:21.487667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2af974-fdcc-417b-8dec-a9fe5805c3c2 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:21.494122 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf67ebb-4ab7-450d-bf80-1d8a6c238d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:21.495235 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf67ebb-4ab7-450d-bf80-1d8a6c238d47 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:21.495719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf67ebb-4ab7-450d-bf80-1d8a6c238d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:21.496218 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf67ebb-4ab7-450d-bf80-1d8a6c238d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:21.497143 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf67ebb-4ab7-450d-bf80-1d8a6c238d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:21.499859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf67ebb-4ab7-450d-bf80-1d8a6c238d47 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:21.513409 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1089/2208] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:21.520647 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf67ebb-4ab7-450d-bf80-1d8a6c238d47 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:21.536133 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf67ebb-4ab7-450d-bf80-1d8a6c238d47 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:21.542229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cecd34-fd36-4595-840e-3ef37fafd656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:21.543444 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cecd34-fd36-4595-840e-3ef37fafd656 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:21.543942 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cecd34-fd36-4595-840e-3ef37fafd656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:21.544449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cecd34-fd36-4595-840e-3ef37fafd656 admin admin] PATH_INFO: `/v3/projects/c3721df054404b3d96635ee84277a4be/users/31edcd7d57e64ab69b21f8e9628f7663/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:21.548610 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cecd34-fd36-4595-840e-3ef37fafd656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3721df054404b3d96635ee84277a4be, user_id=31edcd7d57e64ab69b21f8e9628f7663, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:21.554184 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cecd34-fd36-4595-840e-3ef37fafd656 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:21.577267 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1090/2209] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:21 2022] PUT /identity/v3/projects/c3721df054404b3d96635ee84277a4be/users/31edcd7d57e64ab69b21f8e9628f7663/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:21.595393 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09f5a2-f436-434f-9785-265890126ef2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:21.755932 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56947fd6-c6ea-4bb6-a0cc-97d577eab9ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:21.756578 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56947fd6-c6ea-4bb6-a0cc-97d577eab9ac service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:21.760900 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56947fd6-c6ea-4bb6-a0cc-97d577eab9ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:21.761217 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56947fd6-c6ea-4bb6-a0cc-97d577eab9ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:21.943211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56947fd6-c6ea-4bb6-a0cc-97d577eab9ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:21.947003 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56947fd6-c6ea-4bb6-a0cc-97d577eab9ac service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:21.963832 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1120/2210] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:25.447897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7ebca-ab3e-4da7-9445-05233b5d1b2c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:25.448460 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7ebca-ab3e-4da7-9445-05233b5d1b2c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:25.448460 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7ebca-ab3e-4da7-9445-05233b5d1b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:25.513935 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9ef7ebca-ab3e-4da7-9445-05233b5d1b2c None None] MFA Rules not processed for user `c9e00255a2524a8780cb8074292c0cac`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:25.519031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9ef7ebca-ab3e-4da7-9445-05233b5d1b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:25.722848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1091/2211] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:25.733942 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56947fd6-c6ea-4bb6-a0cc-97d577eab9ac service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:25.736892 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-56947fd6-c6ea-4bb6-a0cc-97d577eab9ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:25.890945 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56947fd6-c6ea-4bb6-a0cc-97d577eab9ac service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:25.898449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5551c-2ef6-4eae-be61-20c11d633186 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:25.899391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5551c-2ef6-4eae-be61-20c11d633186 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:25.899830 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5551c-2ef6-4eae-be61-20c11d633186 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:25.900264 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5551c-2ef6-4eae-be61-20c11d633186 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:25.918210 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5551c-2ef6-4eae-be61-20c11d633186 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:25.920932 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5551c-2ef6-4eae-be61-20c11d633186 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:25.946879 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1121/2212] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:37:27.954584 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e293bd8-b469-429f-8b55-11f5f6277206 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:27.955435 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e293bd8-b469-429f-8b55-11f5f6277206 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:27.955435 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e293bd8-b469-429f-8b55-11f5f6277206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:27.983716 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9e293bd8-b469-429f-8b55-11f5f6277206 None None] MFA Rules not processed for user `c9e00255a2524a8780cb8074292c0cac`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:27.985409 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9e293bd8-b469-429f-8b55-11f5f6277206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:28.000902 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1092/2213] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:37:28.204322 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5551c-2ef6-4eae-be61-20c11d633186 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:28.206673 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-99f5551c-2ef6-4eae-be61-20c11d633186 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:28.232054 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5551c-2ef6-4eae-be61-20c11d633186 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:28.238835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503be684-7411-420b-b0df-52fe53cc1bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:28.239512 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503be684-7411-420b-b0df-52fe53cc1bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:28.239791 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503be684-7411-420b-b0df-52fe53cc1bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:28.240067 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503be684-7411-420b-b0df-52fe53cc1bff admin admin] PATH_INFO: `/v3/users/e84bd63e8fa0446b872be11785309652` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:28.242641 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503be684-7411-420b-b0df-52fe53cc1bff admin admin] RBAC: Authorizing `identity:delete_user(user_id=e84bd63e8fa0446b872be11785309652)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:28.244899 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503be684-7411-420b-b0df-52fe53cc1bff admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:28.295658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:28.351595 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-503be684-7411-420b-b0df-52fe53cc1bff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e84bd63e8fa0446b872be11785309652'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:28.399402 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-503be684-7411-420b-b0df-52fe53cc1bff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e84bd63e8fa0446b872be11785309652'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:28.402397 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-503be684-7411-420b-b0df-52fe53cc1bff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e84bd63e8fa0446b872be11785309652'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:28.420644 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-503be684-7411-420b-b0df-52fe53cc1bff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e84bd63e8fa0446b872be11785309652'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:28.436401 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-503be684-7411-420b-b0df-52fe53cc1bff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e84bd63e8fa0446b872be11785309652'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:28.453134 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1122/2214] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:28 2022] DELETE /identity/v3/users/e84bd63e8fa0446b872be11785309652 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:28.454436 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e0826-61fd-420d-a43a-58014226d77b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:28.454881 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e0826-61fd-420d-a43a-58014226d77b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:28.455386 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e0826-61fd-420d-a43a-58014226d77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:28.527690 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-904e0826-61fd-420d-a43a-58014226d77b None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:28.530400 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-904e0826-61fd-420d-a43a-58014226d77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:28.608741 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:28.699562 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1093/2215] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:28.736318 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503be684-7411-420b-b0df-52fe53cc1bff admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:28.739699 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-503be684-7411-420b-b0df-52fe53cc1bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:28.856825 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503be684-7411-420b-b0df-52fe53cc1bff admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:28.878597 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef514302-7862-415d-9e77-4634604f99a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:28.879267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef514302-7862-415d-9e77-4634604f99a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:28.879547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef514302-7862-415d-9e77-4634604f99a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:28.881406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef514302-7862-415d-9e77-4634604f99a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:28.909656 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef514302-7862-415d-9e77-4634604f99a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:28.911336 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef514302-7862-415d-9e77-4634604f99a6 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:28.942013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1123/2216] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:30.007269 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e0826-61fd-420d-a43a-58014226d77b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:30.009036 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-904e0826-61fd-420d-a43a-58014226d77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:30.041512 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e0826-61fd-420d-a43a-58014226d77b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:30.057428 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7ef9f-b1e1-44d6-b1eb-73940d505698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:30.058512 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7ef9f-b1e1-44d6-b1eb-73940d505698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:30.058512 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7ef9f-b1e1-44d6-b1eb-73940d505698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:30.058791 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7ef9f-b1e1-44d6-b1eb-73940d505698 admin admin] PATH_INFO: `/v3/projects/3551650fa3e7451f846bd51cc2bd67e4` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:30.061848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7ef9f-b1e1-44d6-b1eb-73940d505698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3551650fa3e7451f846bd51cc2bd67e4)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:30.064606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7ef9f-b1e1-44d6-b1eb-73940d505698 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:30.215750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-23b7ef9f-b1e1-44d6-b1eb-73940d505698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3551650fa3e7451f846bd51cc2bd67e4', 'request_id': 'req-23b7ef9f-b1e1-44d6-b1eb-73940d505698'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:30.230143 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-23b7ef9f-b1e1-44d6-b1eb-73940d505698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3551650fa3e7451f846bd51cc2bd67e4', 'request_id': 'req-23b7ef9f-b1e1-44d6-b1eb-73940d505698'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:30.248100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-23b7ef9f-b1e1-44d6-b1eb-73940d505698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3551650fa3e7451f846bd51cc2bd67e4', 'request_id': 'req-23b7ef9f-b1e1-44d6-b1eb-73940d505698'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:30.265942 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3aae81-8b6b-43e6-b98b-d56136650fb3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:30.266525 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3aae81-8b6b-43e6-b98b-d56136650fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:30.266525 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3aae81-8b6b-43e6-b98b-d56136650fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:30.280962 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-23b7ef9f-b1e1-44d6-b1eb-73940d505698 admin admin] The token cache is being invalidate because project 3551650fa3e7451f846bd51cc2bd67e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:30.281261 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-23b7ef9f-b1e1-44d6-b1eb-73940d505698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:30.283950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-23b7ef9f-b1e1-44d6-b1eb-73940d505698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:30.293008 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1094/2217] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:30 2022] DELETE /identity/v3/projects/3551650fa3e7451f846bd51cc2bd67e4 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:30.302587 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be5031-5df6-405f-8e46-451b0a8aff4f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:30.304128 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be5031-5df6-405f-8e46-451b0a8aff4f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:30.304128 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be5031-5df6-405f-8e46-451b0a8aff4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:30.319490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0e3aae81-8b6b-43e6-b98b-d56136650fb3 None None] MFA Rules not processed for user `3c001a902faf4b3c8d8f23f2e017c706`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:30.328097 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0e3aae81-8b6b-43e6-b98b-d56136650fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:30.344237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-06be5031-5df6-405f-8e46-451b0a8aff4f None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:30.347765 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-06be5031-5df6-405f-8e46-451b0a8aff4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:30.467570 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1124/2218] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 1 16:37:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:37:30.530443 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3aae81-8b6b-43e6-b98b-d56136650fb3 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:30.531960 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0e3aae81-8b6b-43e6-b98b-d56136650fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:30.585088 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1095/2219] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:30.589872 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2ffd6-9df4-42fe-b881-2f2aec3b66e2 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:30.590411 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2ffd6-9df4-42fe-b881-2f2aec3b66e2 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:30.591287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2ffd6-9df4-42fe-b881-2f2aec3b66e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:30.642822 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:30.668588 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a5b2ffd6-9df4-42fe-b881-2f2aec3b66e2 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:30.673684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a5b2ffd6-9df4-42fe-b881-2f2aec3b66e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:30.693380 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3aae81-8b6b-43e6-b98b-d56136650fb3 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:30.704888 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1096/2220] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:30.706623 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8956778-d621-46fb-b5f4-19b0b200bb9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748e35d9a1534920860b2234d45f6724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:30.707425 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8956778-d621-46fb-b5f4-19b0b200bb9a service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:30.707836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8956778-d621-46fb-b5f4-19b0b200bb9a service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:30.708005 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8956778-d621-46fb-b5f4-19b0b200bb9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:30.712785 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2ffd6-9df4-42fe-b881-2f2aec3b66e2 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:30.726705 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2ffd6-9df4-42fe-b881-2f2aec3b66e2 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:30.733349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8956778-d621-46fb-b5f4-19b0b200bb9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:30.735412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8956778-d621-46fb-b5f4-19b0b200bb9a service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:30.736202 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e3480-9d2d-4524-b42a-09d5aaccb53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:30.737229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e3480-9d2d-4524-b42a-09d5aaccb53b admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:30.737844 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e3480-9d2d-4524-b42a-09d5aaccb53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:30.738328 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e3480-9d2d-4524-b42a-09d5aaccb53b admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:30.740115 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e3480-9d2d-4524-b42a-09d5aaccb53b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:37:30.740726 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e3480-9d2d-4524-b42a-09d5aaccb53b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:30.743021 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e3480-9d2d-4524-b42a-09d5aaccb53b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:30.755926 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1125/2221] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 1 16:37:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 16:37:30.772355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1097/2222] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:37:30.772753 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8956778-d621-46fb-b5f4-19b0b200bb9a service swift] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:30.798507 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8956778-d621-46fb-b5f4-19b0b200bb9a service swift] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:30.808135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852d476-6095-4495-8813-d7ed738fde62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:30.808927 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852d476-6095-4495-8813-d7ed738fde62 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:30.809203 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852d476-6095-4495-8813-d7ed738fde62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:30.809872 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852d476-6095-4495-8813-d7ed738fde62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:30.811275 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852d476-6095-4495-8813-d7ed738fde62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:30.813375 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852d476-6095-4495-8813-d7ed738fde62 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:30.877544 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1126/2223] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:30 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:30.881906 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e3480-9d2d-4524-b42a-09d5aaccb53b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:30.899226 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e3480-9d2d-4524-b42a-09d5aaccb53b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:31.017076 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:31.066001 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd52c1-8e1e-462f-8613-5db49149440f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:31.067421 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd52c1-8e1e-462f-8613-5db49149440f admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:31.068049 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd52c1-8e1e-462f-8613-5db49149440f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:31.068343 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd52c1-8e1e-462f-8613-5db49149440f admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:31.069096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd52c1-8e1e-462f-8613-5db49149440f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:31.072006 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd52c1-8e1e-462f-8613-5db49149440f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:31.138994 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1098/2224] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:30 2022] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:31.143681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852d476-6095-4495-8813-d7ed738fde62 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:31.178656 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852d476-6095-4495-8813-d7ed738fde62 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:31.194453 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f17ce-3cb4-488c-8cca-1f12f112e661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:31.195725 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f17ce-3cb4-488c-8cca-1f12f112e661 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:31.196211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f17ce-3cb4-488c-8cca-1f12f112e661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:31.198749 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f17ce-3cb4-488c-8cca-1f12f112e661 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:31.200160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f17ce-3cb4-488c-8cca-1f12f112e661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:31.203644 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f17ce-3cb4-488c-8cca-1f12f112e661 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:31.243282 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1127/2225] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:37:31.249374 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd52c1-8e1e-462f-8613-5db49149440f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:31.268333 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd52c1-8e1e-462f-8613-5db49149440f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:31.286403 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44792f32-8e5b-402a-a479-fcc4b2dbd479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:31.287224 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44792f32-8e5b-402a-a479-fcc4b2dbd479 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:31.290290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44792f32-8e5b-402a-a479-fcc4b2dbd479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:31.290698 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44792f32-8e5b-402a-a479-fcc4b2dbd479 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:31.297692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44792f32-8e5b-402a-a479-fcc4b2dbd479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:31.299757 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44792f32-8e5b-402a-a479-fcc4b2dbd479 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:31.323656 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1099/2226] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:37:31.330141 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f17ce-3cb4-488c-8cca-1f12f112e661 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:31.348709 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f17ce-3cb4-488c-8cca-1f12f112e661 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:31.367397 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04786504-a186-4233-a130-20f2dea729ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:31.368820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04786504-a186-4233-a130-20f2dea729ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:31.369460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04786504-a186-4233-a130-20f2dea729ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:31.369909 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04786504-a186-4233-a130-20f2dea729ad admin admin] PATH_INFO: `/v3/projects/2ee7dd86ce134e4cb5f218771b4de6e8/users/7fe5814501aa40a3b75b7a20f34a6c0d/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:31.454380 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04786504-a186-4233-a130-20f2dea729ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ee7dd86ce134e4cb5f218771b4de6e8, user_id=7fe5814501aa40a3b75b7a20f34a6c0d, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:31.472406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04786504-a186-4233-a130-20f2dea729ad admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:31.521508 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1128/2227] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:31 2022] PUT /identity/v3/projects/2ee7dd86ce134e4cb5f218771b4de6e8/users/7fe5814501aa40a3b75b7a20f34a6c0d/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:37:31.533892 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2f11c-d0ac-41d5-9744-3c62cae28fe3 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:31.533892 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2f11c-d0ac-41d5-9744-3c62cae28fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:31.533892 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2f11c-d0ac-41d5-9744-3c62cae28fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:31.639972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c3e2f11c-d0ac-41d5-9744-3c62cae28fe3 None None] MFA Rules not processed for user `7fe5814501aa40a3b75b7a20f34a6c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:31.642504 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c3e2f11c-d0ac-41d5-9744-3c62cae28fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:31.839884 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1100/2228] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:31.852612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04786504-a186-4233-a130-20f2dea729ad admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:31.855788 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-04786504-a186-4233-a130-20f2dea729ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:32.065356 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04786504-a186-4233-a130-20f2dea729ad admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:32.101777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d74126-d08f-4a18-beb2-5679cf0c5331 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:32.102943 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d74126-d08f-4a18-beb2-5679cf0c5331 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:32.103227 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d74126-d08f-4a18-beb2-5679cf0c5331 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:32.103503 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d74126-d08f-4a18-beb2-5679cf0c5331 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:32.126148 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d74126-d08f-4a18-beb2-5679cf0c5331 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:32.127682 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d74126-d08f-4a18-beb2-5679cf0c5331 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:32.167000 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1129/2229] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:36.385001 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a3165-d927-4bb3-8499-3a0c0a238bf9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:36.385914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a3165-d927-4bb3-8499-3a0c0a238bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:36.385914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a3165-d927-4bb3-8499-3a0c0a238bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:36.604313 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-fb7a3165-d927-4bb3-8499-3a0c0a238bf9 None None] MFA Rules not processed for user `31edcd7d57e64ab69b21f8e9628f7663`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:36.615104 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fb7a3165-d927-4bb3-8499-3a0c0a238bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:37.220963 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1101/2230] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 838 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:37.350407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d74126-d08f-4a18-beb2-5679cf0c5331 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:37.352181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d2d74126-d08f-4a18-beb2-5679cf0c5331 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:37.515023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d74126-d08f-4a18-beb2-5679cf0c5331 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:37.544102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7009e2-24e1-4443-a513-68d2cf675489 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:37.546130 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7009e2-24e1-4443-a513-68d2cf675489 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:37.546433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7009e2-24e1-4443-a513-68d2cf675489 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:37.546928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7009e2-24e1-4443-a513-68d2cf675489 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:37.551538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7a7009e2-24e1-4443-a513-68d2cf675489 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:37.605919 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:37.705200 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7009e2-24e1-4443-a513-68d2cf675489 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:37.705200 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7009e2-24e1-4443-a513-68d2cf675489 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:37.714817 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1130/2231] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:38.384579 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a3165-d927-4bb3-8499-3a0c0a238bf9 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:38.526737 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:38.614653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a3165-d927-4bb3-8499-3a0c0a238bf9 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:38.626679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b55e0-5dbb-4e08-a936-3a7065bc30f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:38.637685 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b55e0-5dbb-4e08-a936-3a7065bc30f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:38.638362 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b55e0-5dbb-4e08-a936-3a7065bc30f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:38.639856 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b55e0-5dbb-4e08-a936-3a7065bc30f6 admin admin] PATH_INFO: `/v3/users/7fe5814501aa40a3b75b7a20f34a6c0d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:38.643477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b55e0-5dbb-4e08-a936-3a7065bc30f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fe5814501aa40a3b75b7a20f34a6c0d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:38.648542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b55e0-5dbb-4e08-a936-3a7065bc30f6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:38.757777 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-265b55e0-5dbb-4e08-a936-3a7065bc30f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fe5814501aa40a3b75b7a20f34a6c0d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:38.783260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-265b55e0-5dbb-4e08-a936-3a7065bc30f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fe5814501aa40a3b75b7a20f34a6c0d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:38.784173 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-265b55e0-5dbb-4e08-a936-3a7065bc30f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fe5814501aa40a3b75b7a20f34a6c0d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:38.785019 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-265b55e0-5dbb-4e08-a936-3a7065bc30f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fe5814501aa40a3b75b7a20f34a6c0d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:38.798530 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-265b55e0-5dbb-4e08-a936-3a7065bc30f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fe5814501aa40a3b75b7a20f34a6c0d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:38.830346 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1102/2232] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:38 2022] DELETE /identity/v3/users/7fe5814501aa40a3b75b7a20f34a6c0d => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:38.832243 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6701a4-33a3-4fa2-93c5-d6b5edb6d19e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:38.833074 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6701a4-33a3-4fa2-93c5-d6b5edb6d19e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:38.833074 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6701a4-33a3-4fa2-93c5-d6b5edb6d19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:38.888693 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8f6701a4-33a3-4fa2-93c5-d6b5edb6d19e None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:38.890905 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8f6701a4-33a3-4fa2-93c5-d6b5edb6d19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:39.141310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1131/2233] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:37:39.196931 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b55e0-5dbb-4e08-a936-3a7065bc30f6 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:39.200415 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-265b55e0-5dbb-4e08-a936-3a7065bc30f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:39.457092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b55e0-5dbb-4e08-a936-3a7065bc30f6 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:39.465846 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e135168-2df1-47dd-a83c-9d44c7829b0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:39.467457 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e135168-2df1-47dd-a83c-9d44c7829b0f service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:39.468372 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e135168-2df1-47dd-a83c-9d44c7829b0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:39.468782 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e135168-2df1-47dd-a83c-9d44c7829b0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:39.518225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e135168-2df1-47dd-a83c-9d44c7829b0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:39.523690 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e135168-2df1-47dd-a83c-9d44c7829b0f service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:39.587089 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1103/2234] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:40.266868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e452ffd-cf31-4977-92c7-cdc47c05be0b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:40.267818 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e452ffd-cf31-4977-92c7-cdc47c05be0b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:40.267818 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e452ffd-cf31-4977-92c7-cdc47c05be0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:40.306323 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7e452ffd-cf31-4977-92c7-cdc47c05be0b None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:40.307773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7e452ffd-cf31-4977-92c7-cdc47c05be0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:40.318618 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1132/2235] 10.222.0.75 () {58 vars in 1016 bytes} [Thu Sep 1 16:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:40.580705 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e135168-2df1-47dd-a83c-9d44c7829b0f service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:40.580705 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6e135168-2df1-47dd-a83c-9d44c7829b0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:40.599780 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e135168-2df1-47dd-a83c-9d44c7829b0f service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:40.690835 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5b699-1e87-4845-a8e9-b155e1a1e5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:40.692552 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5b699-1e87-4845-a8e9-b155e1a1e5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:40.697687 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5b699-1e87-4845-a8e9-b155e1a1e5be admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:40.697687 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5b699-1e87-4845-a8e9-b155e1a1e5be admin admin] PATH_INFO: `/v3/projects/2ee7dd86ce134e4cb5f218771b4de6e8` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:40.702463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5b699-1e87-4845-a8e9-b155e1a1e5be admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ee7dd86ce134e4cb5f218771b4de6e8)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:40.719042 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5b699-1e87-4845-a8e9-b155e1a1e5be admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:40.846031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0bf5b699-1e87-4845-a8e9-b155e1a1e5be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ee7dd86ce134e4cb5f218771b4de6e8', 'request_id': 'req-0bf5b699-1e87-4845-a8e9-b155e1a1e5be'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:40.853234 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:40.877973 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0bf5b699-1e87-4845-a8e9-b155e1a1e5be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ee7dd86ce134e4cb5f218771b4de6e8', 'request_id': 'req-0bf5b699-1e87-4845-a8e9-b155e1a1e5be'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:40.891783 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0bf5b699-1e87-4845-a8e9-b155e1a1e5be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ee7dd86ce134e4cb5f218771b4de6e8', 'request_id': 'req-0bf5b699-1e87-4845-a8e9-b155e1a1e5be'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:40.950087 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0bf5b699-1e87-4845-a8e9-b155e1a1e5be admin admin] The token cache is being invalidate because project 2ee7dd86ce134e4cb5f218771b4de6e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:40.953257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0bf5b699-1e87-4845-a8e9-b155e1a1e5be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:40.957950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0bf5b699-1e87-4845-a8e9-b155e1a1e5be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:40.962997 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1104/2236] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:40 2022] DELETE /identity/v3/projects/2ee7dd86ce134e4cb5f218771b4de6e8 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:40.971803 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c130864-d817-470c-a007-2f4cd6bee93c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:40.972111 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c130864-d817-470c-a007-2f4cd6bee93c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:40.972566 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c130864-d817-470c-a007-2f4cd6bee93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:41.040235 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6c130864-d817-470c-a007-2f4cd6bee93c None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:41.043590 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6c130864-d817-470c-a007-2f4cd6bee93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:41.276178 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1133/2237] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:41.283157 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08588638-c7ba-497b-8067-d6c4b6b1278d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:41.284676 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08588638-c7ba-497b-8067-d6c4b6b1278d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:41.285593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08588638-c7ba-497b-8067-d6c4b6b1278d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:41.333447 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c130864-d817-470c-a007-2f4cd6bee93c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:41.336369 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6c130864-d817-470c-a007-2f4cd6bee93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:41.382992 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-08588638-c7ba-497b-8067-d6c4b6b1278d None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:41.387120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-08588638-c7ba-497b-8067-d6c4b6b1278d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:41.428086 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1105/2238] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:41.430531 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08588638-c7ba-497b-8067-d6c4b6b1278d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:41.465394 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08588638-c7ba-497b-8067-d6c4b6b1278d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:41.469037 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:41.485029 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8a890-4410-4f7c-ad3c-f8ceb91dff91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:41.486436 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8a890-4410-4f7c-ad3c-f8ceb91dff91 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:41.486647 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8a890-4410-4f7c-ad3c-f8ceb91dff91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:41.487155 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8a890-4410-4f7c-ad3c-f8ceb91dff91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:41.489461 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8a890-4410-4f7c-ad3c-f8ceb91dff91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:37:41.490020 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8a890-4410-4f7c-ad3c-f8ceb91dff91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:41.494885 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8a890-4410-4f7c-ad3c-f8ceb91dff91 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:41.528864 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1106/2239] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:37:41.530130 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c130864-d817-470c-a007-2f4cd6bee93c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:41.544066 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8a890-4410-4f7c-ad3c-f8ceb91dff91 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:41.564751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d00a9-daf5-4a62-a7e4-0d06e1184af4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:41.566593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8a890-4410-4f7c-ad3c-f8ceb91dff91 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:41.572977 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d00a9-daf5-4a62-a7e4-0d06e1184af4 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:41.573775 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d00a9-daf5-4a62-a7e4-0d06e1184af4 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:41.576690 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d00a9-daf5-4a62-a7e4-0d06e1184af4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:41.579546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-594d00a9-daf5-4a62-a7e4-0d06e1184af4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:41.590222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537e1f7-f24e-43b2-b1fd-74b8bea51677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:41.591186 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537e1f7-f24e-43b2-b1fd-74b8bea51677 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:41.591743 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537e1f7-f24e-43b2-b1fd-74b8bea51677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:41.592216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537e1f7-f24e-43b2-b1fd-74b8bea51677 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:41.593373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9537e1f7-f24e-43b2-b1fd-74b8bea51677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:41.599595 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9537e1f7-f24e-43b2-b1fd-74b8bea51677 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:41.643020 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d00a9-daf5-4a62-a7e4-0d06e1184af4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:41.647434 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d00a9-daf5-4a62-a7e4-0d06e1184af4 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:41.713667 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1134/2240] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:37:41.739638 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1107/2241] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:41 2022] POST /identity/v3/projects => generated 377 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:41.740914 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d00a9-daf5-4a62-a7e4-0d06e1184af4 service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:41.785506 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d00a9-daf5-4a62-a7e4-0d06e1184af4 service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:42.120344 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b9b2d-4fcd-4a04-b41b-a4091cecea04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:42.121016 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b9b2d-4fcd-4a04-b41b-a4091cecea04 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:42.121297 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b9b2d-4fcd-4a04-b41b-a4091cecea04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:42.121571 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b9b2d-4fcd-4a04-b41b-a4091cecea04 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:42.122249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b9b2d-4fcd-4a04-b41b-a4091cecea04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:42.125084 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b9b2d-4fcd-4a04-b41b-a4091cecea04 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:42.213469 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1135/2242] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:41 2022] POST /identity/v3/users => generated 289 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:37:42.219691 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537e1f7-f24e-43b2-b1fd-74b8bea51677 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:42.282375 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537e1f7-f24e-43b2-b1fd-74b8bea51677 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:42.306810 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8767413-0275-4fc2-af82-3a54448d5bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:42.307880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8767413-0275-4fc2-af82-3a54448d5bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:42.308359 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8767413-0275-4fc2-af82-3a54448d5bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:42.314239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8767413-0275-4fc2-af82-3a54448d5bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:42.315687 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8767413-0275-4fc2-af82-3a54448d5bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:42.321229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8767413-0275-4fc2-af82-3a54448d5bd7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:42.381773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b9b2d-4fcd-4a04-b41b-a4091cecea04 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:42.395697 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1108/2243] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:42.413987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b9b2d-4fcd-4a04-b41b-a4091cecea04 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:42.437537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081b685-9a94-4f3a-b987-2457d8109e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:42.440592 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081b685-9a94-4f3a-b987-2457d8109e27 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:42.442553 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081b685-9a94-4f3a-b987-2457d8109e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:42.444523 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081b685-9a94-4f3a-b987-2457d8109e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:42.447584 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081b685-9a94-4f3a-b987-2457d8109e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:42.458204 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081b685-9a94-4f3a-b987-2457d8109e27 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:42.495983 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44803bb3-14da-488b-9759-0ead9fd335e8 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:42.496411 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44803bb3-14da-488b-9759-0ead9fd335e8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:42.496846 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44803bb3-14da-488b-9759-0ead9fd335e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:42.508557 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1136/2244] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:42.516818 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081b685-9a94-4f3a-b987-2457d8109e27 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:42.558859 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-44803bb3-14da-488b-9759-0ead9fd335e8 None None] MFA Rules not processed for user `068c4abbe8db4aceab62bbc6bbf10f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:42.560373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-44803bb3-14da-488b-9759-0ead9fd335e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:42.587579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081b685-9a94-4f3a-b987-2457d8109e27 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:42.597791 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45476f08-c3ac-429a-be86-04703407480c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:42.605411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45476f08-c3ac-429a-be86-04703407480c admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:42.605921 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45476f08-c3ac-429a-be86-04703407480c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:42.606610 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45476f08-c3ac-429a-be86-04703407480c admin admin] PATH_INFO: `/v3/projects/32fd7ca88deb427e9bc7149b6d97682c/users/d5a0220118c94d0bbe7d0441ddc17427/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:42.690427 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45476f08-c3ac-429a-be86-04703407480c admin admin] RBAC: Authorizing `identity:create_grant(project_id=32fd7ca88deb427e9bc7149b6d97682c, user_id=d5a0220118c94d0bbe7d0441ddc17427, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:42.700966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45476f08-c3ac-429a-be86-04703407480c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:42.733120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1109/2245] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:42.769207 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1137/2246] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:42 2022] PUT /identity/v3/projects/32fd7ca88deb427e9bc7149b6d97682c/users/d5a0220118c94d0bbe7d0441ddc17427/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:42.779963 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc177d1-0e2e-42bf-ba8f-e3db5726c514 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:42.780467 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc177d1-0e2e-42bf-ba8f-e3db5726c514 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:42.780877 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc177d1-0e2e-42bf-ba8f-e3db5726c514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:42.877853 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ccc177d1-0e2e-42bf-ba8f-e3db5726c514 None None] MFA Rules not processed for user `d5a0220118c94d0bbe7d0441ddc17427`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:42.879372 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ccc177d1-0e2e-42bf-ba8f-e3db5726c514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:43.142681 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1110/2247] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:43.149036 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45476f08-c3ac-429a-be86-04703407480c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:43.338959 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45476f08-c3ac-429a-be86-04703407480c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:43.365912 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111eeb6-05cc-48ea-8593-17831b148dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:43.366958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111eeb6-05cc-48ea-8593-17831b148dab admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:43.367734 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111eeb6-05cc-48ea-8593-17831b148dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:43.373626 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111eeb6-05cc-48ea-8593-17831b148dab admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:43.376858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111eeb6-05cc-48ea-8593-17831b148dab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:43.380094 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111eeb6-05cc-48ea-8593-17831b148dab admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:43.472738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1138/2248] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:43 2022] POST /identity/v3/projects => generated 375 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:43.477311 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc177d1-0e2e-42bf-ba8f-e3db5726c514 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:43.550265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc177d1-0e2e-42bf-ba8f-e3db5726c514 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:43.589076 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:43.661076 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6467f0f-89f8-4c33-b701-fced22329cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:43.662531 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6467f0f-89f8-4c33-b701-fced22329cda admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:43.663323 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6467f0f-89f8-4c33-b701-fced22329cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:43.663963 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6467f0f-89f8-4c33-b701-fced22329cda admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:43.664905 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6467f0f-89f8-4c33-b701-fced22329cda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:43.667689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6467f0f-89f8-4c33-b701-fced22329cda admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:43.708529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1111/2249] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:43 2022] POST /identity/v3/users => generated 288 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:37:43.714987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111eeb6-05cc-48ea-8593-17831b148dab admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:43.734125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111eeb6-05cc-48ea-8593-17831b148dab admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:43.759709 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a04c9-2e28-4f68-a131-5854ffa0b6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:43.762009 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a04c9-2e28-4f68-a131-5854ffa0b6bc admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:43.764023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a04c9-2e28-4f68-a131-5854ffa0b6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:43.764823 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a04c9-2e28-4f68-a131-5854ffa0b6bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:43.767319 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a04c9-2e28-4f68-a131-5854ffa0b6bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:43.771093 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a04c9-2e28-4f68-a131-5854ffa0b6bc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:43.817874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1139/2250] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:43.819095 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6467f0f-89f8-4c33-b701-fced22329cda admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:43.847683 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6467f0f-89f8-4c33-b701-fced22329cda admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:43.868167 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44415c29-a371-43d2-bc15-7345d9717525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:43.869167 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44415c29-a371-43d2-bc15-7345d9717525 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:43.869704 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44415c29-a371-43d2-bc15-7345d9717525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:43.870069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44415c29-a371-43d2-bc15-7345d9717525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:43.871048 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44415c29-a371-43d2-bc15-7345d9717525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:43.873419 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44415c29-a371-43d2-bc15-7345d9717525 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:43.921915 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1112/2251] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:43.928725 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a04c9-2e28-4f68-a131-5854ffa0b6bc admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:43.961791 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a04c9-2e28-4f68-a131-5854ffa0b6bc admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:43.989854 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1a794-e079-48f1-b0c7-9e0624405fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:43.991675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1a794-e079-48f1-b0c7-9e0624405fc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:43.992420 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1a794-e079-48f1-b0c7-9e0624405fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:43.993433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1a794-e079-48f1-b0c7-9e0624405fc7 admin admin] PATH_INFO: `/v3/projects/c0ba3235cb7641b3954c9ebffe88544e/users/e89e07f256b04a2e8fa9990022ec3ceb/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:44.002239 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:44.078686 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1a794-e079-48f1-b0c7-9e0624405fc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ba3235cb7641b3954c9ebffe88544e, user_id=e89e07f256b04a2e8fa9990022ec3ceb, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:44.097874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1a794-e079-48f1-b0c7-9e0624405fc7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:44.152847 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1140/2252] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:43 2022] PUT /identity/v3/projects/c0ba3235cb7641b3954c9ebffe88544e/users/e89e07f256b04a2e8fa9990022ec3ceb/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:44.177016 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5938e7-9456-43c9-897c-f441bb61eb50 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:44.177556 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5938e7-9456-43c9-897c-f441bb61eb50 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:44.178055 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5938e7-9456-43c9-897c-f441bb61eb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:44.285998 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2e5938e7-9456-43c9-897c-f441bb61eb50 None None] MFA Rules not processed for user `e89e07f256b04a2e8fa9990022ec3ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:44.290959 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2e5938e7-9456-43c9-897c-f441bb61eb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:44.647138 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1113/2253] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:44.652687 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1a794-e079-48f1-b0c7-9e0624405fc7 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:44.820518 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1a794-e079-48f1-b0c7-9e0624405fc7 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:44.827508 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5519d-453d-4760-ba24-adb23775a36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:44.828250 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5519d-453d-4760-ba24-adb23775a36a admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:44.830058 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5519d-453d-4760-ba24-adb23775a36a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:44.831149 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5519d-453d-4760-ba24-adb23775a36a admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:44.831864 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5519d-453d-4760-ba24-adb23775a36a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:44.833925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5519d-453d-4760-ba24-adb23775a36a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:44.909729 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1141/2254] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:44 2022] POST /identity/v3/projects => generated 375 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:37:44.913625 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5938e7-9456-43c9-897c-f441bb61eb50 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:44.945127 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5938e7-9456-43c9-897c-f441bb61eb50 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:45.136057 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14345930-f8a4-47c5-9416-d615c9ee7735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:45.136057 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14345930-f8a4-47c5-9416-d615c9ee7735 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:45.144969 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14345930-f8a4-47c5-9416-d615c9ee7735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:45.145867 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14345930-f8a4-47c5-9416-d615c9ee7735 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:45.147353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14345930-f8a4-47c5-9416-d615c9ee7735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:45.158078 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14345930-f8a4-47c5-9416-d615c9ee7735 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:45.231287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1114/2255] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:44 2022] POST /identity/v3/users => generated 294 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:37:45.239288 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5519d-453d-4760-ba24-adb23775a36a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:45.300660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5519d-453d-4760-ba24-adb23775a36a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:45.350195 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66972763-225d-4b97-bdcd-55c5e46de359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:45.351759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66972763-225d-4b97-bdcd-55c5e46de359 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:45.352579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66972763-225d-4b97-bdcd-55c5e46de359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:45.354814 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66972763-225d-4b97-bdcd-55c5e46de359 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:45.358949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66972763-225d-4b97-bdcd-55c5e46de359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:45.371439 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66972763-225d-4b97-bdcd-55c5e46de359 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:45.415077 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1142/2256] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:45.422578 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14345930-f8a4-47c5-9416-d615c9ee7735 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:45.473466 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14345930-f8a4-47c5-9416-d615c9ee7735 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:45.511682 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e69f50-f033-44bb-a983-d779c3516ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:45.515759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e69f50-f033-44bb-a983-d779c3516ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:45.517684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e69f50-f033-44bb-a983-d779c3516ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:45.518510 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e69f50-f033-44bb-a983-d779c3516ddf admin admin] PATH_INFO: `/v3/projects/7b19ba699f7b413c8fee0b91d252179a/users/705d2955bd7d4fc08f529dd91f1efa9b/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:45.564297 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e69f50-f033-44bb-a983-d779c3516ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b19ba699f7b413c8fee0b91d252179a, user_id=705d2955bd7d4fc08f529dd91f1efa9b, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:45.572523 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e69f50-f033-44bb-a983-d779c3516ddf admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:45.577161 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:45.601066 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1115/2257] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:45 2022] PUT /identity/v3/projects/7b19ba699f7b413c8fee0b91d252179a/users/705d2955bd7d4fc08f529dd91f1efa9b/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:45.612284 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66972763-225d-4b97-bdcd-55c5e46de359 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:45.627880 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66972763-225d-4b97-bdcd-55c5e46de359 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:45.797719 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487269de-9d9e-4733-8c54-0acb1a6e9d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:45.799580 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487269de-9d9e-4733-8c54-0acb1a6e9d3f admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:45.800121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487269de-9d9e-4733-8c54-0acb1a6e9d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:45.813589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487269de-9d9e-4733-8c54-0acb1a6e9d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:45.814483 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487269de-9d9e-4733-8c54-0acb1a6e9d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:45.816576 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487269de-9d9e-4733-8c54-0acb1a6e9d3f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:45.842059 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1143/2258] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:45.844600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e69f50-f033-44bb-a983-d779c3516ddf admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:45.865022 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e69f50-f033-44bb-a983-d779c3516ddf admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:45.878150 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95675d-72d0-477b-bb54-7262b19da84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:45.880891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95675d-72d0-477b-bb54-7262b19da84b admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:45.881470 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95675d-72d0-477b-bb54-7262b19da84b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:45.881860 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95675d-72d0-477b-bb54-7262b19da84b admin admin] PATH_INFO: `/v3/projects/7b19ba699f7b413c8fee0b91d252179a/users/705d2955bd7d4fc08f529dd91f1efa9b/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:45.885006 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95675d-72d0-477b-bb54-7262b19da84b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b19ba699f7b413c8fee0b91d252179a, user_id=705d2955bd7d4fc08f529dd91f1efa9b, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:45.890068 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95675d-72d0-477b-bb54-7262b19da84b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:45.918163 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1116/2259] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:45 2022] PUT /identity/v3/projects/7b19ba699f7b413c8fee0b91d252179a/users/705d2955bd7d4fc08f529dd91f1efa9b/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:45.940464 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc0253-b07d-4700-b14f-7564b3ff8437 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:45.943188 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc0253-b07d-4700-b14f-7564b3ff8437 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:45.944084 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc0253-b07d-4700-b14f-7564b3ff8437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:46.029167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-02cc0253-b07d-4700-b14f-7564b3ff8437 None None] MFA Rules not processed for user `705d2955bd7d4fc08f529dd91f1efa9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:46.031335 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-02cc0253-b07d-4700-b14f-7564b3ff8437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:46.239120 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:46.342752 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1144/2260] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:46.362654 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95675d-72d0-477b-bb54-7262b19da84b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:46.365211 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8d95675d-72d0-477b-bb54-7262b19da84b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:46.478823 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb999f71-63b3-46cf-bfec-eeab57e38d6a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:46.480199 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb999f71-63b3-46cf-bfec-eeab57e38d6a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:46.480753 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb999f71-63b3-46cf-bfec-eeab57e38d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:46.519683 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95675d-72d0-477b-bb54-7262b19da84b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:46.522823 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-bb999f71-63b3-46cf-bfec-eeab57e38d6a None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:46.527787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bb999f71-63b3-46cf-bfec-eeab57e38d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:46.531623 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfda68-0e42-4f0a-8926-b628a3c37cd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:46.532693 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfda68-0e42-4f0a-8926-b628a3c37cd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:46.532985 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfda68-0e42-4f0a-8926-b628a3c37cd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:46.533368 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfda68-0e42-4f0a-8926-b628a3c37cd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:46.703047 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfda68-0e42-4f0a-8926-b628a3c37cd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:46.711184 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfda68-0e42-4f0a-8926-b628a3c37cd1 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:46.760547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1145/2261] 10.222.0.75 () {58 vars in 1016 bytes} [Thu Sep 1 16:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:37:46.783659 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb999f71-63b3-46cf-bfec-eeab57e38d6a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:46.790180 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1117/2262] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:47.180456 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb999f71-63b3-46cf-bfec-eeab57e38d6a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:47.230485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a11e07-6bc7-4ebd-97d1-3e24f81c27cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:47.236589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a11e07-6bc7-4ebd-97d1-3e24f81c27cb service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:47.237667 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a11e07-6bc7-4ebd-97d1-3e24f81c27cb service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:47.247764 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a11e07-6bc7-4ebd-97d1-3e24f81c27cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:47.332128 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a11e07-6bc7-4ebd-97d1-3e24f81c27cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:47.338726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a11e07-6bc7-4ebd-97d1-3e24f81c27cb service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:47.381286 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1146/2263] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:49.661468 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfda68-0e42-4f0a-8926-b628a3c37cd1 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:49.663714 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e2bfda68-0e42-4f0a-8926-b628a3c37cd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:49.681096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfda68-0e42-4f0a-8926-b628a3c37cd1 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:49.686560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926fbe9f-ea95-4752-836e-efb3b5c0ea5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:49.687639 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fbe9f-ea95-4752-836e-efb3b5c0ea5b service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:49.688819 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fbe9f-ea95-4752-836e-efb3b5c0ea5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:49.689407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fbe9f-ea95-4752-836e-efb3b5c0ea5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:49.837411 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926fbe9f-ea95-4752-836e-efb3b5c0ea5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:49.839028 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926fbe9f-ea95-4752-836e-efb3b5c0ea5b service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:49.854033 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1118/2264] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:51.165803 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a11e07-6bc7-4ebd-97d1-3e24f81c27cb service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:51.185815 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a11e07-6bc7-4ebd-97d1-3e24f81c27cb service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:51.205759 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4de50-b115-4209-97b2-06b0f3f28b9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:51.206921 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4de50-b115-4209-97b2-06b0f3f28b9f service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:51.207471 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4de50-b115-4209-97b2-06b0f3f28b9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:51.208050 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4de50-b115-4209-97b2-06b0f3f28b9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:51.226884 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4de50-b115-4209-97b2-06b0f3f28b9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:51.230732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4de50-b115-4209-97b2-06b0f3f28b9f service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:51.266220 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1147/2265] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:54.204948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbe639-2051-4ae6-b375-c08584d8bddd None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:54.205841 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbe639-2051-4ae6-b375-c08584d8bddd None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:54.206574 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbe639-2051-4ae6-b375-c08584d8bddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:54.251834 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2cdbe639-2051-4ae6-b375-c08584d8bddd None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:54.253386 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2cdbe639-2051-4ae6-b375-c08584d8bddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:54.263114 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1119/2266] 10.222.0.75 () {58 vars in 1016 bytes} [Thu Sep 1 16:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:54.454861 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4de50-b115-4209-97b2-06b0f3f28b9f service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:54.472218 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4de50-b115-4209-97b2-06b0f3f28b9f service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:54.480492 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f21c0e-3924-41ad-a22f-b2f8d1fd21ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:54.482596 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f21c0e-3924-41ad-a22f-b2f8d1fd21ce service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:54.483285 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f21c0e-3924-41ad-a22f-b2f8d1fd21ce service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:54.483964 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f21c0e-3924-41ad-a22f-b2f8d1fd21ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:54.496907 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f21c0e-3924-41ad-a22f-b2f8d1fd21ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:54.499562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f21c0e-3924-41ad-a22f-b2f8d1fd21ce service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:54.524961 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1148/2267] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:56.128394 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbe639-2051-4ae6-b375-c08584d8bddd None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:56.153269 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbe639-2051-4ae6-b375-c08584d8bddd None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:56.157284 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087cb9f-5c54-4962-bc4f-c1b5f8eb5b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:56.158175 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087cb9f-5c54-4962-bc4f-c1b5f8eb5b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:56.158612 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087cb9f-5c54-4962-bc4f-c1b5f8eb5b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:56.159024 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087cb9f-5c54-4962-bc4f-c1b5f8eb5b53 admin admin] PATH_INFO: `/v3/users/d5a0220118c94d0bbe7d0441ddc17427` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:56.160433 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087cb9f-5c54-4962-bc4f-c1b5f8eb5b53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5a0220118c94d0bbe7d0441ddc17427)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:56.163260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087cb9f-5c54-4962-bc4f-c1b5f8eb5b53 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:56.203889 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:56.248857 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3087cb9f-5c54-4962-bc4f-c1b5f8eb5b53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5a0220118c94d0bbe7d0441ddc17427'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:56.272832 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3087cb9f-5c54-4962-bc4f-c1b5f8eb5b53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5a0220118c94d0bbe7d0441ddc17427'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:56.274149 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3087cb9f-5c54-4962-bc4f-c1b5f8eb5b53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5a0220118c94d0bbe7d0441ddc17427'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:56.275271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3087cb9f-5c54-4962-bc4f-c1b5f8eb5b53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5a0220118c94d0bbe7d0441ddc17427'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:56.289783 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3087cb9f-5c54-4962-bc4f-c1b5f8eb5b53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5a0220118c94d0bbe7d0441ddc17427'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:56.315286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1120/2268] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:56 2022] DELETE /identity/v3/users/d5a0220118c94d0bbe7d0441ddc17427 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:56.322207 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d611be0-10d5-42ad-8397-6b7fe42a0ed2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:56.323118 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d611be0-10d5-42ad-8397-6b7fe42a0ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:56.323118 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d611be0-10d5-42ad-8397-6b7fe42a0ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:56.354489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0d611be0-10d5-42ad-8397-6b7fe42a0ed2 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:56.356743 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0d611be0-10d5-42ad-8397-6b7fe42a0ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:56.406965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:56.441139 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1149/2269] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:56.455123 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087cb9f-5c54-4962-bc4f-c1b5f8eb5b53 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:56.457453 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3087cb9f-5c54-4962-bc4f-c1b5f8eb5b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:56.548659 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087cb9f-5c54-4962-bc4f-c1b5f8eb5b53 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:56.555141 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6656c-6ba3-4e2d-9f5d-931a83fd7619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:56.556300 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6656c-6ba3-4e2d-9f5d-931a83fd7619 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:56.556825 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6656c-6ba3-4e2d-9f5d-931a83fd7619 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:56.557577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6656c-6ba3-4e2d-9f5d-931a83fd7619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:56.577370 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6656c-6ba3-4e2d-9f5d-931a83fd7619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:56.579482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6656c-6ba3-4e2d-9f5d-931a83fd7619 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:56.598690 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1121/2270] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:56.981471 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d611be0-10d5-42ad-8397-6b7fe42a0ed2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:56.985361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0d611be0-10d5-42ad-8397-6b7fe42a0ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:57.007400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d611be0-10d5-42ad-8397-6b7fe42a0ed2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:57.016823 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2b004-dcb4-439e-9941-03047a232d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:57.017500 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2b004-dcb4-439e-9941-03047a232d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:57.017896 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2b004-dcb4-439e-9941-03047a232d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:57.018106 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2b004-dcb4-439e-9941-03047a232d3e admin admin] PATH_INFO: `/v3/projects/32fd7ca88deb427e9bc7149b6d97682c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:57.019457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b2b004-dcb4-439e-9941-03047a232d3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=32fd7ca88deb427e9bc7149b6d97682c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:57.022306 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b2b004-dcb4-439e-9941-03047a232d3e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:57.138157 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-50b2b004-dcb4-439e-9941-03047a232d3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32fd7ca88deb427e9bc7149b6d97682c', 'request_id': 'req-50b2b004-dcb4-439e-9941-03047a232d3e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:57.185758 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-50b2b004-dcb4-439e-9941-03047a232d3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32fd7ca88deb427e9bc7149b6d97682c', 'request_id': 'req-50b2b004-dcb4-439e-9941-03047a232d3e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:57.217640 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-50b2b004-dcb4-439e-9941-03047a232d3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32fd7ca88deb427e9bc7149b6d97682c', 'request_id': 'req-50b2b004-dcb4-439e-9941-03047a232d3e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:57.236934 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-50b2b004-dcb4-439e-9941-03047a232d3e admin admin] The token cache is being invalidate because project 32fd7ca88deb427e9bc7149b6d97682c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:57.238519 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-50b2b004-dcb4-439e-9941-03047a232d3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:57.239792 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-50b2b004-dcb4-439e-9941-03047a232d3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:57.243120 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1150/2271] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:56 2022] DELETE /identity/v3/projects/32fd7ca88deb427e9bc7149b6d97682c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:57.249609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6656c-6ba3-4e2d-9f5d-931a83fd7619 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:57.290428 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6656c-6ba3-4e2d-9f5d-931a83fd7619 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:57.440443 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e9317-1ff0-45af-bd31-4e228b2ef23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:57.441442 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e9317-1ff0-45af-bd31-4e228b2ef23c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:57.441973 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e9317-1ff0-45af-bd31-4e228b2ef23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:57.442455 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e9317-1ff0-45af-bd31-4e228b2ef23c admin admin] PATH_INFO: `/v3/users/e89e07f256b04a2e8fa9990022ec3ceb` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:57.443959 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e9317-1ff0-45af-bd31-4e228b2ef23c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e89e07f256b04a2e8fa9990022ec3ceb)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:57.450350 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e9317-1ff0-45af-bd31-4e228b2ef23c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:57.515404 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:57.517292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d61e9317-1ff0-45af-bd31-4e228b2ef23c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e89e07f256b04a2e8fa9990022ec3ceb'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:57.542577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d61e9317-1ff0-45af-bd31-4e228b2ef23c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e89e07f256b04a2e8fa9990022ec3ceb'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:57.543720 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d61e9317-1ff0-45af-bd31-4e228b2ef23c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e89e07f256b04a2e8fa9990022ec3ceb'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:57.545333 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d61e9317-1ff0-45af-bd31-4e228b2ef23c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e89e07f256b04a2e8fa9990022ec3ceb'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:57.563420 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d61e9317-1ff0-45af-bd31-4e228b2ef23c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e89e07f256b04a2e8fa9990022ec3ceb'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:57.597366 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1122/2272] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:57 2022] DELETE /identity/v3/users/e89e07f256b04a2e8fa9990022ec3ceb => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:57.999898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2b004-dcb4-439e-9941-03047a232d3e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:58.001586 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-50b2b004-dcb4-439e-9941-03047a232d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:58.017076 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2b004-dcb4-439e-9941-03047a232d3e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:58.104268 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46716862-b837-4229-9876-c98ef16b3936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:58.105384 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46716862-b837-4229-9876-c98ef16b3936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:58.105854 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46716862-b837-4229-9876-c98ef16b3936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:58.106378 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46716862-b837-4229-9876-c98ef16b3936 admin admin] PATH_INFO: `/v3/projects/c0ba3235cb7641b3954c9ebffe88544e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:58.108546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46716862-b837-4229-9876-c98ef16b3936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0ba3235cb7641b3954c9ebffe88544e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:58.112168 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46716862-b837-4229-9876-c98ef16b3936 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:58.217498 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-46716862-b837-4229-9876-c98ef16b3936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0ba3235cb7641b3954c9ebffe88544e', 'request_id': 'req-46716862-b837-4229-9876-c98ef16b3936'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:58.232374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-46716862-b837-4229-9876-c98ef16b3936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0ba3235cb7641b3954c9ebffe88544e', 'request_id': 'req-46716862-b837-4229-9876-c98ef16b3936'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:58.246701 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-46716862-b837-4229-9876-c98ef16b3936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0ba3235cb7641b3954c9ebffe88544e', 'request_id': 'req-46716862-b837-4229-9876-c98ef16b3936'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:58.255305 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:58.272532 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-46716862-b837-4229-9876-c98ef16b3936 admin admin] The token cache is being invalidate because project c0ba3235cb7641b3954c9ebffe88544e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:58.273616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-46716862-b837-4229-9876-c98ef16b3936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:58.274892 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-46716862-b837-4229-9876-c98ef16b3936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:58.277328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1151/2273] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:57 2022] DELETE /identity/v3/projects/c0ba3235cb7641b3954c9ebffe88544e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:58.283088 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e9317-1ff0-45af-bd31-4e228b2ef23c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:58.285494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d61e9317-1ff0-45af-bd31-4e228b2ef23c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:58.303108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e9317-1ff0-45af-bd31-4e228b2ef23c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:58.388462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2751e71-c2e9-4043-a7eb-a6f20da0bcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:58.389830 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2751e71-c2e9-4043-a7eb-a6f20da0bcff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:58.390221 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2751e71-c2e9-4043-a7eb-a6f20da0bcff admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:58.390592 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2751e71-c2e9-4043-a7eb-a6f20da0bcff admin admin] PATH_INFO: `/v3/users/705d2955bd7d4fc08f529dd91f1efa9b` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:58.392247 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2751e71-c2e9-4043-a7eb-a6f20da0bcff admin admin] RBAC: Authorizing `identity:delete_user(user_id=705d2955bd7d4fc08f529dd91f1efa9b)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:58.395376 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2751e71-c2e9-4043-a7eb-a6f20da0bcff admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:58.483038 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f2751e71-c2e9-4043-a7eb-a6f20da0bcff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '705d2955bd7d4fc08f529dd91f1efa9b'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:58.516669 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f2751e71-c2e9-4043-a7eb-a6f20da0bcff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '705d2955bd7d4fc08f529dd91f1efa9b'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:58.517929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f2751e71-c2e9-4043-a7eb-a6f20da0bcff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '705d2955bd7d4fc08f529dd91f1efa9b'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:58.520927 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f2751e71-c2e9-4043-a7eb-a6f20da0bcff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '705d2955bd7d4fc08f529dd91f1efa9b'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:58.534917 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f2751e71-c2e9-4043-a7eb-a6f20da0bcff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '705d2955bd7d4fc08f529dd91f1efa9b'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:58.559587 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1123/2274] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:58 2022] DELETE /identity/v3/users/705d2955bd7d4fc08f529dd91f1efa9b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:59.068372 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46716862-b837-4229-9876-c98ef16b3936 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:59.070871 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-46716862-b837-4229-9876-c98ef16b3936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:59.097683 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46716862-b837-4229-9876-c98ef16b3936 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:59.208670 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78fc70-3ec9-409f-a6b0-ad323a47d9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:59.209805 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78fc70-3ec9-409f-a6b0-ad323a47d9f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:59.210320 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78fc70-3ec9-409f-a6b0-ad323a47d9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:59.210836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78fc70-3ec9-409f-a6b0-ad323a47d9f1 admin admin] PATH_INFO: `/v3/projects/7b19ba699f7b413c8fee0b91d252179a` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:59.213252 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78fc70-3ec9-409f-a6b0-ad323a47d9f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b19ba699f7b413c8fee0b91d252179a)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:59.217182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78fc70-3ec9-409f-a6b0-ad323a47d9f1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:59.295757 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2d78fc70-3ec9-409f-a6b0-ad323a47d9f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b19ba699f7b413c8fee0b91d252179a', 'request_id': 'req-2d78fc70-3ec9-409f-a6b0-ad323a47d9f1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:59.308122 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2d78fc70-3ec9-409f-a6b0-ad323a47d9f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b19ba699f7b413c8fee0b91d252179a', 'request_id': 'req-2d78fc70-3ec9-409f-a6b0-ad323a47d9f1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:59.320398 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2d78fc70-3ec9-409f-a6b0-ad323a47d9f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b19ba699f7b413c8fee0b91d252179a', 'request_id': 'req-2d78fc70-3ec9-409f-a6b0-ad323a47d9f1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:59.341997 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2d78fc70-3ec9-409f-a6b0-ad323a47d9f1 admin admin] The token cache is being invalidate because project 7b19ba699f7b413c8fee0b91d252179a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:59.342459 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2d78fc70-3ec9-409f-a6b0-ad323a47d9f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:59.343505 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2d78fc70-3ec9-409f-a6b0-ad323a47d9f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:59.345915 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1152/2275] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:59 2022] DELETE /identity/v3/projects/7b19ba699f7b413c8fee0b91d252179a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:59.354458 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f34a1-f6bb-4938-ad95-1dfd8b861c9b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:59.354997 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f34a1-f6bb-4938-ad95-1dfd8b861c9b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:59.355352 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f34a1-f6bb-4938-ad95-1dfd8b861c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:59.390198 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4e1f34a1-f6bb-4938-ad95-1dfd8b861c9b None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:59.392569 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4e1f34a1-f6bb-4938-ad95-1dfd8b861c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:59.447985 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:59.481889 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1124/2276] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:59.491000 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a6bc7-cfc0-4051-8729-6d386d348b28 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:59.491409 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a6bc7-cfc0-4051-8729-6d386d348b28 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:59.491772 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a6bc7-cfc0-4051-8729-6d386d348b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:59.515108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2c2a6bc7-cfc0-4051-8729-6d386d348b28 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:59.517550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2c2a6bc7-cfc0-4051-8729-6d386d348b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:59.531598 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1153/2277] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:37:59.538385 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f34a1-f6bb-4938-ad95-1dfd8b861c9b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:59.550427 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f34a1-f6bb-4938-ad95-1dfd8b861c9b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:59.555644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61c5d5-b910-4a79-9c7c-dd0ee4466e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:59.556270 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61c5d5-b910-4a79-9c7c-dd0ee4466e8b admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:59.556548 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61c5d5-b910-4a79-9c7c-dd0ee4466e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:59.556849 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61c5d5-b910-4a79-9c7c-dd0ee4466e8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:59.557520 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61c5d5-b910-4a79-9c7c-dd0ee4466e8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:37:59.557817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61c5d5-b910-4a79-9c7c-dd0ee4466e8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:59.559459 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61c5d5-b910-4a79-9c7c-dd0ee4466e8b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:59.577954 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1125/2278] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:37:59.579314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a6bc7-cfc0-4051-8729-6d386d348b28 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:59.589881 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a6bc7-cfc0-4051-8729-6d386d348b28 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:59.596402 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3883c-2537-41dd-8301-64718dd779d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:59.597273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3883c-2537-41dd-8301-64718dd779d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:59.597558 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3883c-2537-41dd-8301-64718dd779d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:59.597840 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3883c-2537-41dd-8301-64718dd779d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:59.598495 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3883c-2537-41dd-8301-64718dd779d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:59.600536 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3883c-2537-41dd-8301-64718dd779d4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:59.638051 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1154/2279] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:59 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:59.643380 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61c5d5-b910-4a79-9c7c-dd0ee4466e8b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:59.655238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61c5d5-b910-4a79-9c7c-dd0ee4466e8b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:59.750804 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbb123-5d54-4644-9d51-445352fd154a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:59.751569 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbb123-5d54-4644-9d51-445352fd154a admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:59.751908 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbb123-5d54-4644-9d51-445352fd154a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:59.753300 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbb123-5d54-4644-9d51-445352fd154a admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:59.753300 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dbb123-5d54-4644-9d51-445352fd154a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:59.755070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dbb123-5d54-4644-9d51-445352fd154a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:59.802511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1126/2280] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:59 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:59.802769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3883c-2537-41dd-8301-64718dd779d4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:59.834259 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3883c-2537-41dd-8301-64718dd779d4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:59.844871 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679b532-d7d9-42e8-9012-5c78ea03c4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:59.845931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679b532-d7d9-42e8-9012-5c78ea03c4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:59.846435 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679b532-d7d9-42e8-9012-5c78ea03c4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:59.846923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679b532-d7d9-42e8-9012-5c78ea03c4e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:59.848046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679b532-d7d9-42e8-9012-5c78ea03c4e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:59.851088 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679b532-d7d9-42e8-9012-5c78ea03c4e2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:59.881927 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1155/2281] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:59.886061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbb123-5d54-4644-9d51-445352fd154a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:59.899354 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbb123-5d54-4644-9d51-445352fd154a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:59.907083 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9a382-c5b6-4cf9-a26e-fb71f5d30f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:59.907721 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9a382-c5b6-4cf9-a26e-fb71f5d30f8b admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:59.909019 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9a382-c5b6-4cf9-a26e-fb71f5d30f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:59.909237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9a382-c5b6-4cf9-a26e-fb71f5d30f8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:59.909925 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9a382-c5b6-4cf9-a26e-fb71f5d30f8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:59.911639 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9a382-c5b6-4cf9-a26e-fb71f5d30f8b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:59.928582 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1127/2282] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:59.933110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679b532-d7d9-42e8-9012-5c78ea03c4e2 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:59.954273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679b532-d7d9-42e8-9012-5c78ea03c4e2 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:59.973810 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530bdec-f761-4677-8168-fa1224a53165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:59.975863 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530bdec-f761-4677-8168-fa1224a53165 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:59.977499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530bdec-f761-4677-8168-fa1224a53165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:59.978118 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530bdec-f761-4677-8168-fa1224a53165 admin admin] PATH_INFO: `/v3/projects/05bcd9bddd5c4b7188a1cecac423a214/users/ee45337067ff4ad986d1ab6ee65663b8/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:00.003811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530bdec-f761-4677-8168-fa1224a53165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05bcd9bddd5c4b7188a1cecac423a214, user_id=ee45337067ff4ad986d1ab6ee65663b8, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:00.006860 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530bdec-f761-4677-8168-fa1224a53165 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:00.043167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1156/2283] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:59 2022] PUT /identity/v3/projects/05bcd9bddd5c4b7188a1cecac423a214/users/ee45337067ff4ad986d1ab6ee65663b8/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:38:00.048670 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2283d6-0c92-45f3-8cf9-4de912ac381c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:00.048972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2283d6-0c92-45f3-8cf9-4de912ac381c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:00.049236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2283d6-0c92-45f3-8cf9-4de912ac381c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:00.077338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-6a2283d6-0c92-45f3-8cf9-4de912ac381c None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:00.083746 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6a2283d6-0c92-45f3-8cf9-4de912ac381c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:00.180347 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1128/2284] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:00.188059 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530bdec-f761-4677-8168-fa1224a53165 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:00.190193 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1530bdec-f761-4677-8168-fa1224a53165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:00.215770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:00.269138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530bdec-f761-4677-8168-fa1224a53165 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:00.273176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5ad0e-26d2-4db0-99a0-85f066859104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:00.273808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5ad0e-26d2-4db0-99a0-85f066859104 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:00.274085 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5ad0e-26d2-4db0-99a0-85f066859104 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:00.274357 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5ad0e-26d2-4db0-99a0-85f066859104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:00.288515 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5ad0e-26d2-4db0-99a0-85f066859104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:00.290191 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5ad0e-26d2-4db0-99a0-85f066859104 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:00.302439 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1157/2285] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:38:01.222128 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d95e68-0a1e-44ab-a1db-69758c380667 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:01.222990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d95e68-0a1e-44ab-a1db-69758c380667 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:01.222990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d95e68-0a1e-44ab-a1db-69758c380667 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:01.225447 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1129/2286] 10.222.0.52 () {54 vars in 961 bytes} [Thu Sep 1 16:38:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:38:01.233446 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fe585-6031-46d7-8b10-e242b7006cb1 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:01.234955 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fe585-6031-46d7-8b10-e242b7006cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:01.235370 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fe585-6031-46d7-8b10-e242b7006cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:01.274330 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-049fe585-6031-46d7-8b10-e242b7006cb1 None None] MFA Rules not processed for user `d64fc190fac540259444a531cdbb8d53`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:01.277160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-049fe585-6031-46d7-8b10-e242b7006cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:01.419202 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1158/2287] 10.222.0.52 () {58 vars in 1058 bytes} [Thu Sep 1 16:38:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:01.435805 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d95e68-0a1e-44ab-a1db-69758c380667 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:01.463535 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d95e68-0a1e-44ab-a1db-69758c380667 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:01.474997 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f354d4-e132-4701-80b8-d17610e2ba15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64fc190fac540259444a531cdbb8d53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:01.476049 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f354d4-e132-4701-80b8-d17610e2ba15 service placement] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:01.476644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f354d4-e132-4701-80b8-d17610e2ba15 service placement] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:01.477176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f354d4-e132-4701-80b8-d17610e2ba15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:01.480871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-61f354d4-e132-4701-80b8-d17610e2ba15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:01.508131 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f354d4-e132-4701-80b8-d17610e2ba15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:01.512226 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f354d4-e132-4701-80b8-d17610e2ba15 service placement] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:01.534728 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1130/2288] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:01.570853 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56341d0a-7677-4034-aedb-24e9f82d6fc0 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:01.571360 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56341d0a-7677-4034-aedb-24e9f82d6fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:01.572610 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56341d0a-7677-4034-aedb-24e9f82d6fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:01.611308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-56341d0a-7677-4034-aedb-24e9f82d6fc0 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:01.613182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-56341d0a-7677-4034-aedb-24e9f82d6fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:01.626342 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1159/2289] 10.222.0.75 () {58 vars in 1016 bytes} [Thu Sep 1 16:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:02.010281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f354d4-e132-4701-80b8-d17610e2ba15 service placement] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:02.012804 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-61f354d4-e132-4701-80b8-d17610e2ba15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:02.098712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:02.153213 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f354d4-e132-4701-80b8-d17610e2ba15 service placement] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:02.160162 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6635d-b988-4075-9807-8288932b04cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:02.160903 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6635d-b988-4075-9807-8288932b04cf service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:02.161250 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6635d-b988-4075-9807-8288932b04cf service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:02.162029 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6635d-b988-4075-9807-8288932b04cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:02.174131 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6635d-b988-4075-9807-8288932b04cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:02.177465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6635d-b988-4075-9807-8288932b04cf service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:02.200290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1131/2290] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:08.252585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51126ee-b478-4a27-8965-d7db71d77f69 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:08.258666 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51126ee-b478-4a27-8965-d7db71d77f69 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:08.258666 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51126ee-b478-4a27-8965-d7db71d77f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:08.337738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b51126ee-b478-4a27-8965-d7db71d77f69 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:08.341142 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b51126ee-b478-4a27-8965-d7db71d77f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:08.358675 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48226b96-036a-4d38-88df-36d713eb8b4f None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:08.359428 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48226b96-036a-4d38-88df-36d713eb8b4f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:08.360582 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48226b96-036a-4d38-88df-36d713eb8b4f None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:08.363865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1160/2291] 10.222.0.75 () {58 vars in 1016 bytes} [Thu Sep 1 16:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:08.364147 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1132/2292] 10.222.0.52 () {54 vars in 921 bytes} [Thu Sep 1 16:38:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:38:08.381851 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000e008-4afb-41e0-9600-72fa4a9f5783 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:08.384295 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000e008-4afb-41e0-9600-72fa4a9f5783 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:08.385317 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000e008-4afb-41e0-9600-72fa4a9f5783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:08.402541 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48226b96-036a-4d38-88df-36d713eb8b4f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:08.460384 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d000e008-4afb-41e0-9600-72fa4a9f5783 None None] MFA Rules not processed for user `55f389ab3ea046008b44f129113de995`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:08.464440 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d000e008-4afb-41e0-9600-72fa4a9f5783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:08.472182 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48226b96-036a-4d38-88df-36d713eb8b4f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:08.489461 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1161/2293] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Sep 1 16:38:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:38:08.502034 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c635280-fcf5-44c6-8dfd-d344e8937d4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:08.503846 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c635280-fcf5-44c6-8dfd-d344e8937d4e service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:08.505799 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c635280-fcf5-44c6-8dfd-d344e8937d4e service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:08.507059 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c635280-fcf5-44c6-8dfd-d344e8937d4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:08.511515 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000e008-4afb-41e0-9600-72fa4a9f5783 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:08.528715 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c635280-fcf5-44c6-8dfd-d344e8937d4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:08.530601 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d000e008-4afb-41e0-9600-72fa4a9f5783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:08.533489 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c635280-fcf5-44c6-8dfd-d344e8937d4e service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:08.560301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1133/2294] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:08.659694 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000e008-4afb-41e0-9600-72fa4a9f5783 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:08.679407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623a2bf-e902-43ab-8a04-a6e860302f56 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2feb3132ad9497aaae8720ed170ef3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:08.680390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623a2bf-e902-43ab-8a04-a6e860302f56 service glance] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:08.680946 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623a2bf-e902-43ab-8a04-a6e860302f56 service glance] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:08.681380 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623a2bf-e902-43ab-8a04-a6e860302f56 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:08.698073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9623a2bf-e902-43ab-8a04-a6e860302f56 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:08.704808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9623a2bf-e902-43ab-8a04-a6e860302f56 service glance] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:08.750637 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1162/2295] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:08.884946 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffb2f7-9994-448e-8d73-11f42a2e7238 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:08.885897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffb2f7-9994-448e-8d73-11f42a2e7238 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:08.886359 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffb2f7-9994-448e-8d73-11f42a2e7238 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:08.888586 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1134/2296] 10.222.0.52 () {54 vars in 921 bytes} [Thu Sep 1 16:38:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:38:08.898897 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e86ca3-62f8-44f4-b4fb-bb606c61b473 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:08.899420 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e86ca3-62f8-44f4-b4fb-bb606c61b473 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:08.899843 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e86ca3-62f8-44f4-b4fb-bb606c61b473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:08.938795 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-13e86ca3-62f8-44f4-b4fb-bb606c61b473 None None] MFA Rules not processed for user `0668b918bf2c49c2901838cd22770030`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:08.940104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-13e86ca3-62f8-44f4-b4fb-bb606c61b473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:08.949002 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1163/2297] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Sep 1 16:38:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:08.977644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffb2f7-9994-448e-8d73-11f42a2e7238 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:08.998733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffb2f7-9994-448e-8d73-11f42a2e7238 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:09.007744 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e6a3f-da17-4045-bd4b-c10a245a6242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:09.009033 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e6a3f-da17-4045-bd4b-c10a245a6242 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:09.009469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e6a3f-da17-4045-bd4b-c10a245a6242 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:09.010392 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e6a3f-da17-4045-bd4b-c10a245a6242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:09.030569 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e6a3f-da17-4045-bd4b-c10a245a6242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:09.033161 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e6a3f-da17-4045-bd4b-c10a245a6242 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:09.043411 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1135/2298] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:09.252425 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff378581-50ac-4fb6-bb04-b6a7a7377314 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:09.252764 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff378581-50ac-4fb6-bb04-b6a7a7377314 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:09.253681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff378581-50ac-4fb6-bb04-b6a7a7377314 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:09.254976 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1164/2299] 10.222.0.52 () {54 vars in 921 bytes} [Thu Sep 1 16:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:38:09.273015 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a34fd-4454-49c5-a24a-f7816d235761 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:09.273914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a34fd-4454-49c5-a24a-f7816d235761 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:09.274649 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a34fd-4454-49c5-a24a-f7816d235761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:09.308579 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-716a34fd-4454-49c5-a24a-f7816d235761 None None] MFA Rules not processed for user `55f389ab3ea046008b44f129113de995`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:09.310142 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-716a34fd-4454-49c5-a24a-f7816d235761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:09.323805 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1136/2300] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Sep 1 16:38:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:09.339886 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff378581-50ac-4fb6-bb04-b6a7a7377314 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:09.354754 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff378581-50ac-4fb6-bb04-b6a7a7377314 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:09.359219 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d2e5a-5199-45f0-a3e5-b90370ac0592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:09.360156 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d2e5a-5199-45f0-a3e5-b90370ac0592 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:09.360596 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d2e5a-5199-45f0-a3e5-b90370ac0592 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:09.361065 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d2e5a-5199-45f0-a3e5-b90370ac0592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:09.381263 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d2e5a-5199-45f0-a3e5-b90370ac0592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:09.384212 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d2e5a-5199-45f0-a3e5-b90370ac0592 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:09.412514 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1165/2301] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:10.364462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e0d78-5aad-4cf4-9c01-951518d7e87a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:10.366483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e0d78-5aad-4cf4-9c01-951518d7e87a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:10.367246 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e0d78-5aad-4cf4-9c01-951518d7e87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:10.490481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-619e0d78-5aad-4cf4-9c01-951518d7e87a None None] MFA Rules not processed for user `ee45337067ff4ad986d1ab6ee65663b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:10.493140 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-619e0d78-5aad-4cf4-9c01-951518d7e87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:10.626755 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef8634-68fc-48c2-a683-da2e9f9409b9 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:10.627314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef8634-68fc-48c2-a683-da2e9f9409b9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:10.627771 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef8634-68fc-48c2-a683-da2e9f9409b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:10.658458 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2eef8634-68fc-48c2-a683-da2e9f9409b9 None None] MFA Rules not processed for user `c9e00255a2524a8780cb8074292c0cac`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:10.660246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2eef8634-68fc-48c2-a683-da2e9f9409b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:10.662498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1137/2302] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:38:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:10.667427 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e0d78-5aad-4cf4-9c01-951518d7e87a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:10.685467 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:10.687776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e0d78-5aad-4cf4-9c01-951518d7e87a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:10.694729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e1af5-b0c5-4a91-9283-62587f2857c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:10.695378 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e1af5-b0c5-4a91-9283-62587f2857c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:10.695740 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e1af5-b0c5-4a91-9283-62587f2857c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:10.696268 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e1af5-b0c5-4a91-9283-62587f2857c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:10.697049 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e1af5-b0c5-4a91-9283-62587f2857c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:10.699881 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e1af5-b0c5-4a91-9283-62587f2857c6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:10.758430 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1138/2303] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:38:10 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:38:10.761328 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e1af5-b0c5-4a91-9283-62587f2857c6 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:10.763808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1166/2304] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:38:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:10.862259 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:10.869898 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e1af5-b0c5-4a91-9283-62587f2857c6 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:10.880267 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a3a72-fdf9-4165-9b0e-fcaad9dd5b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:10.881510 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a3a72-fdf9-4165-9b0e-fcaad9dd5b3e admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:10.882199 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a3a72-fdf9-4165-9b0e-fcaad9dd5b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:10.882697 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a3a72-fdf9-4165-9b0e-fcaad9dd5b3e admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:10.883992 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a3a72-fdf9-4165-9b0e-fcaad9dd5b3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:10.888048 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a3a72-fdf9-4165-9b0e-fcaad9dd5b3e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:10.931379 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1139/2305] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:38:10 2022] POST /identity/v3/users => generated 299 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:38:10.932782 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef8634-68fc-48c2-a683-da2e9f9409b9 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:10.949274 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef8634-68fc-48c2-a683-da2e9f9409b9 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:10.956025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b72c4d-f449-4424-be0b-c9f30e6e945f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:10.956924 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b72c4d-f449-4424-be0b-c9f30e6e945f admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:10.957711 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b72c4d-f449-4424-be0b-c9f30e6e945f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:10.958226 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b72c4d-f449-4424-be0b-c9f30e6e945f admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:10.958918 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b72c4d-f449-4424-be0b-c9f30e6e945f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:10.960568 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b72c4d-f449-4424-be0b-c9f30e6e945f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:10.974708 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1167/2306] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:38:10.985134 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a3a72-fdf9-4165-9b0e-fcaad9dd5b3e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:11.004423 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a3a72-fdf9-4165-9b0e-fcaad9dd5b3e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:11.012054 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74ba8c-4a6b-42de-86a6-3d30c5980516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:11.012415 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74ba8c-4a6b-42de-86a6-3d30c5980516 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:11.012871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74ba8c-4a6b-42de-86a6-3d30c5980516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:11.013369 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74ba8c-4a6b-42de-86a6-3d30c5980516 admin admin] PATH_INFO: `/v3/projects/b5c45a78312e4e1ebdfc5f91afb4eb6c/users/1c0f2f9ac4df4773886b151d3e380f5e/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:11.068007 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74ba8c-4a6b-42de-86a6-3d30c5980516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5c45a78312e4e1ebdfc5f91afb4eb6c, user_id=1c0f2f9ac4df4773886b151d3e380f5e, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:11.080240 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74ba8c-4a6b-42de-86a6-3d30c5980516 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:11.125633 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1140/2307] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:38:10 2022] PUT /identity/v3/projects/b5c45a78312e4e1ebdfc5f91afb4eb6c/users/1c0f2f9ac4df4773886b151d3e380f5e/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:38:11.130767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b72c4d-f449-4424-be0b-c9f30e6e945f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:11.160833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b72c4d-f449-4424-be0b-c9f30e6e945f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:11.278167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b82bf0-dbb4-4053-b440-4cae8733589b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:11.280032 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b82bf0-dbb4-4053-b440-4cae8733589b admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:11.280362 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b82bf0-dbb4-4053-b440-4cae8733589b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:11.281236 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b82bf0-dbb4-4053-b440-4cae8733589b admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:11.285631 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b82bf0-dbb4-4053-b440-4cae8733589b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:11.288508 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b82bf0-dbb4-4053-b440-4cae8733589b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:11.320741 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1168/2308] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:38:11.327041 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74ba8c-4a6b-42de-86a6-3d30c5980516 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:11.345541 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74ba8c-4a6b-42de-86a6-3d30c5980516 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:11.353498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d107b2-30dc-4b60-8d3f-254304ae2606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:11.355840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d107b2-30dc-4b60-8d3f-254304ae2606 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:11.355840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d107b2-30dc-4b60-8d3f-254304ae2606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:11.356148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d107b2-30dc-4b60-8d3f-254304ae2606 admin admin] PATH_INFO: `/v3/projects/b5c45a78312e4e1ebdfc5f91afb4eb6c/users/1c0f2f9ac4df4773886b151d3e380f5e/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:11.360305 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d107b2-30dc-4b60-8d3f-254304ae2606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5c45a78312e4e1ebdfc5f91afb4eb6c, user_id=1c0f2f9ac4df4773886b151d3e380f5e, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:11.366481 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d107b2-30dc-4b60-8d3f-254304ae2606 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:11.396786 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1141/2309] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:38:11 2022] PUT /identity/v3/projects/b5c45a78312e4e1ebdfc5f91afb4eb6c/users/1c0f2f9ac4df4773886b151d3e380f5e/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:38:12.708297 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede208f-6b06-4784-88a4-8c2bdaf7da43 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:12.710603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede208f-6b06-4784-88a4-8c2bdaf7da43 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:12.710984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede208f-6b06-4784-88a4-8c2bdaf7da43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:12.759781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-cede208f-6b06-4784-88a4-8c2bdaf7da43 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:12.761211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cede208f-6b06-4784-88a4-8c2bdaf7da43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:12.880210 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1169/2310] 10.222.0.75 () {58 vars in 1016 bytes} [Thu Sep 1 16:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:13.208573 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d107b2-30dc-4b60-8d3f-254304ae2606 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:13.498056 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d107b2-30dc-4b60-8d3f-254304ae2606 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:13.510510 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901b55a-222b-4563-8c12-70d555f5a270 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:13.514462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901b55a-222b-4563-8c12-70d555f5a270 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:13.514966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901b55a-222b-4563-8c12-70d555f5a270 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:13.515526 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901b55a-222b-4563-8c12-70d555f5a270 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:13.534067 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901b55a-222b-4563-8c12-70d555f5a270 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:13.537270 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901b55a-222b-4563-8c12-70d555f5a270 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:13.572034 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1142/2311] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:20.902669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b298d54-33a8-4b04-acb8-a9ccbef505ab None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:20.903246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b298d54-33a8-4b04-acb8-a9ccbef505ab None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:20.903443 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b298d54-33a8-4b04-acb8-a9ccbef505ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:20.978058 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6b298d54-33a8-4b04-acb8-a9ccbef505ab None None] MFA Rules not processed for user `3c001a902faf4b3c8d8f23f2e017c706`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:20.979508 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6b298d54-33a8-4b04-acb8-a9ccbef505ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:21.114995 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:21.135851 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1170/2312] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 1 16:38:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:38:21.162076 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901b55a-222b-4563-8c12-70d555f5a270 service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:21.164845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b901b55a-222b-4563-8c12-70d555f5a270 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:21.397767 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901b55a-222b-4563-8c12-70d555f5a270 service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:21.410223 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318429ec-dba7-4f55-97f4-7f1b8165cb6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748e35d9a1534920860b2234d45f6724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:21.411698 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318429ec-dba7-4f55-97f4-7f1b8165cb6d service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:21.412440 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318429ec-dba7-4f55-97f4-7f1b8165cb6d service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:21.413259 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318429ec-dba7-4f55-97f4-7f1b8165cb6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:21.461161 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318429ec-dba7-4f55-97f4-7f1b8165cb6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:21.464785 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318429ec-dba7-4f55-97f4-7f1b8165cb6d service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:21.488914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1143/2313] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 1 16:38:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 16:38:25.721758 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04807079-d90a-4243-aa4b-14c2ccd1551a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:25.722649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04807079-d90a-4243-aa4b-14c2ccd1551a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:25.722649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04807079-d90a-4243-aa4b-14c2ccd1551a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:25.790903 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-04807079-d90a-4243-aa4b-14c2ccd1551a None None] MFA Rules not processed for user `1c0f2f9ac4df4773886b151d3e380f5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:25.793889 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-04807079-d90a-4243-aa4b-14c2ccd1551a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:26.002842 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1171/2314] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:38:25 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:26.025207 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318429ec-dba7-4f55-97f4-7f1b8165cb6d service swift] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:26.033802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-318429ec-dba7-4f55-97f4-7f1b8165cb6d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:26.132488 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:26.235937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318429ec-dba7-4f55-97f4-7f1b8165cb6d service swift] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:26.242644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e07e7b-71d4-4bd9-aec7-ccb1dadb6779 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2feb3132ad9497aaae8720ed170ef3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:26.243271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e07e7b-71d4-4bd9-aec7-ccb1dadb6779 service glance] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:26.243546 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e07e7b-71d4-4bd9-aec7-ccb1dadb6779 service glance] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:26.243812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e07e7b-71d4-4bd9-aec7-ccb1dadb6779 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:26.326953 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e07e7b-71d4-4bd9-aec7-ccb1dadb6779 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:26.328332 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e07e7b-71d4-4bd9-aec7-ccb1dadb6779 service glance] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:26.347351 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1144/2315] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:26.561354 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b6d76-a27a-4e66-a320-6fb8e28ae876 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:26.562030 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b6d76-a27a-4e66-a320-6fb8e28ae876 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:26.562641 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b6d76-a27a-4e66-a320-6fb8e28ae876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:26.619920 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3d2b6d76-a27a-4e66-a320-6fb8e28ae876 None None] MFA Rules not processed for user `3c001a902faf4b3c8d8f23f2e017c706`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:26.622413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3d2b6d76-a27a-4e66-a320-6fb8e28ae876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:26.637130 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1172/2316] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 1 16:38:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:26.686822 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e07e7b-71d4-4bd9-aec7-ccb1dadb6779 service glance] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:26.705691 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e07e7b-71d4-4bd9-aec7-ccb1dadb6779 service glance] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:26.713067 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd96f4-8e57-4df8-a72a-3d4a2ca696cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748e35d9a1534920860b2234d45f6724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:26.714201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd96f4-8e57-4df8-a72a-3d4a2ca696cc service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:26.714527 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd96f4-8e57-4df8-a72a-3d4a2ca696cc service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:26.714806 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd96f4-8e57-4df8-a72a-3d4a2ca696cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:26.726560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd96f4-8e57-4df8-a72a-3d4a2ca696cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:26.730201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd96f4-8e57-4df8-a72a-3d4a2ca696cc service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:26.742589 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1145/2317] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 1 16:38:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:38:36.590302 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=39 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:36.737059 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=44 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:43.304577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a4726-ad0a-4c99-9bba-b4421aa0aec7 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:43.304577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a4726-ad0a-4c99-9bba-b4421aa0aec7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:43.304577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a4726-ad0a-4c99-9bba-b4421aa0aec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:43.375943 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e55a4726-ad0a-4c99-9bba-b4421aa0aec7 None None] MFA Rules not processed for user `4f61b87034974b79a964fd242db8585f`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:43.380213 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e55a4726-ad0a-4c99-9bba-b4421aa0aec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:43.688025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1173/2318] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:38:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:46.701765 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd96f4-8e57-4df8-a72a-3d4a2ca696cc service swift] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:46.703328 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1bdd96f4-8e57-4df8-a72a-3d4a2ca696cc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:46.832278 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd96f4-8e57-4df8-a72a-3d4a2ca696cc service swift] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:46.839410 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b85f0-c556-4d34-8a76-0ab28584599b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:46.840473 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b85f0-c556-4d34-8a76-0ab28584599b service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:46.842054 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b85f0-c556-4d34-8a76-0ab28584599b service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:46.842451 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b85f0-c556-4d34-8a76-0ab28584599b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:46.847030 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-088b85f0-c556-4d34-8a76-0ab28584599b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:47.097868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b884d-eb61-4622-a170-8d598fee999e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:47.098387 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b884d-eb61-4622-a170-8d598fee999e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:47.098491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b884d-eb61-4622-a170-8d598fee999e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:47.123620 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b85f0-c556-4d34-8a76-0ab28584599b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:47.130655 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b85f0-c556-4d34-8a76-0ab28584599b service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:47.135136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-cc7b884d-eb61-4622-a170-8d598fee999e None None] MFA Rules not processed for user `ee45337067ff4ad986d1ab6ee65663b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:47.136717 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cc7b884d-eb61-4622-a170-8d598fee999e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:47.149754 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1174/2319] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:38:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:47.183307 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1146/2320] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:47.549616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223be0d4-dd86-4370-a01d-54037478eb47 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:47.549969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223be0d4-dd86-4370-a01d-54037478eb47 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:47.550549 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223be0d4-dd86-4370-a01d-54037478eb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:47.653896 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-223be0d4-dd86-4370-a01d-54037478eb47 None None] MFA Rules not processed for user `ed5158b5364c4e10a2128e3d098048ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:47.655361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-223be0d4-dd86-4370-a01d-54037478eb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:47.908815 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1175/2321] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:38:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:57.156065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=50 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:57.873632 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=53 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:01.623021 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0507a-2e9c-4e56-8e84-ec44e4392b38 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:01.624121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0507a-2e9c-4e56-8e84-ec44e4392b38 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:01.624505 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0507a-2e9c-4e56-8e84-ec44e4392b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:01.657232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e4b0507a-2e9c-4e56-8e84-ec44e4392b38 None None] MFA Rules not processed for user `3c001a902faf4b3c8d8f23f2e017c706`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:01.658865 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e4b0507a-2e9c-4e56-8e84-ec44e4392b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:01.671232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1147/2322] 10.222.0.52 () {58 vars in 967 bytes} [Thu Sep 1 16:39:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:39:01.713781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223be0d4-dd86-4370-a01d-54037478eb47 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:01.736599 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223be0d4-dd86-4370-a01d-54037478eb47 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:01.747694 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b26fb-26ab-485a-a3df-066b19f05edd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748e35d9a1534920860b2234d45f6724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:01.749081 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b26fb-26ab-485a-a3df-066b19f05edd service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:01.750176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b26fb-26ab-485a-a3df-066b19f05edd service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:01.751386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b26fb-26ab-485a-a3df-066b19f05edd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:01.769070 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b26fb-26ab-485a-a3df-066b19f05edd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:01.771578 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b26fb-26ab-485a-a3df-066b19f05edd service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:01.789106 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1176/2323] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 1 16:39:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:39:03.550709 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf472ffe-5ced-4bd0-a399-d9255fd526eb None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:03.553306 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf472ffe-5ced-4bd0-a399-d9255fd526eb None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:03.555300 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf472ffe-5ced-4bd0-a399-d9255fd526eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:03.614711 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-bf472ffe-5ced-4bd0-a399-d9255fd526eb None None] MFA Rules not processed for user `3c001a902faf4b3c8d8f23f2e017c706`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:03.616562 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-bf472ffe-5ced-4bd0-a399-d9255fd526eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:03.634658 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1148/2324] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 1 16:39:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:03.656946 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b26fb-26ab-485a-a3df-066b19f05edd service swift] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:03.685050 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b26fb-26ab-485a-a3df-066b19f05edd service swift] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:03.696610 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a5e65-1949-4dda-935e-d4eedbe62ec7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748e35d9a1534920860b2234d45f6724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:03.698083 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a5e65-1949-4dda-935e-d4eedbe62ec7 service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:03.698862 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a5e65-1949-4dda-935e-d4eedbe62ec7 service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:03.699558 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a5e65-1949-4dda-935e-d4eedbe62ec7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:03.719531 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a5e65-1949-4dda-935e-d4eedbe62ec7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:03.723504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a5e65-1949-4dda-935e-d4eedbe62ec7 service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:03.750333 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1177/2325] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 1 16:39:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:39:08.669061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79cee4-ef88-47f9-adf8-85c6e9aed77b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:08.669974 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79cee4-ef88-47f9-adf8-85c6e9aed77b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:08.669974 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79cee4-ef88-47f9-adf8-85c6e9aed77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:08.694212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1f79cee4-ef88-47f9-adf8-85c6e9aed77b None None] MFA Rules not processed for user `3c001a902faf4b3c8d8f23f2e017c706`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:08.695593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1f79cee4-ef88-47f9-adf8-85c6e9aed77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:08.711545 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1149/2326] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 1 16:39:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:39:08.729709 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a5e65-1949-4dda-935e-d4eedbe62ec7 service swift] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:08.763609 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a5e65-1949-4dda-935e-d4eedbe62ec7 service swift] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:08.785337 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d55441-2148-4db9-b836-01a556b8d5a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748e35d9a1534920860b2234d45f6724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:08.786663 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d55441-2148-4db9-b836-01a556b8d5a5 service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:08.787327 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d55441-2148-4db9-b836-01a556b8d5a5 service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:08.787989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d55441-2148-4db9-b836-01a556b8d5a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:08.808729 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d55441-2148-4db9-b836-01a556b8d5a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:08.813305 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d55441-2148-4db9-b836-01a556b8d5a5 service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:08.840058 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1178/2327] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 1 16:39:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:39:18.686827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=9 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:18.832014 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=18 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:22.664915 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300a919-b89d-4c4f-8e57-1ec5aa6ad613 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:22.666065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300a919-b89d-4c4f-8e57-1ec5aa6ad613 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:22.666574 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300a919-b89d-4c4f-8e57-1ec5aa6ad613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:22.701264 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c300a919-b89d-4c4f-8e57-1ec5aa6ad613 None None] MFA Rules not processed for user `054b27e46b8648979d8777e90748722d`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:22.703023 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c300a919-b89d-4c4f-8e57-1ec5aa6ad613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:22.806977 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1150/2328] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:39:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:39:32.799111 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=25 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:32.890801 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a2d7d-3122-4b86-b624-542cb703eba4 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:32.891391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a2d7d-3122-4b86-b624-542cb703eba4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:32.891391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a2d7d-3122-4b86-b624-542cb703eba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:32.958952 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-102a2d7d-3122-4b86-b624-542cb703eba4 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:32.961481 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-102a2d7d-3122-4b86-b624-542cb703eba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:32.987054 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1179/2329] 10.222.0.75 () {58 vars in 1016 bytes} [Thu Sep 1 16:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:33.117568 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300a919-b89d-4c4f-8e57-1ec5aa6ad613 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:33.120085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c300a919-b89d-4c4f-8e57-1ec5aa6ad613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:33.160034 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300a919-b89d-4c4f-8e57-1ec5aa6ad613 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:33.171231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bc07d-6e8c-4660-8d09-bf2f365b1c6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:33.172323 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bc07d-6e8c-4660-8d09-bf2f365b1c6a service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:33.172837 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bc07d-6e8c-4660-8d09-bf2f365b1c6a service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:33.173319 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bc07d-6e8c-4660-8d09-bf2f365b1c6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:33.187687 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bc07d-6e8c-4660-8d09-bf2f365b1c6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:33.190243 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bc07d-6e8c-4660-8d09-bf2f365b1c6a service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:33.214940 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1151/2330] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:34.783817 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5316db-7d0c-49ef-8c7a-515c0bd0266f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:34.784521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5316db-7d0c-49ef-8c7a-515c0bd0266f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:34.784521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5316db-7d0c-49ef-8c7a-515c0bd0266f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:34.805910 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-dc5316db-7d0c-49ef-8c7a-515c0bd0266f None None] MFA Rules not processed for user `3c001a902faf4b3c8d8f23f2e017c706`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:34.807184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dc5316db-7d0c-49ef-8c7a-515c0bd0266f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:34.815416 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1180/2331] 10.222.0.52 () {58 vars in 967 bytes} [Thu Sep 1 16:39:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:34.834074 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bc07d-6e8c-4660-8d09-bf2f365b1c6a service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:34.847894 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bc07d-6e8c-4660-8d09-bf2f365b1c6a service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:34.853554 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c73a5-df57-4605-a345-15091817e116 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748e35d9a1534920860b2234d45f6724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:34.854173 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c73a5-df57-4605-a345-15091817e116 service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:34.854454 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c73a5-df57-4605-a345-15091817e116 service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:34.854722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c73a5-df57-4605-a345-15091817e116 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:34.863908 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c73a5-df57-4605-a345-15091817e116 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:34.865726 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c73a5-df57-4605-a345-15091817e116 service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:34.876166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1152/2332] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 1 16:39:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:39:37.651812 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5316db-7d0c-49ef-8c7a-515c0bd0266f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:37.655420 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dc5316db-7d0c-49ef-8c7a-515c0bd0266f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:37.677360 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5316db-7d0c-49ef-8c7a-515c0bd0266f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:37.682361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ae3d1-a0a3-4b5b-aefb-55884ca1d44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:37.683016 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ae3d1-a0a3-4b5b-aefb-55884ca1d44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:37.683286 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ae3d1-a0a3-4b5b-aefb-55884ca1d44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:37.683569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ae3d1-a0a3-4b5b-aefb-55884ca1d44c admin admin] PATH_INFO: `/v3/users/c9e00255a2524a8780cb8074292c0cac` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:37.685878 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ae3d1-a0a3-4b5b-aefb-55884ca1d44c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9e00255a2524a8780cb8074292c0cac)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:37.687867 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ae3d1-a0a3-4b5b-aefb-55884ca1d44c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:37.749289 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c17ae3d1-a0a3-4b5b-aefb-55884ca1d44c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e00255a2524a8780cb8074292c0cac'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:37.763755 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c17ae3d1-a0a3-4b5b-aefb-55884ca1d44c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e00255a2524a8780cb8074292c0cac'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:37.764608 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c17ae3d1-a0a3-4b5b-aefb-55884ca1d44c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e00255a2524a8780cb8074292c0cac'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:37.773137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c17ae3d1-a0a3-4b5b-aefb-55884ca1d44c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e00255a2524a8780cb8074292c0cac'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:37.784096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c17ae3d1-a0a3-4b5b-aefb-55884ca1d44c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e00255a2524a8780cb8074292c0cac'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:37.795824 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1181/2333] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:39:37 2022] DELETE /identity/v3/users/c9e00255a2524a8780cb8074292c0cac => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:38.051436 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c73a5-df57-4605-a345-15091817e116 service swift] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:38.084468 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c73a5-df57-4605-a345-15091817e116 service swift] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:38.343804 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca6ef5-26cc-43a9-af0b-3e5bb7edaaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:38.344950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca6ef5-26cc-43a9-af0b-3e5bb7edaaa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:38.345428 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca6ef5-26cc-43a9-af0b-3e5bb7edaaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:38.345893 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca6ef5-26cc-43a9-af0b-3e5bb7edaaa6 admin admin] PATH_INFO: `/v3/projects/4fbfb6f90d0449e7a4d2dd47a22d5329` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:38.347453 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca6ef5-26cc-43a9-af0b-3e5bb7edaaa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fbfb6f90d0449e7a4d2dd47a22d5329)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:38.350052 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca6ef5-26cc-43a9-af0b-3e5bb7edaaa6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:38.440518 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-57ca6ef5-26cc-43a9-af0b-3e5bb7edaaa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fbfb6f90d0449e7a4d2dd47a22d5329', 'request_id': 'req-57ca6ef5-26cc-43a9-af0b-3e5bb7edaaa6'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:38.449866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-57ca6ef5-26cc-43a9-af0b-3e5bb7edaaa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fbfb6f90d0449e7a4d2dd47a22d5329', 'request_id': 'req-57ca6ef5-26cc-43a9-af0b-3e5bb7edaaa6'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:38.466326 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-57ca6ef5-26cc-43a9-af0b-3e5bb7edaaa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fbfb6f90d0449e7a4d2dd47a22d5329', 'request_id': 'req-57ca6ef5-26cc-43a9-af0b-3e5bb7edaaa6'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:38.508038 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-57ca6ef5-26cc-43a9-af0b-3e5bb7edaaa6 admin admin] The token cache is being invalidate because project 4fbfb6f90d0449e7a4d2dd47a22d5329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:39:38.508705 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-57ca6ef5-26cc-43a9-af0b-3e5bb7edaaa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:38.512434 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-57ca6ef5-26cc-43a9-af0b-3e5bb7edaaa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:38.522233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1153/2334] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:39:38 2022] DELETE /identity/v3/projects/4fbfb6f90d0449e7a4d2dd47a22d5329 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:38.545870 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995eaa5-4f9f-4ae2-86c2-220e8e393a30 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:38.546248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995eaa5-4f9f-4ae2-86c2-220e8e393a30 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:38.546795 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995eaa5-4f9f-4ae2-86c2-220e8e393a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:38.614812 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a995eaa5-4f9f-4ae2-86c2-220e8e393a30 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:38.616439 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a995eaa5-4f9f-4ae2-86c2-220e8e393a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:38.837569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1182/2335] 10.222.0.75 () {58 vars in 1016 bytes} [Thu Sep 1 16:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:39.199902 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca6ef5-26cc-43a9-af0b-3e5bb7edaaa6 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:39.202250 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-57ca6ef5-26cc-43a9-af0b-3e5bb7edaaa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:39.297742 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:39.304778 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca6ef5-26cc-43a9-af0b-3e5bb7edaaa6 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:39.313405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17745a1c-3f2e-4909-8269-ab3fc441f357 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:39.314729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17745a1c-3f2e-4909-8269-ab3fc441f357 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:39.315383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17745a1c-3f2e-4909-8269-ab3fc441f357 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:39.315891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17745a1c-3f2e-4909-8269-ab3fc441f357 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:39.329820 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17745a1c-3f2e-4909-8269-ab3fc441f357 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:39.331763 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17745a1c-3f2e-4909-8269-ab3fc441f357 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:39.348971 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1154/2336] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:39:42.457766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995eaa5-4f9f-4ae2-86c2-220e8e393a30 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:42.460050 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a995eaa5-4f9f-4ae2-86c2-220e8e393a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:42.532548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995eaa5-4f9f-4ae2-86c2-220e8e393a30 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:42.537291 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a854e20-0898-4d0f-83b2-f4e6b1479ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:42.538021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a854e20-0898-4d0f-83b2-f4e6b1479ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:42.538388 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a854e20-0898-4d0f-83b2-f4e6b1479ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:42.538755 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a854e20-0898-4d0f-83b2-f4e6b1479ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:42.540828 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1a854e20-0898-4d0f-83b2-f4e6b1479ba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:42.556882 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:42.628365 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a854e20-0898-4d0f-83b2-f4e6b1479ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:42.631027 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a854e20-0898-4d0f-83b2-f4e6b1479ba8 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:42.644481 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1183/2337] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:43.873075 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0804a47-4f94-4c51-8e7f-5cfaa3ff2f90 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:43.874200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0804a47-4f94-4c51-8e7f-5cfaa3ff2f90 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:43.874631 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0804a47-4f94-4c51-8e7f-5cfaa3ff2f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:43.924317 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b0804a47-4f94-4c51-8e7f-5cfaa3ff2f90 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:43.926428 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b0804a47-4f94-4c51-8e7f-5cfaa3ff2f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:43.939648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1155/2338] 10.222.0.75 () {58 vars in 1016 bytes} [Thu Sep 1 16:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:43.971795 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a854e20-0898-4d0f-83b2-f4e6b1479ba8 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:44.003057 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a854e20-0898-4d0f-83b2-f4e6b1479ba8 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:44.036353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7ca75-a181-4991-922a-8b6c1b2fb44b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:44.038297 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7ca75-a181-4991-922a-8b6c1b2fb44b service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:44.039350 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7ca75-a181-4991-922a-8b6c1b2fb44b service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:44.040251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7ca75-a181-4991-922a-8b6c1b2fb44b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:44.086249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7ca75-a181-4991-922a-8b6c1b2fb44b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:44.092324 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7ca75-a181-4991-922a-8b6c1b2fb44b service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:44.115190 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1184/2339] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:39:47.141207 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779492f7-57bd-4808-a03b-643a98c472c8 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:47.142140 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779492f7-57bd-4808-a03b-643a98c472c8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:47.142140 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779492f7-57bd-4808-a03b-643a98c472c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:47.191263 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-779492f7-57bd-4808-a03b-643a98c472c8 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:47.193405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-779492f7-57bd-4808-a03b-643a98c472c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:47.204174 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1156/2340] 10.222.0.75 () {58 vars in 1016 bytes} [Thu Sep 1 16:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:47.243690 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7ca75-a181-4991-922a-8b6c1b2fb44b service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:47.256130 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6bf7ca75-a181-4991-922a-8b6c1b2fb44b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:47.280271 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7ca75-a181-4991-922a-8b6c1b2fb44b service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:47.297738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e0935-12cf-4eac-af2b-03db0cc675fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:47.299218 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e0935-12cf-4eac-af2b-03db0cc675fc service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:47.301123 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e0935-12cf-4eac-af2b-03db0cc675fc service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:47.306250 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e0935-12cf-4eac-af2b-03db0cc675fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:47.322053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e0935-12cf-4eac-af2b-03db0cc675fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:47.323527 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e0935-12cf-4eac-af2b-03db0cc675fc service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:47.338249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1185/2341] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:39:49.615939 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68803aeb-9c6e-4afe-8173-bb1930a447c4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:49.616870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68803aeb-9c6e-4afe-8173-bb1930a447c4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:49.617044 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68803aeb-9c6e-4afe-8173-bb1930a447c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:49.680225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-68803aeb-9c6e-4afe-8173-bb1930a447c4 None None] MFA Rules not processed for user `3fb9d9c35c224ceabcb12fe5933e09c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:49.682900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-68803aeb-9c6e-4afe-8173-bb1930a447c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:49.808245 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1157/2342] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:39:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:51.503186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2743b2-c1a2-4081-a45d-e8e4ebe3db90 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:51.503828 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2743b2-c1a2-4081-a45d-e8e4ebe3db90 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:51.504325 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2743b2-c1a2-4081-a45d-e8e4ebe3db90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:51.535367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7a2743b2-c1a2-4081-a45d-e8e4ebe3db90 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:51.536859 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7a2743b2-c1a2-4081-a45d-e8e4ebe3db90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:51.546389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1186/2343] 10.222.0.75 () {58 vars in 1016 bytes} [Thu Sep 1 16:39:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:51.578842 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68803aeb-9c6e-4afe-8173-bb1930a447c4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:51.595013 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68803aeb-9c6e-4afe-8173-bb1930a447c4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:51.601862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7729b8-e294-411e-a398-c258d41c4f5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:51.602682 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7729b8-e294-411e-a398-c258d41c4f5f service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:51.603100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7729b8-e294-411e-a398-c258d41c4f5f service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:51.603472 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7729b8-e294-411e-a398-c258d41c4f5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:51.613837 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7729b8-e294-411e-a398-c258d41c4f5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:51.615454 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7729b8-e294-411e-a398-c258d41c4f5f service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:51.627420 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1158/2344] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:59.172038 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2743b2-c1a2-4081-a45d-e8e4ebe3db90 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:59.173616 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7a2743b2-c1a2-4081-a45d-e8e4ebe3db90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:59.188308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2743b2-c1a2-4081-a45d-e8e4ebe3db90 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:59.192887 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e89c3-f3f5-4a88-9a75-c54dcb642f47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:59.193673 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e89c3-f3f5-4a88-9a75-c54dcb642f47 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:59.194095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e89c3-f3f5-4a88-9a75-c54dcb642f47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:59.194505 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e89c3-f3f5-4a88-9a75-c54dcb642f47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:59.196610 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ff0e89c3-f3f5-4a88-9a75-c54dcb642f47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:59.213517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e89c3-f3f5-4a88-9a75-c54dcb642f47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:59.215774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e89c3-f3f5-4a88-9a75-c54dcb642f47 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:59.228849 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1187/2345] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:40:01.622689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=42 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:02.258899 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7729b8-e294-411e-a398-c258d41c4f5f service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:02.271443 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7729b8-e294-411e-a398-c258d41c4f5f service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:02.276486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970da16-b8d4-4980-b115-9191d364552f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:02.277976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970da16-b8d4-4980-b115-9191d364552f service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:02.278310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970da16-b8d4-4980-b115-9191d364552f service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:02.278693 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970da16-b8d4-4980-b115-9191d364552f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:02.281102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e970da16-b8d4-4980-b115-9191d364552f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:02.300032 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970da16-b8d4-4980-b115-9191d364552f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:02.302785 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970da16-b8d4-4980-b115-9191d364552f service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:02.325294 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1159/2346] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:09.223018 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=44 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:12.314407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=6 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:13.877702 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f39034-9aaf-4ca2-b8ed-5691dd2fa671 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:13.878345 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f39034-9aaf-4ca2-b8ed-5691dd2fa671 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:13.878345 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f39034-9aaf-4ca2-b8ed-5691dd2fa671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:13.901988 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b7f39034-9aaf-4ca2-b8ed-5691dd2fa671 None None] MFA Rules not processed for user `e08b6d367dc542f882cb821abd11cc34`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:13.903261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b7f39034-9aaf-4ca2-b8ed-5691dd2fa671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:13.967815 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1188/2347] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:40:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:40:18.418283 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970da16-b8d4-4980-b115-9191d364552f service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:18.447569 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970da16-b8d4-4980-b115-9191d364552f service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:18.461493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d8890-c49c-494d-a52a-2bd934b13e0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:18.464520 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d8890-c49c-494d-a52a-2bd934b13e0b service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:18.465389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d8890-c49c-494d-a52a-2bd934b13e0b service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:18.466079 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d8890-c49c-494d-a52a-2bd934b13e0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:18.470060 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a55d8890-c49c-494d-a52a-2bd934b13e0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:18.494028 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d8890-c49c-494d-a52a-2bd934b13e0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:18.499192 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d8890-c49c-494d-a52a-2bd934b13e0b service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:18.524411 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1160/2348] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:18 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:23.959687 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=25 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:28.513095 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=6 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:30.570825 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f39034-9aaf-4ca2-b8ed-5691dd2fa671 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:30.573873 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b7f39034-9aaf-4ca2-b8ed-5691dd2fa671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:30.691812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d8890-c49c-494d-a52a-2bd934b13e0b service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:30.694151 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a55d8890-c49c-494d-a52a-2bd934b13e0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:30.716528 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f39034-9aaf-4ca2-b8ed-5691dd2fa671 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:30.723794 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360491c6-c395-4de3-a265-01e00861dd85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64fc190fac540259444a531cdbb8d53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:30.724838 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360491c6-c395-4de3-a265-01e00861dd85 service placement] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:30.725275 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360491c6-c395-4de3-a265-01e00861dd85 service placement] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:30.725700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360491c6-c395-4de3-a265-01e00861dd85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:30.728349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-360491c6-c395-4de3-a265-01e00861dd85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:30.729786 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d8890-c49c-494d-a52a-2bd934b13e0b service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:30.735407 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfe134-0a9f-44f3-95ab-74061e4e520c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:30.736134 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfe134-0a9f-44f3-95ab-74061e4e520c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:30.736477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfe134-0a9f-44f3-95ab-74061e4e520c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:30.737119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfe134-0a9f-44f3-95ab-74061e4e520c admin admin] PATH_INFO: `/v3/users/4f61b87034974b79a964fd242db8585f` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:30.738930 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cfe134-0a9f-44f3-95ab-74061e4e520c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f61b87034974b79a964fd242db8585f)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:30.741563 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cfe134-0a9f-44f3-95ab-74061e4e520c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:30.748544 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360491c6-c395-4de3-a265-01e00861dd85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:30.750820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360491c6-c395-4de3-a265-01e00861dd85 service placement] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:30.765858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1189/2349] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:30.841257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c2cfe134-0a9f-44f3-95ab-74061e4e520c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f61b87034974b79a964fd242db8585f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:30.862393 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c2cfe134-0a9f-44f3-95ab-74061e4e520c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f61b87034974b79a964fd242db8585f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:30.863366 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c2cfe134-0a9f-44f3-95ab-74061e4e520c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f61b87034974b79a964fd242db8585f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:30.864095 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c2cfe134-0a9f-44f3-95ab-74061e4e520c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f61b87034974b79a964fd242db8585f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:30.875972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c2cfe134-0a9f-44f3-95ab-74061e4e520c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f61b87034974b79a964fd242db8585f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:30.906725 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1161/2350] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:40:30 2022] DELETE /identity/v3/users/4f61b87034974b79a964fd242db8585f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:40:31.597206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360491c6-c395-4de3-a265-01e00861dd85 service placement] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:31.619193 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360491c6-c395-4de3-a265-01e00861dd85 service placement] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:31.762676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4be02-0b65-4294-b63d-8192a8b791d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:31.763613 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4be02-0b65-4294-b63d-8192a8b791d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:31.764086 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4be02-0b65-4294-b63d-8192a8b791d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:31.764712 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4be02-0b65-4294-b63d-8192a8b791d4 admin admin] PATH_INFO: `/v3/projects/8e8eb2f1d7e1423c93b47914c90553f0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:31.767403 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4be02-0b65-4294-b63d-8192a8b791d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e8eb2f1d7e1423c93b47914c90553f0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:31.770271 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4be02-0b65-4294-b63d-8192a8b791d4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:31.839358 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bdf4be02-0b65-4294-b63d-8192a8b791d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e8eb2f1d7e1423c93b47914c90553f0', 'request_id': 'req-bdf4be02-0b65-4294-b63d-8192a8b791d4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:31.859052 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bdf4be02-0b65-4294-b63d-8192a8b791d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e8eb2f1d7e1423c93b47914c90553f0', 'request_id': 'req-bdf4be02-0b65-4294-b63d-8192a8b791d4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:31.872343 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bdf4be02-0b65-4294-b63d-8192a8b791d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e8eb2f1d7e1423c93b47914c90553f0', 'request_id': 'req-bdf4be02-0b65-4294-b63d-8192a8b791d4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:31.887728 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bdf4be02-0b65-4294-b63d-8192a8b791d4 admin admin] The token cache is being invalidate because project 8e8eb2f1d7e1423c93b47914c90553f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:40:31.887728 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bdf4be02-0b65-4294-b63d-8192a8b791d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:31.888242 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bdf4be02-0b65-4294-b63d-8192a8b791d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:31.890209 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1190/2351] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:40:31 2022] DELETE /identity/v3/projects/8e8eb2f1d7e1423c93b47914c90553f0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:40:39.550631 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfe134-0a9f-44f3-95ab-74061e4e520c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:39.552200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c2cfe134-0a9f-44f3-95ab-74061e4e520c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:39.644764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfe134-0a9f-44f3-95ab-74061e4e520c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:39.726551 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4d787-13f2-4f78-a809-d2e6700b876c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:39.727191 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4d787-13f2-4f78-a809-d2e6700b876c service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:39.727469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4d787-13f2-4f78-a809-d2e6700b876c service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:39.727769 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4d787-13f2-4f78-a809-d2e6700b876c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:39.730262 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-32b4d787-13f2-4f78-a809-d2e6700b876c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:39.737169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:39.809264 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4d787-13f2-4f78-a809-d2e6700b876c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:39.810807 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4d787-13f2-4f78-a809-d2e6700b876c service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:39.822076 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1162/2352] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:41.883100 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:44.145481 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d5d18-3e9f-4fe9-b6e8-30270ee7a8c5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:44.146174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d5d18-3e9f-4fe9-b6e8-30270ee7a8c5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:44.146174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d5d18-3e9f-4fe9-b6e8-30270ee7a8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:44.167640 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7c6d5d18-3e9f-4fe9-b6e8-30270ee7a8c5 None None] MFA Rules not processed for user `ed5158b5364c4e10a2128e3d098048ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:44.168921 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7c6d5d18-3e9f-4fe9-b6e8-30270ee7a8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:44.248468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1191/2353] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:40:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:44.851385 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4d787-13f2-4f78-a809-d2e6700b876c service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:44.853737 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-32b4d787-13f2-4f78-a809-d2e6700b876c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:44.928404 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4d787-13f2-4f78-a809-d2e6700b876c service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:44.934443 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4d182-986f-47ee-8d60-261858f362c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:44.935272 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4d182-986f-47ee-8d60-261858f362c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:44.935454 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4d182-986f-47ee-8d60-261858f362c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:44.935627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4d182-986f-47ee-8d60-261858f362c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:44.937582 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e9c4d182-986f-47ee-8d60-261858f362c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:44.949524 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4d182-986f-47ee-8d60-261858f362c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:44.951016 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4d182-986f-47ee-8d60-261858f362c9 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:44.960798 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1163/2354] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:52.270498 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d5d18-3e9f-4fe9-b6e8-30270ee7a8c5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:52.272757 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7c6d5d18-3e9f-4fe9-b6e8-30270ee7a8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:52.364421 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d5d18-3e9f-4fe9-b6e8-30270ee7a8c5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:52.371649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42b525-c80b-485a-a6dd-0405e7a597b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:52.372446 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42b525-c80b-485a-a6dd-0405e7a597b8 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:52.372761 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42b525-c80b-485a-a6dd-0405e7a597b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:52.373036 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42b525-c80b-485a-a6dd-0405e7a597b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:52.375078 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1b42b525-c80b-485a-a6dd-0405e7a597b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:52.398675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42b525-c80b-485a-a6dd-0405e7a597b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:52.401889 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42b525-c80b-485a-a6dd-0405e7a597b8 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:52.423562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1192/2355] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:52.563426 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4d182-986f-47ee-8d60-261858f362c9 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:52.565808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e9c4d182-986f-47ee-8d60-261858f362c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:52.783103 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4d182-986f-47ee-8d60-261858f362c9 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:52.800858 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22944acc-5c81-497b-a6bb-dadf1d7b37d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:52.802093 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22944acc-5c81-497b-a6bb-dadf1d7b37d0 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:52.803158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22944acc-5c81-497b-a6bb-dadf1d7b37d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:52.803362 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22944acc-5c81-497b-a6bb-dadf1d7b37d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:52.807880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-22944acc-5c81-497b-a6bb-dadf1d7b37d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:52.845970 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22944acc-5c81-497b-a6bb-dadf1d7b37d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:52.847887 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22944acc-5c81-497b-a6bb-dadf1d7b37d0 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:52.866609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1164/2356] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:40:57.269796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453040b9-99c3-4c45-8de3-8638c724dbf7 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:57.270661 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453040b9-99c3-4c45-8de3-8638c724dbf7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:57.270661 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453040b9-99c3-4c45-8de3-8638c724dbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:57.298471 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-453040b9-99c3-4c45-8de3-8638c724dbf7 None None] MFA Rules not processed for user `054b27e46b8648979d8777e90748722d`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:57.300403 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-453040b9-99c3-4c45-8de3-8638c724dbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:57.312770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1193/2357] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:40:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:40:57.692016 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22944acc-5c81-497b-a6bb-dadf1d7b37d0 service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:57.725417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22944acc-5c81-497b-a6bb-dadf1d7b37d0 service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:57.732351 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d6b8b-cb43-4369-bed9-21045783b953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:57.733465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d6b8b-cb43-4369-bed9-21045783b953 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:57.733977 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d6b8b-cb43-4369-bed9-21045783b953 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:57.734474 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d6b8b-cb43-4369-bed9-21045783b953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:57.737514 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c54d6b8b-cb43-4369-bed9-21045783b953 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:57.772957 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d6b8b-cb43-4369-bed9-21045783b953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:57.774887 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d6b8b-cb43-4369-bed9-21045783b953 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:57.785237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1165/2358] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:58.236513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453040b9-99c3-4c45-8de3-8638c724dbf7 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:58.238097 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-453040b9-99c3-4c45-8de3-8638c724dbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:58.342147 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453040b9-99c3-4c45-8de3-8638c724dbf7 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:58.349098 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f52b4-c376-4045-a910-f922f2e0d16c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64fc190fac540259444a531cdbb8d53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:58.349954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f52b4-c376-4045-a910-f922f2e0d16c service placement] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:58.350383 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f52b4-c376-4045-a910-f922f2e0d16c service placement] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:58.350755 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f52b4-c376-4045-a910-f922f2e0d16c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:58.353038 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6b2f52b4-c376-4045-a910-f922f2e0d16c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:58.371909 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f52b4-c376-4045-a910-f922f2e0d16c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:58.373787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f52b4-c376-4045-a910-f922f2e0d16c service placement] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:58.385877 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1194/2359] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:03.717231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d6b8b-cb43-4369-bed9-21045783b953 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:03.733048 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d6b8b-cb43-4369-bed9-21045783b953 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:03.739380 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a29c7-051a-4ca5-b9b5-ff777064ab2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:03.740068 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a29c7-051a-4ca5-b9b5-ff777064ab2e service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:03.740395 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a29c7-051a-4ca5-b9b5-ff777064ab2e service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:03.740895 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a29c7-051a-4ca5-b9b5-ff777064ab2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:03.742889 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-680a29c7-051a-4ca5-b9b5-ff777064ab2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:03.789397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:03.820055 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a29c7-051a-4ca5-b9b5-ff777064ab2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:03.822647 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a29c7-051a-4ca5-b9b5-ff777064ab2e service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:03.833682 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1166/2360] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:07.306635 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f52b4-c376-4045-a910-f922f2e0d16c service placement] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:07.327037 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f52b4-c376-4045-a910-f922f2e0d16c service placement] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:07.334232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d06e32-2450-4aee-9775-c5ecc3224673 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:07.335268 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d06e32-2450-4aee-9775-c5ecc3224673 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:07.335676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d06e32-2450-4aee-9775-c5ecc3224673 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:07.336135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d06e32-2450-4aee-9775-c5ecc3224673 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:07.338563 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-63d06e32-2450-4aee-9775-c5ecc3224673 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:07.356691 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d06e32-2450-4aee-9775-c5ecc3224673 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:07.359525 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d06e32-2450-4aee-9775-c5ecc3224673 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:07.374763 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1195/2361] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:13.828612 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=12 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:17.311068 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be050e5-46ba-49d9-8514-db53d52592ad None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:17.312055 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be050e5-46ba-49d9-8514-db53d52592ad None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:17.312055 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be050e5-46ba-49d9-8514-db53d52592ad None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:17.313382 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1167/2362] 10.222.0.52 () {54 vars in 921 bytes} [Thu Sep 1 16:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:41:17.319933 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1698f83-a9b2-4dc0-8f99-a7ca7d218c1e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:17.320848 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1698f83-a9b2-4dc0-8f99-a7ca7d218c1e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:17.320848 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1698f83-a9b2-4dc0-8f99-a7ca7d218c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:17.327293 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:17.393630 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c1698f83-a9b2-4dc0-8f99-a7ca7d218c1e None None] MFA Rules not processed for user `0668b918bf2c49c2901838cd22770030`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:17.395432 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c1698f83-a9b2-4dc0-8f99-a7ca7d218c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:17.408602 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1196/2363] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Sep 1 16:41:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:17.425582 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be050e5-46ba-49d9-8514-db53d52592ad None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:17.427446 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3be050e5-46ba-49d9-8514-db53d52592ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:17.443248 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be050e5-46ba-49d9-8514-db53d52592ad None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:17.447393 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea3eac-648a-40cf-85eb-394d8e8238e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:17.448267 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea3eac-648a-40cf-85eb-394d8e8238e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:17.448743 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea3eac-648a-40cf-85eb-394d8e8238e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:17.449212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea3eac-648a-40cf-85eb-394d8e8238e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:17.461726 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea3eac-648a-40cf-85eb-394d8e8238e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:17.464119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea3eac-648a-40cf-85eb-394d8e8238e1 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:17.473810 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1168/2364] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:41:17.590339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8addb3f-e6dd-46cc-9817-c6f4fdc92252 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:17.590951 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8addb3f-e6dd-46cc-9817-c6f4fdc92252 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:17.591630 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8addb3f-e6dd-46cc-9817-c6f4fdc92252 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:17.595453 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1197/2365] 10.222.0.52 () {54 vars in 921 bytes} [Thu Sep 1 16:41:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:41:17.601783 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02172743-379f-4951-b30d-a84bd03034a7 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:17.602150 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02172743-379f-4951-b30d-a84bd03034a7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:17.603362 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02172743-379f-4951-b30d-a84bd03034a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:17.640070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-02172743-379f-4951-b30d-a84bd03034a7 None None] MFA Rules not processed for user `55f389ab3ea046008b44f129113de995`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:17.641752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-02172743-379f-4951-b30d-a84bd03034a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:17.657026 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1169/2366] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Sep 1 16:41:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:17.671367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8addb3f-e6dd-46cc-9817-c6f4fdc92252 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:17.691565 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8addb3f-e6dd-46cc-9817-c6f4fdc92252 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:17.698227 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c20349-6e2a-473c-8843-c628f4665bb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:17.699775 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c20349-6e2a-473c-8843-c628f4665bb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:17.700528 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c20349-6e2a-473c-8843-c628f4665bb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:17.701052 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c20349-6e2a-473c-8843-c628f4665bb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:17.722501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c20349-6e2a-473c-8843-c628f4665bb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:17.733133 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c20349-6e2a-473c-8843-c628f4665bb1 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:17.750052 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1198/2367] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:27.632691 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=9 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:27.742615 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=16 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:31.303549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02172743-379f-4951-b30d-a84bd03034a7 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:31.315070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02172743-379f-4951-b30d-a84bd03034a7 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:31.320659 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbbfb4-47cf-47fb-b6aa-7119f4a098ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:31.322289 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbbfb4-47cf-47fb-b6aa-7119f4a098ae service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:31.322289 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbbfb4-47cf-47fb-b6aa-7119f4a098ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:31.324089 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbbfb4-47cf-47fb-b6aa-7119f4a098ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:31.326100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d1cbbfb4-47cf-47fb-b6aa-7119f4a098ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:31.511217 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbbfb4-47cf-47fb-b6aa-7119f4a098ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:31.514972 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbbfb4-47cf-47fb-b6aa-7119f4a098ae service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:31.565668 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1170/2368] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:41:37.060466 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c20349-6e2a-473c-8843-c628f4665bb1 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:37.063174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-28c20349-6e2a-473c-8843-c628f4665bb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:37.089360 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c20349-6e2a-473c-8843-c628f4665bb1 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:37.098749 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ad097-2d14-4644-be05-eadeeae85dee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64fc190fac540259444a531cdbb8d53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:37.100187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ad097-2d14-4644-be05-eadeeae85dee service placement] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:37.100713 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ad097-2d14-4644-be05-eadeeae85dee service placement] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:37.101217 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ad097-2d14-4644-be05-eadeeae85dee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:37.105267 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2b0ad097-2d14-4644-be05-eadeeae85dee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:37.126417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ad097-2d14-4644-be05-eadeeae85dee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:37.128801 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ad097-2d14-4644-be05-eadeeae85dee service placement] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:37.148512 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1199/2369] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:41:37.170557 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbbfb4-47cf-47fb-b6aa-7119f4a098ae service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:37.173486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d1cbbfb4-47cf-47fb-b6aa-7119f4a098ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:37.188417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbbfb4-47cf-47fb-b6aa-7119f4a098ae service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:37.193900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe29df9-6f72-4247-bcfa-35396f9821a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:37.194953 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe29df9-6f72-4247-bcfa-35396f9821a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:37.195225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe29df9-6f72-4247-bcfa-35396f9821a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:37.195746 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe29df9-6f72-4247-bcfa-35396f9821a3 admin admin] PATH_INFO: `/v3/users/3fb9d9c35c224ceabcb12fe5933e09c5` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:37.197174 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe29df9-6f72-4247-bcfa-35396f9821a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb9d9c35c224ceabcb12fe5933e09c5)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:37.199718 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe29df9-6f72-4247-bcfa-35396f9821a3 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:37.271463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5fe29df9-6f72-4247-bcfa-35396f9821a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb9d9c35c224ceabcb12fe5933e09c5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:37.287759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5fe29df9-6f72-4247-bcfa-35396f9821a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb9d9c35c224ceabcb12fe5933e09c5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:37.288739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5fe29df9-6f72-4247-bcfa-35396f9821a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb9d9c35c224ceabcb12fe5933e09c5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:37.289985 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5fe29df9-6f72-4247-bcfa-35396f9821a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb9d9c35c224ceabcb12fe5933e09c5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:37.298869 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5fe29df9-6f72-4247-bcfa-35396f9821a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb9d9c35c224ceabcb12fe5933e09c5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:37.315391 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1171/2370] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:41:37 2022] DELETE /identity/v3/users/3fb9d9c35c224ceabcb12fe5933e09c5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:41:37.698814 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ad097-2d14-4644-be05-eadeeae85dee service placement] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:37.743621 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ad097-2d14-4644-be05-eadeeae85dee service placement] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:37.867873 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355d334-6c4b-450a-928f-1908dd963e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:37.868534 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355d334-6c4b-450a-928f-1908dd963e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:37.868868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355d334-6c4b-450a-928f-1908dd963e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:37.869127 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355d334-6c4b-450a-928f-1908dd963e74 admin admin] PATH_INFO: `/v3/projects/bf496edaad3447d4b46bca012a047180` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:37.870452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355d334-6c4b-450a-928f-1908dd963e74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf496edaad3447d4b46bca012a047180)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:37.872662 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355d334-6c4b-450a-928f-1908dd963e74 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:37.968064 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f355d334-6c4b-450a-928f-1908dd963e74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf496edaad3447d4b46bca012a047180', 'request_id': 'req-f355d334-6c4b-450a-928f-1908dd963e74'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:37.979843 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f355d334-6c4b-450a-928f-1908dd963e74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf496edaad3447d4b46bca012a047180', 'request_id': 'req-f355d334-6c4b-450a-928f-1908dd963e74'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:37.989814 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f355d334-6c4b-450a-928f-1908dd963e74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf496edaad3447d4b46bca012a047180', 'request_id': 'req-f355d334-6c4b-450a-928f-1908dd963e74'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:38.002959 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f355d334-6c4b-450a-928f-1908dd963e74 admin admin] The token cache is being invalidate because project bf496edaad3447d4b46bca012a047180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:41:38.003210 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f355d334-6c4b-450a-928f-1908dd963e74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:38.003993 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f355d334-6c4b-450a-928f-1908dd963e74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:38.005994 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1200/2371] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:41:37 2022] DELETE /identity/v3/projects/bf496edaad3447d4b46bca012a047180 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:41:38.012570 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24ff70-cb9d-4e87-813a-5e86a33bd664 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:38.013382 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24ff70-cb9d-4e87-813a-5e86a33bd664 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:38.013839 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24ff70-cb9d-4e87-813a-5e86a33bd664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:38.106800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-fb24ff70-cb9d-4e87-813a-5e86a33bd664 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:38.109072 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fb24ff70-cb9d-4e87-813a-5e86a33bd664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:38.126835 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:38.215778 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1172/2372] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:38.224781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532d001-4af8-45cd-8a97-43f7a6740851 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:38.225385 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532d001-4af8-45cd-8a97-43f7a6740851 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:38.225385 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532d001-4af8-45cd-8a97-43f7a6740851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:38.248021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7532d001-4af8-45cd-8a97-43f7a6740851 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:38.249550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7532d001-4af8-45cd-8a97-43f7a6740851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:38.257869 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1201/2373] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:41:38.262396 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24ff70-cb9d-4e87-813a-5e86a33bd664 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:38.273367 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24ff70-cb9d-4e87-813a-5e86a33bd664 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:38.279486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc8d4d-ef90-4222-988c-fd86cc4ba115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:38.280000 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc8d4d-ef90-4222-988c-fd86cc4ba115 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:38.280352 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc8d4d-ef90-4222-988c-fd86cc4ba115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:38.280660 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc8d4d-ef90-4222-988c-fd86cc4ba115 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:38.281330 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc8d4d-ef90-4222-988c-fd86cc4ba115 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:41:38.281630 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc8d4d-ef90-4222-988c-fd86cc4ba115 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:38.283314 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc8d4d-ef90-4222-988c-fd86cc4ba115 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:38.298021 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1173/2374] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:41:38.302726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532d001-4af8-45cd-8a97-43f7a6740851 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:38.312990 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532d001-4af8-45cd-8a97-43f7a6740851 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:38.318513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f3660-b87b-4713-8ea2-684220000a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:38.319237 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f3660-b87b-4713-8ea2-684220000a87 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:38.319652 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f3660-b87b-4713-8ea2-684220000a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:38.320036 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f3660-b87b-4713-8ea2-684220000a87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:38.320870 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f3660-b87b-4713-8ea2-684220000a87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:38.323091 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f3660-b87b-4713-8ea2-684220000a87 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:38.368833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1202/2375] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:41:38 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:41:38.373526 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc8d4d-ef90-4222-988c-fd86cc4ba115 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:38.385812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc8d4d-ef90-4222-988c-fd86cc4ba115 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:38.486595 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd85a4-dd0c-433a-b6d1-03456c27fb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:38.487287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd85a4-dd0c-433a-b6d1-03456c27fb3f admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:38.487706 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd85a4-dd0c-433a-b6d1-03456c27fb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:38.488100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd85a4-dd0c-433a-b6d1-03456c27fb3f admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:38.488959 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd85a4-dd0c-433a-b6d1-03456c27fb3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:38.491118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd85a4-dd0c-433a-b6d1-03456c27fb3f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:38.518151 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1174/2376] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:41:38 2022] POST /identity/v3/users => generated 291 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:41:38.523012 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f3660-b87b-4713-8ea2-684220000a87 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:38.535923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f3660-b87b-4713-8ea2-684220000a87 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:38.543719 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d44331-fbc0-4d05-b250-72ff3ddc0508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:38.544826 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d44331-fbc0-4d05-b250-72ff3ddc0508 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:38.545343 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d44331-fbc0-4d05-b250-72ff3ddc0508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:38.545857 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d44331-fbc0-4d05-b250-72ff3ddc0508 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:38.547113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d44331-fbc0-4d05-b250-72ff3ddc0508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:38.550213 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d44331-fbc0-4d05-b250-72ff3ddc0508 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:38.572315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1203/2377] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:41:38.577338 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd85a4-dd0c-433a-b6d1-03456c27fb3f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:38.590545 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd85a4-dd0c-433a-b6d1-03456c27fb3f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:38.595897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1eb71-ac0a-4f98-9c73-8d7541c610fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:38.596590 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1eb71-ac0a-4f98-9c73-8d7541c610fa admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:38.596978 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1eb71-ac0a-4f98-9c73-8d7541c610fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:38.597397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1eb71-ac0a-4f98-9c73-8d7541c610fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:38.598173 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c1eb71-ac0a-4f98-9c73-8d7541c610fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:38.600100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c1eb71-ac0a-4f98-9c73-8d7541c610fa admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:38.613215 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1175/2378] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:41:38.617912 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d44331-fbc0-4d05-b250-72ff3ddc0508 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:38.629743 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d44331-fbc0-4d05-b250-72ff3ddc0508 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:38.635570 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba5b76-9c09-4fbe-bd2f-ef61e8df3c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:38.636366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba5b76-9c09-4fbe-bd2f-ef61e8df3c22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:38.636764 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba5b76-9c09-4fbe-bd2f-ef61e8df3c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:38.637095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba5b76-9c09-4fbe-bd2f-ef61e8df3c22 admin admin] PATH_INFO: `/v3/projects/f6709eb8c46f4f2687641ecf17f018b8/users/8ddb681796384fa7a4e4b2e54444f112/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:38.655702 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba5b76-9c09-4fbe-bd2f-ef61e8df3c22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6709eb8c46f4f2687641ecf17f018b8, user_id=8ddb681796384fa7a4e4b2e54444f112, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:38.658718 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba5b76-9c09-4fbe-bd2f-ef61e8df3c22 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:38.678051 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1204/2379] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:41:38 2022] PUT /identity/v3/projects/f6709eb8c46f4f2687641ecf17f018b8/users/8ddb681796384fa7a4e4b2e54444f112/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:41:38.696439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe1396-ee10-4855-af09-2d06616e2ccd None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:38.696754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe1396-ee10-4855-af09-2d06616e2ccd None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:38.697033 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe1396-ee10-4855-af09-2d06616e2ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:38.729763 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a5fe1396-ee10-4855-af09-2d06616e2ccd None None] MFA Rules not processed for user `8ddb681796384fa7a4e4b2e54444f112`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:38.731085 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a5fe1396-ee10-4855-af09-2d06616e2ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:38.839308 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1176/2380] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:41:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:39.092849 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba5b76-9c09-4fbe-bd2f-ef61e8df3c22 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:39.095339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7fba5b76-9c09-4fbe-bd2f-ef61e8df3c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:39.103345 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:39.241814 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba5b76-9c09-4fbe-bd2f-ef61e8df3c22 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:39.251897 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398ca7d-a438-4749-9d5a-2731fd7b6049 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:39.253404 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398ca7d-a438-4749-9d5a-2731fd7b6049 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:39.254081 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398ca7d-a438-4749-9d5a-2731fd7b6049 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:39.254656 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398ca7d-a438-4749-9d5a-2731fd7b6049 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:39.270273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398ca7d-a438-4749-9d5a-2731fd7b6049 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:39.274233 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398ca7d-a438-4749-9d5a-2731fd7b6049 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:39.293475 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1205/2381] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:41.708869 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa02a75-7333-4ca9-b559-318563b8c665 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:41.708869 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa02a75-7333-4ca9-b559-318563b8c665 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:41.710035 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa02a75-7333-4ca9-b559-318563b8c665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:41.742722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2fa02a75-7333-4ca9-b559-318563b8c665 None None] MFA Rules not processed for user `3c001a902faf4b3c8d8f23f2e017c706`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:41.744212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2fa02a75-7333-4ca9-b559-318563b8c665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:41.761106 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:41.922115 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1177/2382] 10.222.0.52 () {58 vars in 967 bytes} [Thu Sep 1 16:41:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:41:42.001282 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b05e9-bf15-4c0f-bf3b-a2d48865753c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:42.002198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b05e9-bf15-4c0f-bf3b-a2d48865753c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:42.002659 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b05e9-bf15-4c0f-bf3b-a2d48865753c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:42.043734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa02a75-7333-4ca9-b559-318563b8c665 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:42.046815 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2fa02a75-7333-4ca9-b559-318563b8c665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:42.063203 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-934b05e9-bf15-4c0f-bf3b-a2d48865753c None None] MFA Rules not processed for user `3c001a902faf4b3c8d8f23f2e017c706`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:42.065985 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-934b05e9-bf15-4c0f-bf3b-a2d48865753c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:42.122606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1206/2383] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 1 16:41:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:42.124147 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b05e9-bf15-4c0f-bf3b-a2d48865753c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:42.128460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-934b05e9-bf15-4c0f-bf3b-a2d48865753c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:42.214942 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa02a75-7333-4ca9-b559-318563b8c665 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:42.222528 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89be937-7b84-4456-8127-212c97760e59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748e35d9a1534920860b2234d45f6724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:42.224056 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89be937-7b84-4456-8127-212c97760e59 service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:42.224450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89be937-7b84-4456-8127-212c97760e59 service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:42.224857 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89be937-7b84-4456-8127-212c97760e59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:42.238604 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89be937-7b84-4456-8127-212c97760e59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:42.241842 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89be937-7b84-4456-8127-212c97760e59 service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:42.270442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b05e9-bf15-4c0f-bf3b-a2d48865753c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:42.279784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ac3aa-0459-4589-882b-e22c1c4c5124 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748e35d9a1534920860b2234d45f6724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:42.281137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ac3aa-0459-4589-882b-e22c1c4c5124 service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:42.281785 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ac3aa-0459-4589-882b-e22c1c4c5124 service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:42.282074 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ac3aa-0459-4589-882b-e22c1c4c5124 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:42.287840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1178/2384] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 1 16:41:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 16:41:42.302738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ac3aa-0459-4589-882b-e22c1c4c5124 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:42.306950 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ac3aa-0459-4589-882b-e22c1c4c5124 service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:42.323460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1207/2385] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 1 16:41:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:41:43.157824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89be937-7b84-4456-8127-212c97760e59 service swift] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:43.160120 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e89be937-7b84-4456-8127-212c97760e59 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:43.180917 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89be937-7b84-4456-8127-212c97760e59 service swift] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:43.194231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf88e47-aaff-4570-9bb1-97961f8a01d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:43.195833 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf88e47-aaff-4570-9bb1-97961f8a01d6 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:43.197257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf88e47-aaff-4570-9bb1-97961f8a01d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:43.197818 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf88e47-aaff-4570-9bb1-97961f8a01d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:43.200296 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4bf88e47-aaff-4570-9bb1-97961f8a01d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:43.303224 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf88e47-aaff-4570-9bb1-97961f8a01d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:43.305302 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf88e47-aaff-4570-9bb1-97961f8a01d6 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:43.322999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1179/2386] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:43 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:45.095074 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ac3aa-0459-4589-882b-e22c1c4c5124 service swift] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:45.245740 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ac3aa-0459-4589-882b-e22c1c4c5124 service swift] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:45.264745 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b36b93-329e-49ae-bff8-7f95ac9d8436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:45.265801 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b36b93-329e-49ae-bff8-7f95ac9d8436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:45.266092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b36b93-329e-49ae-bff8-7f95ac9d8436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:45.266944 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b36b93-329e-49ae-bff8-7f95ac9d8436 admin admin] PATH_INFO: `/v3/users/8ddb681796384fa7a4e4b2e54444f112` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:45.269490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b36b93-329e-49ae-bff8-7f95ac9d8436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ddb681796384fa7a4e4b2e54444f112)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:45.272006 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b36b93-329e-49ae-bff8-7f95ac9d8436 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:45.291127 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:45.404070 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-98b36b93-329e-49ae-bff8-7f95ac9d8436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ddb681796384fa7a4e4b2e54444f112'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:45.489111 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-98b36b93-329e-49ae-bff8-7f95ac9d8436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ddb681796384fa7a4e4b2e54444f112'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:45.494082 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-98b36b93-329e-49ae-bff8-7f95ac9d8436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ddb681796384fa7a4e4b2e54444f112'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:45.530446 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-98b36b93-329e-49ae-bff8-7f95ac9d8436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ddb681796384fa7a4e4b2e54444f112'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:45.557591 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-98b36b93-329e-49ae-bff8-7f95ac9d8436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ddb681796384fa7a4e4b2e54444f112'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:45.579600 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1208/2387] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:41:45 2022] DELETE /identity/v3/users/8ddb681796384fa7a4e4b2e54444f112 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:41:45.587911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093cc83-baf7-4aeb-8ae5-ef4c1f5a3afc None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:45.588823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093cc83-baf7-4aeb-8ae5-ef4c1f5a3afc None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:45.589542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093cc83-baf7-4aeb-8ae5-ef4c1f5a3afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:45.631220 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1093cc83-baf7-4aeb-8ae5-ef4c1f5a3afc None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:45.635282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1093cc83-baf7-4aeb-8ae5-ef4c1f5a3afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:45.751804 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:45.820004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1180/2388] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:45.832798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b36b93-329e-49ae-bff8-7f95ac9d8436 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:45.835358 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-98b36b93-329e-49ae-bff8-7f95ac9d8436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:45.978633 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b36b93-329e-49ae-bff8-7f95ac9d8436 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:45.983202 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028bf8b-927b-47d5-b41b-f495edb14cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:45.984094 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028bf8b-927b-47d5-b41b-f495edb14cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:45.984478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028bf8b-927b-47d5-b41b-f495edb14cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:45.984935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028bf8b-927b-47d5-b41b-f495edb14cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:46.004158 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028bf8b-927b-47d5-b41b-f495edb14cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:46.005929 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028bf8b-927b-47d5-b41b-f495edb14cd6 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:46.020970 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1209/2389] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:46.683333 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093cc83-baf7-4aeb-8ae5-ef4c1f5a3afc None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:46.695724 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1093cc83-baf7-4aeb-8ae5-ef4c1f5a3afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:46.760659 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093cc83-baf7-4aeb-8ae5-ef4c1f5a3afc None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:46.767866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8d281-bf34-44ce-b803-d04dd4776fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:46.768901 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8d281-bf34-44ce-b803-d04dd4776fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:46.769593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8d281-bf34-44ce-b803-d04dd4776fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:46.770082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8d281-bf34-44ce-b803-d04dd4776fb4 admin admin] PATH_INFO: `/v3/projects/f6709eb8c46f4f2687641ecf17f018b8` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:46.787910 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8d281-bf34-44ce-b803-d04dd4776fb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6709eb8c46f4f2687641ecf17f018b8)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:46.791304 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8d281-bf34-44ce-b803-d04dd4776fb4 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:46.899497 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ffa8d281-bf34-44ce-b803-d04dd4776fb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6709eb8c46f4f2687641ecf17f018b8', 'request_id': 'req-ffa8d281-bf34-44ce-b803-d04dd4776fb4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:46.916090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ffa8d281-bf34-44ce-b803-d04dd4776fb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6709eb8c46f4f2687641ecf17f018b8', 'request_id': 'req-ffa8d281-bf34-44ce-b803-d04dd4776fb4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:46.931871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ffa8d281-bf34-44ce-b803-d04dd4776fb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6709eb8c46f4f2687641ecf17f018b8', 'request_id': 'req-ffa8d281-bf34-44ce-b803-d04dd4776fb4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:46.969492 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ffa8d281-bf34-44ce-b803-d04dd4776fb4 admin admin] The token cache is being invalidate because project f6709eb8c46f4f2687641ecf17f018b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:41:46.970394 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ffa8d281-bf34-44ce-b803-d04dd4776fb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:46.972154 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ffa8d281-bf34-44ce-b803-d04dd4776fb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:46.977007 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1181/2390] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:41:46 2022] DELETE /identity/v3/projects/f6709eb8c46f4f2687641ecf17f018b8 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:41:46.986454 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f5adf-fee5-4444-9c45-669fe22a52a3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:46.987965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f5adf-fee5-4444-9c45-669fe22a52a3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:46.988875 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f5adf-fee5-4444-9c45-669fe22a52a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:47.070847 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-527f5adf-fee5-4444-9c45-669fe22a52a3 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:47.073317 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-527f5adf-fee5-4444-9c45-669fe22a52a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:47.223915 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1210/2391] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:47.237212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cced418-1a13-45c8-a909-b937da7583de None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:47.237511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cced418-1a13-45c8-a909-b937da7583de None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:47.237870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cced418-1a13-45c8-a909-b937da7583de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:47.289515 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9cced418-1a13-45c8-a909-b937da7583de None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:47.292969 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9cced418-1a13-45c8-a909-b937da7583de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:47.317883 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1182/2392] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:41:47.318781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f5adf-fee5-4444-9c45-669fe22a52a3 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:47.343174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f5adf-fee5-4444-9c45-669fe22a52a3 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:47.360597 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b4a96-69dc-461b-b306-9ffbc2af8c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:47.362502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b4a96-69dc-461b-b306-9ffbc2af8c98 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:47.363393 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b4a96-69dc-461b-b306-9ffbc2af8c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:47.364219 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b4a96-69dc-461b-b306-9ffbc2af8c98 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:47.367690 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b4a96-69dc-461b-b306-9ffbc2af8c98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:41:47.369604 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b4a96-69dc-461b-b306-9ffbc2af8c98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:47.373908 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b4a96-69dc-461b-b306-9ffbc2af8c98 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:47.422576 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1211/2393] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:41:47.427720 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cced418-1a13-45c8-a909-b937da7583de None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:47.445516 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cced418-1a13-45c8-a909-b937da7583de None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:47.455568 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e556ace-eb35-480c-851c-aa97dde72ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:47.456201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e556ace-eb35-480c-851c-aa97dde72ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:47.456477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e556ace-eb35-480c-851c-aa97dde72ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:47.456791 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e556ace-eb35-480c-851c-aa97dde72ab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:47.457827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e556ace-eb35-480c-851c-aa97dde72ab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:47.460188 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e556ace-eb35-480c-851c-aa97dde72ab2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:47.516080 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1183/2394] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:41:47 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:41:47.518600 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b4a96-69dc-461b-b306-9ffbc2af8c98 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:47.552347 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b4a96-69dc-461b-b306-9ffbc2af8c98 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:47.732182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:47.938372 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7456f09-dc4b-4940-8793-904a048450d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:47.939605 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7456f09-dc4b-4940-8793-904a048450d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:47.941629 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7456f09-dc4b-4940-8793-904a048450d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:47.942070 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7456f09-dc4b-4940-8793-904a048450d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:47.942828 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7456f09-dc4b-4940-8793-904a048450d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:47.957771 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7456f09-dc4b-4940-8793-904a048450d3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:48.071514 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1212/2395] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:41:47 2022] POST /identity/v3/users => generated 287 bytes in 554 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:41:48.079655 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e556ace-eb35-480c-851c-aa97dde72ab2 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:48.114484 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e556ace-eb35-480c-851c-aa97dde72ab2 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:48.132397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d4694-523d-45d2-baf2-d4f7bd066bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:48.133461 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d4694-523d-45d2-baf2-d4f7bd066bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:48.135012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d4694-523d-45d2-baf2-d4f7bd066bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:48.135486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d4694-523d-45d2-baf2-d4f7bd066bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:48.136512 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d4694-523d-45d2-baf2-d4f7bd066bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:48.139896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d4694-523d-45d2-baf2-d4f7bd066bf2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:48.170718 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1184/2396] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:41:48.176603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7456f09-dc4b-4940-8793-904a048450d3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:48.215896 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7456f09-dc4b-4940-8793-904a048450d3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:48.224979 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbdc32-843c-461f-9da6-d3645d933b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:48.226038 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbdc32-843c-461f-9da6-d3645d933b12 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:48.226559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbdc32-843c-461f-9da6-d3645d933b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:48.227041 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbdc32-843c-461f-9da6-d3645d933b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:48.228284 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbdc32-843c-461f-9da6-d3645d933b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:48.231539 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbdc32-843c-461f-9da6-d3645d933b12 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:48.264344 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1213/2397] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:41:48.265001 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d4694-523d-45d2-baf2-d4f7bd066bf2 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:48.284524 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d4694-523d-45d2-baf2-d4f7bd066bf2 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:48.309430 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139c39a-ee44-4d37-b3e9-bc562882dd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:48.311132 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139c39a-ee44-4d37-b3e9-bc562882dd81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:48.312174 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139c39a-ee44-4d37-b3e9-bc562882dd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:48.313035 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139c39a-ee44-4d37-b3e9-bc562882dd81 admin admin] PATH_INFO: `/v3/projects/5db9a44e5e0941c091231fcf8db28f84/users/d0df69f0d9a04b9c8fe3bd7309480d37/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:48.346353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6139c39a-ee44-4d37-b3e9-bc562882dd81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db9a44e5e0941c091231fcf8db28f84, user_id=d0df69f0d9a04b9c8fe3bd7309480d37, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:48.351564 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6139c39a-ee44-4d37-b3e9-bc562882dd81 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:48.399469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1185/2398] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:41:48 2022] PUT /identity/v3/projects/5db9a44e5e0941c091231fcf8db28f84/users/d0df69f0d9a04b9c8fe3bd7309480d37/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:41:48.427009 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3b15c-0e34-4483-8c6b-6b135faa8ba5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:48.428019 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3b15c-0e34-4483-8c6b-6b135faa8ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:48.429029 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3b15c-0e34-4483-8c6b-6b135faa8ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:48.492110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4ec3b15c-0e34-4483-8c6b-6b135faa8ba5 None None] MFA Rules not processed for user `d0df69f0d9a04b9c8fe3bd7309480d37`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:48.495015 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4ec3b15c-0e34-4483-8c6b-6b135faa8ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:48.727762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1214/2399] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:41:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:48.732455 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139c39a-ee44-4d37-b3e9-bc562882dd81 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:48.928293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139c39a-ee44-4d37-b3e9-bc562882dd81 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:48.937927 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ccaaa-28c3-41eb-9aaf-81758e36c9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:48.939394 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ccaaa-28c3-41eb-9aaf-81758e36c9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:48.940017 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ccaaa-28c3-41eb-9aaf-81758e36c9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:48.940644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ccaaa-28c3-41eb-9aaf-81758e36c9c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:48.942284 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ccaaa-28c3-41eb-9aaf-81758e36c9c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:48.946337 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ccaaa-28c3-41eb-9aaf-81758e36c9c9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:48.989305 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:49.042979 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3b15c-0e34-4483-8c6b-6b135faa8ba5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:49.057888 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1186/2400] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:41:48 2022] POST /identity/v3/projects => generated 373 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:41:49.067338 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3b15c-0e34-4483-8c6b-6b135faa8ba5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:49.155081 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eedb18-3221-4309-bae4-8b9f52119197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:49.156071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eedb18-3221-4309-bae4-8b9f52119197 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:49.156071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eedb18-3221-4309-bae4-8b9f52119197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:49.156355 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eedb18-3221-4309-bae4-8b9f52119197 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:49.157097 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eedb18-3221-4309-bae4-8b9f52119197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:49.159009 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eedb18-3221-4309-bae4-8b9f52119197 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:49.199402 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1215/2401] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:41:49 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:41:49.204110 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ccaaa-28c3-41eb-9aaf-81758e36c9c9 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:49.217665 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ccaaa-28c3-41eb-9aaf-81758e36c9c9 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:49.224964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165e59b-1c1f-49f0-adfb-14b9ccf5f6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:49.226155 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165e59b-1c1f-49f0-adfb-14b9ccf5f6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:49.227220 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165e59b-1c1f-49f0-adfb-14b9ccf5f6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:49.227772 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165e59b-1c1f-49f0-adfb-14b9ccf5f6e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:49.228716 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7165e59b-1c1f-49f0-adfb-14b9ccf5f6e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:49.230829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7165e59b-1c1f-49f0-adfb-14b9ccf5f6e2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:49.246985 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1187/2402] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:41:49.251913 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eedb18-3221-4309-bae4-8b9f52119197 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:49.272856 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eedb18-3221-4309-bae4-8b9f52119197 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:49.289230 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f443c1a-859b-4029-b6c5-caf636fb4908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:49.290771 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f443c1a-859b-4029-b6c5-caf636fb4908 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:49.291320 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f443c1a-859b-4029-b6c5-caf636fb4908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:49.291791 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f443c1a-859b-4029-b6c5-caf636fb4908 admin admin] PATH_INFO: `/v3/projects/4af9e5c1ed914b7491838e83c2c50a19/users/b322fe59bfae47939774fd91e2700f53/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:49.330878 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f443c1a-859b-4029-b6c5-caf636fb4908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4af9e5c1ed914b7491838e83c2c50a19, user_id=b322fe59bfae47939774fd91e2700f53, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:49.336101 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f443c1a-859b-4029-b6c5-caf636fb4908 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:49.345129 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:49.373372 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1216/2403] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:41:49 2022] PUT /identity/v3/projects/4af9e5c1ed914b7491838e83c2c50a19/users/b322fe59bfae47939774fd91e2700f53/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:41:49.374943 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165e59b-1c1f-49f0-adfb-14b9ccf5f6e2 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:49.390472 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165e59b-1c1f-49f0-adfb-14b9ccf5f6e2 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:49.546539 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85a23c-7637-41cb-ba10-bd8ec4d356e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:49.547675 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85a23c-7637-41cb-ba10-bd8ec4d356e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:49.548143 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85a23c-7637-41cb-ba10-bd8ec4d356e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:49.548579 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85a23c-7637-41cb-ba10-bd8ec4d356e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:49.549485 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85a23c-7637-41cb-ba10-bd8ec4d356e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:49.551710 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85a23c-7637-41cb-ba10-bd8ec4d356e4 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:49.568429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1188/2404] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:41:49.570979 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f443c1a-859b-4029-b6c5-caf636fb4908 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:49.591898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f443c1a-859b-4029-b6c5-caf636fb4908 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:49.610760 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944d59b-d559-45ea-94cf-089fa08fa9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:49.611825 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944d59b-d559-45ea-94cf-089fa08fa9d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:49.612272 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944d59b-d559-45ea-94cf-089fa08fa9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:49.612786 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944d59b-d559-45ea-94cf-089fa08fa9d0 admin admin] PATH_INFO: `/v3/projects/4af9e5c1ed914b7491838e83c2c50a19/users/b322fe59bfae47939774fd91e2700f53/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:49.620417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944d59b-d559-45ea-94cf-089fa08fa9d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4af9e5c1ed914b7491838e83c2c50a19, user_id=b322fe59bfae47939774fd91e2700f53, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:49.623424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944d59b-d559-45ea-94cf-089fa08fa9d0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:49.648145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1217/2405] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:41:49 2022] PUT /identity/v3/projects/4af9e5c1ed914b7491838e83c2c50a19/users/b322fe59bfae47939774fd91e2700f53/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:41:49.660707 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4759b76-266b-40b8-a81d-fff1445f3ef8 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:49.661076 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4759b76-266b-40b8-a81d-fff1445f3ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:49.661547 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4759b76-266b-40b8-a81d-fff1445f3ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:49.733252 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a4759b76-266b-40b8-a81d-fff1445f3ef8 None None] MFA Rules not processed for user `b322fe59bfae47939774fd91e2700f53`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:49.735429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a4759b76-266b-40b8-a81d-fff1445f3ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:49.993603 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1189/2406] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:41:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:50.019271 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944d59b-d559-45ea-94cf-089fa08fa9d0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:50.021356 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3944d59b-d559-45ea-94cf-089fa08fa9d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:50.322828 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944d59b-d559-45ea-94cf-089fa08fa9d0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:50.333147 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b240fc-9dd8-4739-8300-e8ef0784acfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:50.333782 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b240fc-9dd8-4739-8300-e8ef0784acfd service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:50.334058 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b240fc-9dd8-4739-8300-e8ef0784acfd service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:50.334330 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b240fc-9dd8-4739-8300-e8ef0784acfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:50.376969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b240fc-9dd8-4739-8300-e8ef0784acfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:50.380100 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b240fc-9dd8-4739-8300-e8ef0784acfd service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:50.459087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1218/2407] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:50.647198 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4759b76-266b-40b8-a81d-fff1445f3ef8 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:50.667047 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4759b76-266b-40b8-a81d-fff1445f3ef8 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:50.677148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be472af-5b72-42f5-8828-c8d3684310be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:50.677970 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be472af-5b72-42f5-8828-c8d3684310be service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:50.678361 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be472af-5b72-42f5-8828-c8d3684310be service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:50.682722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be472af-5b72-42f5-8828-c8d3684310be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:50.904509 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be472af-5b72-42f5-8828-c8d3684310be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:50.910185 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be472af-5b72-42f5-8828-c8d3684310be service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:50.926879 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:50.946705 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1190/2408] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:00.096934 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b240fc-9dd8-4739-8300-e8ef0784acfd service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:00.098537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-30b240fc-9dd8-4739-8300-e8ef0784acfd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:00.284412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b240fc-9dd8-4739-8300-e8ef0784acfd service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:00.294814 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5ff88-b4a8-45cd-8abf-1a15b5ca143e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:00.296049 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5ff88-b4a8-45cd-8abf-1a15b5ca143e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:00.296638 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5ff88-b4a8-45cd-8abf-1a15b5ca143e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:00.297234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5ff88-b4a8-45cd-8abf-1a15b5ca143e admin admin] PATH_INFO: `/v3/users/ee45337067ff4ad986d1ab6ee65663b8` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:00.300237 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5ff88-b4a8-45cd-8abf-1a15b5ca143e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee45337067ff4ad986d1ab6ee65663b8)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:00.302786 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5ff88-b4a8-45cd-8abf-1a15b5ca143e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:00.463417 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-09d5ff88-b4a8-45cd-8abf-1a15b5ca143e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee45337067ff4ad986d1ab6ee65663b8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:00.488225 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-09d5ff88-b4a8-45cd-8abf-1a15b5ca143e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee45337067ff4ad986d1ab6ee65663b8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:00.489637 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-09d5ff88-b4a8-45cd-8abf-1a15b5ca143e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee45337067ff4ad986d1ab6ee65663b8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:00.494104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:00.503371 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-09d5ff88-b4a8-45cd-8abf-1a15b5ca143e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee45337067ff4ad986d1ab6ee65663b8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:00.518415 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-09d5ff88-b4a8-45cd-8abf-1a15b5ca143e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee45337067ff4ad986d1ab6ee65663b8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:00.534647 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1219/2409] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:00 2022] DELETE /identity/v3/users/ee45337067ff4ad986d1ab6ee65663b8 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:00.940018 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:01.061479 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be472af-5b72-42f5-8828-c8d3684310be service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:01.081065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be472af-5b72-42f5-8828-c8d3684310be service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:01.168011 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4972128-d90c-4e49-adea-eecfed12dae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:01.168573 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4972128-d90c-4e49-adea-eecfed12dae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:01.168914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4972128-d90c-4e49-adea-eecfed12dae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:01.169208 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4972128-d90c-4e49-adea-eecfed12dae7 admin admin] PATH_INFO: `/v3/projects/05bcd9bddd5c4b7188a1cecac423a214` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:01.170509 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4972128-d90c-4e49-adea-eecfed12dae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05bcd9bddd5c4b7188a1cecac423a214)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:01.172555 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4972128-d90c-4e49-adea-eecfed12dae7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:01.228689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f4972128-d90c-4e49-adea-eecfed12dae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05bcd9bddd5c4b7188a1cecac423a214', 'request_id': 'req-f4972128-d90c-4e49-adea-eecfed12dae7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:01.236048 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f4972128-d90c-4e49-adea-eecfed12dae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05bcd9bddd5c4b7188a1cecac423a214', 'request_id': 'req-f4972128-d90c-4e49-adea-eecfed12dae7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:01.243539 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f4972128-d90c-4e49-adea-eecfed12dae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05bcd9bddd5c4b7188a1cecac423a214', 'request_id': 'req-f4972128-d90c-4e49-adea-eecfed12dae7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:01.259243 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f4972128-d90c-4e49-adea-eecfed12dae7 admin admin] The token cache is being invalidate because project 05bcd9bddd5c4b7188a1cecac423a214 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:01.259532 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f4972128-d90c-4e49-adea-eecfed12dae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:01.260236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f4972128-d90c-4e49-adea-eecfed12dae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:01.261814 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1191/2410] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:01 2022] DELETE /identity/v3/projects/05bcd9bddd5c4b7188a1cecac423a214 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:01.266433 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5ff88-b4a8-45cd-8abf-1a15b5ca143e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:01.269269 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-09d5ff88-b4a8-45cd-8abf-1a15b5ca143e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:01.284806 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5ff88-b4a8-45cd-8abf-1a15b5ca143e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:01.371786 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac4606-c4aa-45ee-882e-fd241a734ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:01.372867 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac4606-c4aa-45ee-882e-fd241a734ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:01.373345 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac4606-c4aa-45ee-882e-fd241a734ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:01.373775 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac4606-c4aa-45ee-882e-fd241a734ab4 admin admin] PATH_INFO: `/v3/users/1c0f2f9ac4df4773886b151d3e380f5e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:01.376250 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac4606-c4aa-45ee-882e-fd241a734ab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c0f2f9ac4df4773886b151d3e380f5e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:01.379953 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac4606-c4aa-45ee-882e-fd241a734ab4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:01.464820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3dac4606-c4aa-45ee-882e-fd241a734ab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c0f2f9ac4df4773886b151d3e380f5e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:01.493221 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3dac4606-c4aa-45ee-882e-fd241a734ab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c0f2f9ac4df4773886b151d3e380f5e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:01.513011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3dac4606-c4aa-45ee-882e-fd241a734ab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c0f2f9ac4df4773886b151d3e380f5e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:01.533269 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3dac4606-c4aa-45ee-882e-fd241a734ab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c0f2f9ac4df4773886b151d3e380f5e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:01.552449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3dac4606-c4aa-45ee-882e-fd241a734ab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c0f2f9ac4df4773886b151d3e380f5e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:01.564464 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1220/2411] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:01 2022] DELETE /identity/v3/users/1c0f2f9ac4df4773886b151d3e380f5e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:02.214432 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4972128-d90c-4e49-adea-eecfed12dae7 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:02.216369 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f4972128-d90c-4e49-adea-eecfed12dae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:02.243322 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4972128-d90c-4e49-adea-eecfed12dae7 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:02.419152 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb17fe-7306-4248-8de1-155be4a87e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:02.420373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb17fe-7306-4248-8de1-155be4a87e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:02.420833 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb17fe-7306-4248-8de1-155be4a87e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:02.421240 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb17fe-7306-4248-8de1-155be4a87e2c admin admin] PATH_INFO: `/v3/projects/b5c45a78312e4e1ebdfc5f91afb4eb6c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:02.422926 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb17fe-7306-4248-8de1-155be4a87e2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5c45a78312e4e1ebdfc5f91afb4eb6c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:02.425384 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb17fe-7306-4248-8de1-155be4a87e2c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:02.487822 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:02.516297 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-25eb17fe-7306-4248-8de1-155be4a87e2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5c45a78312e4e1ebdfc5f91afb4eb6c', 'request_id': 'req-25eb17fe-7306-4248-8de1-155be4a87e2c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:02.531063 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-25eb17fe-7306-4248-8de1-155be4a87e2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5c45a78312e4e1ebdfc5f91afb4eb6c', 'request_id': 'req-25eb17fe-7306-4248-8de1-155be4a87e2c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:02.539651 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-25eb17fe-7306-4248-8de1-155be4a87e2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5c45a78312e4e1ebdfc5f91afb4eb6c', 'request_id': 'req-25eb17fe-7306-4248-8de1-155be4a87e2c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:02.561478 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-25eb17fe-7306-4248-8de1-155be4a87e2c admin admin] The token cache is being invalidate because project b5c45a78312e4e1ebdfc5f91afb4eb6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:02.561899 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-25eb17fe-7306-4248-8de1-155be4a87e2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:02.562547 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-25eb17fe-7306-4248-8de1-155be4a87e2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:02.564335 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1192/2412] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:02 2022] DELETE /identity/v3/projects/b5c45a78312e4e1ebdfc5f91afb4eb6c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:03.177498 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac4606-c4aa-45ee-882e-fd241a734ab4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:03.179912 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3dac4606-c4aa-45ee-882e-fd241a734ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:03.289723 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac4606-c4aa-45ee-882e-fd241a734ab4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:03.324070 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:03.384582 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795fabe-89a8-4973-af7c-31a6bee64494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:03.385649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795fabe-89a8-4973-af7c-31a6bee64494 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:03.386125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795fabe-89a8-4973-af7c-31a6bee64494 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:03.386699 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795fabe-89a8-4973-af7c-31a6bee64494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:03.389297 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1795fabe-89a8-4973-af7c-31a6bee64494 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:03.505132 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795fabe-89a8-4973-af7c-31a6bee64494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:03.506732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795fabe-89a8-4973-af7c-31a6bee64494 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:03.519743 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1221/2413] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:09.085844 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb17fe-7306-4248-8de1-155be4a87e2c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:09.088943 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-25eb17fe-7306-4248-8de1-155be4a87e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:09.104612 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb17fe-7306-4248-8de1-155be4a87e2c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:09.111610 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f619e-f006-4663-af3f-285435b80b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:09.112268 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f619e-f006-4663-af3f-285435b80b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:09.113033 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f619e-f006-4663-af3f-285435b80b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:09.113483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f619e-f006-4663-af3f-285435b80b83 admin admin] PATH_INFO: `/v3/users/ed5158b5364c4e10a2128e3d098048ca` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:09.116679 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f619e-f006-4663-af3f-285435b80b83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed5158b5364c4e10a2128e3d098048ca)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:09.120071 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f619e-f006-4663-af3f-285435b80b83 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:09.233619 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d54f619e-f006-4663-af3f-285435b80b83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed5158b5364c4e10a2128e3d098048ca'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:09.262769 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d54f619e-f006-4663-af3f-285435b80b83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed5158b5364c4e10a2128e3d098048ca'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:09.263757 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d54f619e-f006-4663-af3f-285435b80b83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed5158b5364c4e10a2128e3d098048ca'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:09.264744 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d54f619e-f006-4663-af3f-285435b80b83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed5158b5364c4e10a2128e3d098048ca'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:09.280655 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d54f619e-f006-4663-af3f-285435b80b83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed5158b5364c4e10a2128e3d098048ca'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:09.309197 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1193/2414] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:09 2022] DELETE /identity/v3/users/ed5158b5364c4e10a2128e3d098048ca => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:09.617892 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795fabe-89a8-4973-af7c-31a6bee64494 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:09.630183 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795fabe-89a8-4973-af7c-31a6bee64494 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:09.751981 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e70858-cee8-4781-8cae-2d7ce69bc0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:09.753104 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e70858-cee8-4781-8cae-2d7ce69bc0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:09.753605 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e70858-cee8-4781-8cae-2d7ce69bc0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:09.754333 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e70858-cee8-4781-8cae-2d7ce69bc0e8 admin admin] PATH_INFO: `/v3/projects/1f3a5aa7aaa04fb7991a5d7904cba03f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:09.757294 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e70858-cee8-4781-8cae-2d7ce69bc0e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f3a5aa7aaa04fb7991a5d7904cba03f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:09.759752 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e70858-cee8-4781-8cae-2d7ce69bc0e8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:09.913128 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-46e70858-cee8-4781-8cae-2d7ce69bc0e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f3a5aa7aaa04fb7991a5d7904cba03f', 'request_id': 'req-46e70858-cee8-4781-8cae-2d7ce69bc0e8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:09.941550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-46e70858-cee8-4781-8cae-2d7ce69bc0e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f3a5aa7aaa04fb7991a5d7904cba03f', 'request_id': 'req-46e70858-cee8-4781-8cae-2d7ce69bc0e8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:09.964480 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-46e70858-cee8-4781-8cae-2d7ce69bc0e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f3a5aa7aaa04fb7991a5d7904cba03f', 'request_id': 'req-46e70858-cee8-4781-8cae-2d7ce69bc0e8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:09.982245 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:09.990416 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-46e70858-cee8-4781-8cae-2d7ce69bc0e8 admin admin] The token cache is being invalidate because project 1f3a5aa7aaa04fb7991a5d7904cba03f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:09.991426 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-46e70858-cee8-4781-8cae-2d7ce69bc0e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:09.993530 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-46e70858-cee8-4781-8cae-2d7ce69bc0e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:09.997440 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1222/2415] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:09 2022] DELETE /identity/v3/projects/1f3a5aa7aaa04fb7991a5d7904cba03f => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:10.005812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12629f9c-cab8-48c5-9520-90c340b03f82 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:10.006779 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12629f9c-cab8-48c5-9520-90c340b03f82 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:10.007510 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12629f9c-cab8-48c5-9520-90c340b03f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:10.053251 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-12629f9c-cab8-48c5-9520-90c340b03f82 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:10.056028 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-12629f9c-cab8-48c5-9520-90c340b03f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:10.145696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1194/2416] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:10.153678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77933e4c-84a9-411d-8919-11d5db697c47 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:10.153988 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77933e4c-84a9-411d-8919-11d5db697c47 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:10.154521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77933e4c-84a9-411d-8919-11d5db697c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:10.193275 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-77933e4c-84a9-411d-8919-11d5db697c47 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:10.194745 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-77933e4c-84a9-411d-8919-11d5db697c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:10.204070 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1223/2417] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:10.210041 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12629f9c-cab8-48c5-9520-90c340b03f82 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:10.222227 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12629f9c-cab8-48c5-9520-90c340b03f82 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:10.230694 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692f70b-4bc8-450f-aa90-37ab30210a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:10.231762 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692f70b-4bc8-450f-aa90-37ab30210a4e admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:10.232348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692f70b-4bc8-450f-aa90-37ab30210a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:10.233003 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692f70b-4bc8-450f-aa90-37ab30210a4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:10.234072 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692f70b-4bc8-450f-aa90-37ab30210a4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:42:10.234670 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692f70b-4bc8-450f-aa90-37ab30210a4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:10.236745 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692f70b-4bc8-450f-aa90-37ab30210a4e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:10.252369 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1195/2418] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:42:10.260133 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77933e4c-84a9-411d-8919-11d5db697c47 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:10.270632 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77933e4c-84a9-411d-8919-11d5db697c47 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:10.276952 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0691bc-fc52-497c-a97c-fdff8a98be0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:10.277582 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0691bc-fc52-497c-a97c-fdff8a98be0b admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:10.277858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0691bc-fc52-497c-a97c-fdff8a98be0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:10.278162 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0691bc-fc52-497c-a97c-fdff8a98be0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:10.278781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0691bc-fc52-497c-a97c-fdff8a98be0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:10.280968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0691bc-fc52-497c-a97c-fdff8a98be0b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:10.318182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1224/2419] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:10 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:10.324248 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692f70b-4bc8-450f-aa90-37ab30210a4e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:10.349137 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692f70b-4bc8-450f-aa90-37ab30210a4e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:10.386501 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:10.493070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdea839-ad25-452f-a189-5f6b82bfa621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:10.493711 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdea839-ad25-452f-a189-5f6b82bfa621 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:10.493991 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdea839-ad25-452f-a189-5f6b82bfa621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:10.494267 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdea839-ad25-452f-a189-5f6b82bfa621 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:10.494945 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdea839-ad25-452f-a189-5f6b82bfa621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:10.497195 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdea839-ad25-452f-a189-5f6b82bfa621 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:10.526153 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1196/2420] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:10 2022] POST /identity/v3/users => generated 283 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:42:10.530384 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0691bc-fc52-497c-a97c-fdff8a98be0b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:10.544142 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0691bc-fc52-497c-a97c-fdff8a98be0b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:10.550082 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489aef1-5a13-414e-9c48-ca4be0c7d5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:10.550716 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489aef1-5a13-414e-9c48-ca4be0c7d5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:10.550995 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489aef1-5a13-414e-9c48-ca4be0c7d5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:10.551299 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489aef1-5a13-414e-9c48-ca4be0c7d5f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:10.551965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c489aef1-5a13-414e-9c48-ca4be0c7d5f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:10.553768 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c489aef1-5a13-414e-9c48-ca4be0c7d5f5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:10.565276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1225/2421] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:42:10.569675 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdea839-ad25-452f-a189-5f6b82bfa621 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:10.580924 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdea839-ad25-452f-a189-5f6b82bfa621 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:10.587756 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191adac-f325-411b-ae70-8359db63c25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:10.588405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191adac-f325-411b-ae70-8359db63c25b admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:10.588737 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191adac-f325-411b-ae70-8359db63c25b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:10.589030 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191adac-f325-411b-ae70-8359db63c25b admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:10.589677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191adac-f325-411b-ae70-8359db63c25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:10.591340 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191adac-f325-411b-ae70-8359db63c25b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:10.625364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1197/2422] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:42:10.627020 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489aef1-5a13-414e-9c48-ca4be0c7d5f5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:10.648515 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489aef1-5a13-414e-9c48-ca4be0c7d5f5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:10.666407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dac522-e790-4d31-b558-6efda91847d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:10.666407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dac522-e790-4d31-b558-6efda91847d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:10.666407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dac522-e790-4d31-b558-6efda91847d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:10.666407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dac522-e790-4d31-b558-6efda91847d3 admin admin] PATH_INFO: `/v3/projects/4bf7a0469af34ff491c912397e8aa628/users/d1fc01bb788046e0aaee7a24e34fbc43/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:10.702673 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dac522-e790-4d31-b558-6efda91847d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf7a0469af34ff491c912397e8aa628, user_id=d1fc01bb788046e0aaee7a24e34fbc43, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:10.702673 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dac522-e790-4d31-b558-6efda91847d3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:10.720892 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1226/2423] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:10 2022] PUT /identity/v3/projects/4bf7a0469af34ff491c912397e8aa628/users/d1fc01bb788046e0aaee7a24e34fbc43/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:10.734062 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40b6da-2f72-4260-a508-60ff5bda4a9f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:10.734688 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40b6da-2f72-4260-a508-60ff5bda4a9f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:10.735402 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40b6da-2f72-4260-a508-60ff5bda4a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:10.798469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-cb40b6da-2f72-4260-a508-60ff5bda4a9f None None] MFA Rules not processed for user `d1fc01bb788046e0aaee7a24e34fbc43`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:10.800958 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cb40b6da-2f72-4260-a508-60ff5bda4a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:10.952044 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1198/2424] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:10.987027 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dac522-e790-4d31-b558-6efda91847d3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:10.989114 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c8dac522-e790-4d31-b558-6efda91847d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:11.221936 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dac522-e790-4d31-b558-6efda91847d3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:11.231497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c1674-9a81-454d-9485-e08c1133c6b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:11.232918 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c1674-9a81-454d-9485-e08c1133c6b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:11.233527 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c1674-9a81-454d-9485-e08c1133c6b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:11.234121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c1674-9a81-454d-9485-e08c1133c6b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:11.254114 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c1674-9a81-454d-9485-e08c1133c6b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:11.258265 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c1674-9a81-454d-9485-e08c1133c6b8 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:11.290272 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1227/2425] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:11.915177 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2642e9-6606-47dd-8e43-ec92ce5392bc None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:11.916828 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2642e9-6606-47dd-8e43-ec92ce5392bc None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:11.916828 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2642e9-6606-47dd-8e43-ec92ce5392bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:11.938172 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ac2642e9-6606-47dd-8e43-ec92ce5392bc None None] MFA Rules not processed for user `3c001a902faf4b3c8d8f23f2e017c706`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:11.940226 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ac2642e9-6606-47dd-8e43-ec92ce5392bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:12.012248 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1199/2426] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 1 16:42:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:12.027871 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c1674-9a81-454d-9485-e08c1133c6b8 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:12.029568 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8c1c1674-9a81-454d-9485-e08c1133c6b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:12.131378 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c1674-9a81-454d-9485-e08c1133c6b8 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:12.138020 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67e61e-39f6-4b71-93e5-8163cfc1bc89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748e35d9a1534920860b2234d45f6724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:12.139173 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67e61e-39f6-4b71-93e5-8163cfc1bc89 service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:12.139376 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67e61e-39f6-4b71-93e5-8163cfc1bc89 service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:12.139770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67e61e-39f6-4b71-93e5-8163cfc1bc89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:12.153899 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67e61e-39f6-4b71-93e5-8163cfc1bc89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:12.158767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67e61e-39f6-4b71-93e5-8163cfc1bc89 service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:12.175982 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1228/2427] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 1 16:42:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:19.528640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2642e9-6606-47dd-8e43-ec92ce5392bc None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:19.531428 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ac2642e9-6606-47dd-8e43-ec92ce5392bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:19.638245 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:19.711970 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2642e9-6606-47dd-8e43-ec92ce5392bc None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:19.718545 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee67964-58f9-4fed-8848-c00d193c3905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:19.719745 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee67964-58f9-4fed-8848-c00d193c3905 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:19.720127 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee67964-58f9-4fed-8848-c00d193c3905 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:19.720748 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee67964-58f9-4fed-8848-c00d193c3905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:19.724701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0ee67964-58f9-4fed-8848-c00d193c3905 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:19.846564 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee67964-58f9-4fed-8848-c00d193c3905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:19.848710 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee67964-58f9-4fed-8848-c00d193c3905 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:19.862175 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1200/2428] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:22.167579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=85,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:22.908247 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67e61e-39f6-4b71-93e5-8163cfc1bc89 service swift] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:22.922234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67e61e-39f6-4b71-93e5-8163cfc1bc89 service swift] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:22.928544 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2f294-e83c-4827-ba60-06cb442c58bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:22.929829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2f294-e83c-4827-ba60-06cb442c58bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:22.930284 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2f294-e83c-4827-ba60-06cb442c58bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:22.930913 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2f294-e83c-4827-ba60-06cb442c58bf admin admin] PATH_INFO: `/v3/users/d1fc01bb788046e0aaee7a24e34fbc43` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:22.932876 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2f294-e83c-4827-ba60-06cb442c58bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1fc01bb788046e0aaee7a24e34fbc43)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:22.935970 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2f294-e83c-4827-ba60-06cb442c58bf admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:23.029867 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ffc2f294-e83c-4827-ba60-06cb442c58bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1fc01bb788046e0aaee7a24e34fbc43'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:23.054135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ffc2f294-e83c-4827-ba60-06cb442c58bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1fc01bb788046e0aaee7a24e34fbc43'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:23.055745 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ffc2f294-e83c-4827-ba60-06cb442c58bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1fc01bb788046e0aaee7a24e34fbc43'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:23.067132 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ffc2f294-e83c-4827-ba60-06cb442c58bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1fc01bb788046e0aaee7a24e34fbc43'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:23.087676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ffc2f294-e83c-4827-ba60-06cb442c58bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1fc01bb788046e0aaee7a24e34fbc43'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:23.097414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1229/2429] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:22 2022] DELETE /identity/v3/users/d1fc01bb788046e0aaee7a24e34fbc43 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:23.104486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9135fe-2aeb-4df3-937c-ebaa0e8654e5 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:23.106060 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9135fe-2aeb-4df3-937c-ebaa0e8654e5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:23.106635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9135fe-2aeb-4df3-937c-ebaa0e8654e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:23.148781 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2b9135fe-2aeb-4df3-937c-ebaa0e8654e5 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:23.151275 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2b9135fe-2aeb-4df3-937c-ebaa0e8654e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:23.290001 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1201/2430] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:23.305700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2f294-e83c-4827-ba60-06cb442c58bf admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:23.307262 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ffc2f294-e83c-4827-ba60-06cb442c58bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:23.459842 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2f294-e83c-4827-ba60-06cb442c58bf admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:23.464276 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77137e7-7244-4f78-89bc-c09189c00718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:23.464949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77137e7-7244-4f78-89bc-c09189c00718 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:23.465227 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77137e7-7244-4f78-89bc-c09189c00718 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:23.465490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77137e7-7244-4f78-89bc-c09189c00718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:23.476413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77137e7-7244-4f78-89bc-c09189c00718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:23.478497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77137e7-7244-4f78-89bc-c09189c00718 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:23.489068 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1230/2431] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:42:24.169913 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9135fe-2aeb-4df3-937c-ebaa0e8654e5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:24.172773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2b9135fe-2aeb-4df3-937c-ebaa0e8654e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:24.223100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9135fe-2aeb-4df3-937c-ebaa0e8654e5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:24.232466 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8ede3-5c20-46a0-9410-bfefc8e76c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:24.233644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8ede3-5c20-46a0-9410-bfefc8e76c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:24.234128 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8ede3-5c20-46a0-9410-bfefc8e76c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:24.234613 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8ede3-5c20-46a0-9410-bfefc8e76c32 admin admin] PATH_INFO: `/v3/projects/4bf7a0469af34ff491c912397e8aa628` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:24.237797 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8ede3-5c20-46a0-9410-bfefc8e76c32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bf7a0469af34ff491c912397e8aa628)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:24.242495 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8ede3-5c20-46a0-9410-bfefc8e76c32 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:24.375792 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2eb8ede3-5c20-46a0-9410-bfefc8e76c32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bf7a0469af34ff491c912397e8aa628', 'request_id': 'req-2eb8ede3-5c20-46a0-9410-bfefc8e76c32'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:24.388867 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2eb8ede3-5c20-46a0-9410-bfefc8e76c32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bf7a0469af34ff491c912397e8aa628', 'request_id': 'req-2eb8ede3-5c20-46a0-9410-bfefc8e76c32'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:24.408270 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2eb8ede3-5c20-46a0-9410-bfefc8e76c32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bf7a0469af34ff491c912397e8aa628', 'request_id': 'req-2eb8ede3-5c20-46a0-9410-bfefc8e76c32'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:24.439006 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2eb8ede3-5c20-46a0-9410-bfefc8e76c32 admin admin] The token cache is being invalidate because project 4bf7a0469af34ff491c912397e8aa628 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:24.439376 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2eb8ede3-5c20-46a0-9410-bfefc8e76c32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:24.440086 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2eb8ede3-5c20-46a0-9410-bfefc8e76c32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:24.442047 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1202/2432] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:24 2022] DELETE /identity/v3/projects/4bf7a0469af34ff491c912397e8aa628 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:24.451311 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9cd967-5fb3-41b2-abbb-2a0fd8aefc70 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:24.452114 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9cd967-5fb3-41b2-abbb-2a0fd8aefc70 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:24.452114 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9cd967-5fb3-41b2-abbb-2a0fd8aefc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:24.520321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-cd9cd967-5fb3-41b2-abbb-2a0fd8aefc70 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:24.522150 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cd9cd967-5fb3-41b2-abbb-2a0fd8aefc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:24.734829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1231/2433] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:24.761000 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc281bd-f6c8-44f1-828b-f62196710034 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:24.761643 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc281bd-f6c8-44f1-828b-f62196710034 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:24.762240 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc281bd-f6c8-44f1-828b-f62196710034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:24.817470 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:24.833408 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4cc281bd-f6c8-44f1-828b-f62196710034 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:24.838633 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4cc281bd-f6c8-44f1-828b-f62196710034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:24.889037 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1203/2434] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:24.895944 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9cd967-5fb3-41b2-abbb-2a0fd8aefc70 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:24.939807 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9cd967-5fb3-41b2-abbb-2a0fd8aefc70 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:24.952222 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460781b-e175-48ab-81a1-f0f75cd7a499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:24.953871 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460781b-e175-48ab-81a1-f0f75cd7a499 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:24.954659 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460781b-e175-48ab-81a1-f0f75cd7a499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:24.955404 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460781b-e175-48ab-81a1-f0f75cd7a499 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:24.956960 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460781b-e175-48ab-81a1-f0f75cd7a499 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:42:24.957762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460781b-e175-48ab-81a1-f0f75cd7a499 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:24.962248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460781b-e175-48ab-81a1-f0f75cd7a499 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:25.007949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc281bd-f6c8-44f1-828b-f62196710034 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:25.008465 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1232/2435] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:42:25.019149 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc281bd-f6c8-44f1-828b-f62196710034 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:25.026764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae0d57-09cb-4801-9f33-6e936e6e86f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:25.027397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae0d57-09cb-4801-9f33-6e936e6e86f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:25.027673 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae0d57-09cb-4801-9f33-6e936e6e86f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:25.027942 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae0d57-09cb-4801-9f33-6e936e6e86f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:25.028758 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae0d57-09cb-4801-9f33-6e936e6e86f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:25.031069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae0d57-09cb-4801-9f33-6e936e6e86f3 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:25.093413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1204/2436] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:25 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:25.100854 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460781b-e175-48ab-81a1-f0f75cd7a499 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:25.130980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:25.137895 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460781b-e175-48ab-81a1-f0f75cd7a499 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:25.283227 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ea79d-ed5b-4c6c-a162-bcf085398131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:25.286074 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ea79d-ed5b-4c6c-a162-bcf085398131 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:25.286802 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ea79d-ed5b-4c6c-a162-bcf085398131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:25.287393 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ea79d-ed5b-4c6c-a162-bcf085398131 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:25.289942 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ea79d-ed5b-4c6c-a162-bcf085398131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:25.292243 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ea79d-ed5b-4c6c-a162-bcf085398131 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:25.328693 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1233/2437] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:25 2022] POST /identity/v3/users => generated 287 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:25.332097 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae0d57-09cb-4801-9f33-6e936e6e86f3 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:25.362877 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae0d57-09cb-4801-9f33-6e936e6e86f3 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:25.372126 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ea79d-ed5b-4c6c-a162-bcf085398131 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:25.374300 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cc3ea79d-ed5b-4c6c-a162-bcf085398131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:25.374785 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3af73-0a67-434a-ad4c-4c815e36f271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:25.375865 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3af73-0a67-434a-ad4c-4c815e36f271 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:25.376361 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3af73-0a67-434a-ad4c-4c815e36f271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:25.376920 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3af73-0a67-434a-ad4c-4c815e36f271 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:25.378316 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3af73-0a67-434a-ad4c-4c815e36f271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:25.382718 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3af73-0a67-434a-ad4c-4c815e36f271 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:25.394379 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ea79d-ed5b-4c6c-a162-bcf085398131 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:25.400476 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1205/2438] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:25.403750 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2a3f9-1885-4e06-9cb7-44f02d22431f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:25.405533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2a3f9-1885-4e06-9cb7-44f02d22431f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:25.405779 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3af73-0a67-434a-ad4c-4c815e36f271 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:25.406057 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2a3f9-1885-4e06-9cb7-44f02d22431f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:25.406579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2a3f9-1885-4e06-9cb7-44f02d22431f admin admin] PATH_INFO: `/v3/users/054b27e46b8648979d8777e90748722d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:25.411332 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2a3f9-1885-4e06-9cb7-44f02d22431f admin admin] RBAC: Authorizing `identity:delete_user(user_id=054b27e46b8648979d8777e90748722d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:25.415247 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2a3f9-1885-4e06-9cb7-44f02d22431f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:25.453590 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3af73-0a67-434a-ad4c-4c815e36f271 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:25.465314 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631316b-0785-49d8-bf9a-b2e873366e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:25.468242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631316b-0785-49d8-bf9a-b2e873366e91 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:25.468242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631316b-0785-49d8-bf9a-b2e873366e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:25.468242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631316b-0785-49d8-bf9a-b2e873366e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:25.468242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631316b-0785-49d8-bf9a-b2e873366e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:25.471238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631316b-0785-49d8-bf9a-b2e873366e91 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:25.507633 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1206/2439] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:25.527108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631316b-0785-49d8-bf9a-b2e873366e91 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:25.547123 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631316b-0785-49d8-bf9a-b2e873366e91 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:25.556881 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acff791-6b7f-4a61-aa94-ad08e8391264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:25.558471 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acff791-6b7f-4a61-aa94-ad08e8391264 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:25.559280 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acff791-6b7f-4a61-aa94-ad08e8391264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:25.561079 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acff791-6b7f-4a61-aa94-ad08e8391264 admin admin] PATH_INFO: `/v3/projects/3208683e338241c89c540cf26c5bfa06/users/29e939c705544ad8a04558eab63c3fd0/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:25.579370 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e7f2a3f9-1885-4e06-9cb7-44f02d22431f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '054b27e46b8648979d8777e90748722d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:25.590019 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acff791-6b7f-4a61-aa94-ad08e8391264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3208683e338241c89c540cf26c5bfa06, user_id=29e939c705544ad8a04558eab63c3fd0, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:25.595844 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acff791-6b7f-4a61-aa94-ad08e8391264 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:25.598493 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e7f2a3f9-1885-4e06-9cb7-44f02d22431f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '054b27e46b8648979d8777e90748722d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:25.599360 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e7f2a3f9-1885-4e06-9cb7-44f02d22431f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '054b27e46b8648979d8777e90748722d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:25.611129 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e7f2a3f9-1885-4e06-9cb7-44f02d22431f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '054b27e46b8648979d8777e90748722d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:25.623321 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1207/2440] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:25 2022] PUT /identity/v3/projects/3208683e338241c89c540cf26c5bfa06/users/29e939c705544ad8a04558eab63c3fd0/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:25.623642 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e7f2a3f9-1885-4e06-9cb7-44f02d22431f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '054b27e46b8648979d8777e90748722d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:25.642512 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1234/2441] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:25 2022] DELETE /identity/v3/users/054b27e46b8648979d8777e90748722d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:25.642795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5971472-8a18-4651-89b7-7db32c2811cf None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:25.643024 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5971472-8a18-4651-89b7-7db32c2811cf None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:25.643479 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5971472-8a18-4651-89b7-7db32c2811cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:25.691995 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b5971472-8a18-4651-89b7-7db32c2811cf None None] MFA Rules not processed for user `29e939c705544ad8a04558eab63c3fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:25.694136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b5971472-8a18-4651-89b7-7db32c2811cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:25.812311 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1208/2442] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:25.829535 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2a3f9-1885-4e06-9cb7-44f02d22431f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:25.831922 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e7f2a3f9-1885-4e06-9cb7-44f02d22431f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:25.976265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5971472-8a18-4651-89b7-7db32c2811cf None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:25.977925 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b5971472-8a18-4651-89b7-7db32c2811cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:25.981786 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:25.989399 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2a3f9-1885-4e06-9cb7-44f02d22431f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:26.010131 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1482d7-1e1d-48e7-8c5b-7e7907c7f026 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f389ab3ea046008b44f129113de995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:26.011231 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1482d7-1e1d-48e7-8c5b-7e7907c7f026 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:26.011696 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1482d7-1e1d-48e7-8c5b-7e7907c7f026 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:26.012132 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1482d7-1e1d-48e7-8c5b-7e7907c7f026 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:26.026263 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1482d7-1e1d-48e7-8c5b-7e7907c7f026 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:26.034746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1482d7-1e1d-48e7-8c5b-7e7907c7f026 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:26.066181 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1235/2443] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:42:26.250281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5971472-8a18-4651-89b7-7db32c2811cf None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:26.262966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f16d7-4739-4017-8d0a-eedef7ce9686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:26.264760 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f16d7-4739-4017-8d0a-eedef7ce9686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:26.265913 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f16d7-4739-4017-8d0a-eedef7ce9686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:26.266828 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f16d7-4739-4017-8d0a-eedef7ce9686 admin admin] PATH_INFO: `/v3/projects/0a2c9ab7783944ad9657663f22960220` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:26.274678 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f16d7-4739-4017-8d0a-eedef7ce9686 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a2c9ab7783944ad9657663f22960220)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:26.275979 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f16d7-4739-4017-8d0a-eedef7ce9686 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:26.354842 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:26.467525 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3d3f16d7-4739-4017-8d0a-eedef7ce9686 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a2c9ab7783944ad9657663f22960220', 'request_id': 'req-3d3f16d7-4739-4017-8d0a-eedef7ce9686'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:26.489814 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3d3f16d7-4739-4017-8d0a-eedef7ce9686 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a2c9ab7783944ad9657663f22960220', 'request_id': 'req-3d3f16d7-4739-4017-8d0a-eedef7ce9686'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:26.518239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3d3f16d7-4739-4017-8d0a-eedef7ce9686 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a2c9ab7783944ad9657663f22960220', 'request_id': 'req-3d3f16d7-4739-4017-8d0a-eedef7ce9686'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:26.538109 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1482d7-1e1d-48e7-8c5b-7e7907c7f026 service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:26.541277 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ba1482d7-1e1d-48e7-8c5b-7e7907c7f026 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:26.546348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3d3f16d7-4739-4017-8d0a-eedef7ce9686 admin admin] The token cache is being invalidate because project 0a2c9ab7783944ad9657663f22960220 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:26.546846 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3d3f16d7-4739-4017-8d0a-eedef7ce9686 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:26.548340 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3d3f16d7-4739-4017-8d0a-eedef7ce9686 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:26.551171 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1209/2444] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:25 2022] DELETE /identity/v3/projects/0a2c9ab7783944ad9657663f22960220 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:26.557966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cccc3-2461-46f9-957b-51e257fd2a42 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:26.558944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cccc3-2461-46f9-957b-51e257fd2a42 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:26.559838 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cccc3-2461-46f9-957b-51e257fd2a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:26.578245 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1482d7-1e1d-48e7-8c5b-7e7907c7f026 service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:26.612701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-be7cccc3-2461-46f9-957b-51e257fd2a42 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:26.615159 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-be7cccc3-2461-46f9-957b-51e257fd2a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:26.720044 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6838a20-ee0f-4578-bfff-fc2da74c7292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:26.723299 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6838a20-ee0f-4578-bfff-fc2da74c7292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:26.723964 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6838a20-ee0f-4578-bfff-fc2da74c7292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:26.725633 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6838a20-ee0f-4578-bfff-fc2da74c7292 admin admin] PATH_INFO: `/v3/users/29e939c705544ad8a04558eab63c3fd0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:26.730800 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6838a20-ee0f-4578-bfff-fc2da74c7292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29e939c705544ad8a04558eab63c3fd0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:26.736114 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6838a20-ee0f-4578-bfff-fc2da74c7292 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:26.754172 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1210/2445] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:26.764013 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07c9e0-22ba-450f-a0bd-649aeb26141a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:26.764764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07c9e0-22ba-450f-a0bd-649aeb26141a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:26.765294 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07c9e0-22ba-450f-a0bd-649aeb26141a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:26.812760 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ea07c9e0-22ba-450f-a0bd-649aeb26141a None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:26.814643 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ea07c9e0-22ba-450f-a0bd-649aeb26141a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:26.828759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1211/2446] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:26.829130 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e6838a20-ee0f-4578-bfff-fc2da74c7292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29e939c705544ad8a04558eab63c3fd0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:26.833785 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07c9e0-22ba-450f-a0bd-649aeb26141a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:26.849614 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07c9e0-22ba-450f-a0bd-649aeb26141a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:26.858032 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e2c02-91f0-4608-8c66-f29c05a26f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:26.859352 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e2c02-91f0-4608-8c66-f29c05a26f49 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:26.859801 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e2c02-91f0-4608-8c66-f29c05a26f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:26.860298 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e2c02-91f0-4608-8c66-f29c05a26f49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:26.860474 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e6838a20-ee0f-4578-bfff-fc2da74c7292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29e939c705544ad8a04558eab63c3fd0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:26.861622 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e2c02-91f0-4608-8c66-f29c05a26f49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:42:26.861915 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e6838a20-ee0f-4578-bfff-fc2da74c7292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29e939c705544ad8a04558eab63c3fd0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:26.862129 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e2c02-91f0-4608-8c66-f29c05a26f49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:26.865140 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e2c02-91f0-4608-8c66-f29c05a26f49 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:26.879646 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e6838a20-ee0f-4578-bfff-fc2da74c7292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29e939c705544ad8a04558eab63c3fd0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:26.887936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1212/2447] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:42:26.894471 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e2c02-91f0-4608-8c66-f29c05a26f49 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:26.896515 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c40e2c02-91f0-4608-8c66-f29c05a26f49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:26.906328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e6838a20-ee0f-4578-bfff-fc2da74c7292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29e939c705544ad8a04558eab63c3fd0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:26.915049 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e2c02-91f0-4608-8c66-f29c05a26f49 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:26.920415 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc49e3-43c9-492f-b361-74d547ebce38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:26.921138 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc49e3-43c9-492f-b361-74d547ebce38 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:26.921416 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc49e3-43c9-492f-b361-74d547ebce38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:26.921682 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc49e3-43c9-492f-b361-74d547ebce38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:26.922379 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc49e3-43c9-492f-b361-74d547ebce38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:26.924498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc49e3-43c9-492f-b361-74d547ebce38 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:26.927787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1236/2448] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:26 2022] DELETE /identity/v3/users/29e939c705544ad8a04558eab63c3fd0 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:26.932879 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a014e-f9fc-48a4-945a-67103c9ac9a4 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:26.933188 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a014e-f9fc-48a4-945a-67103c9ac9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:26.934309 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a014e-f9fc-48a4-945a-67103c9ac9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:26.958535 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5f6a014e-f9fc-48a4-945a-67103c9ac9a4 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:26.960195 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5f6a014e-f9fc-48a4-945a-67103c9ac9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:26.969100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1213/2449] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:26 2022] POST /identity/v3/projects => generated 379 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:26.970386 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc49e3-43c9-492f-b361-74d547ebce38 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:27.068758 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1237/2450] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:27.075545 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc49e3-43c9-492f-b361-74d547ebce38 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:27.086745 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb15db-b674-4d30-9205-3d3b540d9bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:27.087041 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a014e-f9fc-48a4-945a-67103c9ac9a4 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:27.088114 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb15db-b674-4d30-9205-3d3b540d9bbd admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:27.088587 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb15db-b674-4d30-9205-3d3b540d9bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:27.089070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb15db-b674-4d30-9205-3d3b540d9bbd admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:27.090292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb15db-b674-4d30-9205-3d3b540d9bbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:27.091899 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5f6a014e-f9fc-48a4-945a-67103c9ac9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:27.093137 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb15db-b674-4d30-9205-3d3b540d9bbd admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:27.107038 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:27.117622 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:27.126736 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1214/2451] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:26 2022] POST /identity/v3/users => generated 290 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:42:27.134561 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb15db-b674-4d30-9205-3d3b540d9bbd admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:27.150639 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb15db-b674-4d30-9205-3d3b540d9bbd admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:27.156517 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b69a9-cad5-4524-8c91-e2d2f0fa0573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:27.157297 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b69a9-cad5-4524-8c91-e2d2f0fa0573 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:27.157630 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b69a9-cad5-4524-8c91-e2d2f0fa0573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:27.158023 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b69a9-cad5-4524-8c91-e2d2f0fa0573 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:27.159053 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b69a9-cad5-4524-8c91-e2d2f0fa0573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:27.161593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b69a9-cad5-4524-8c91-e2d2f0fa0573 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:27.179317 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1215/2452] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:27.184840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b69a9-cad5-4524-8c91-e2d2f0fa0573 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:27.188779 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a014e-f9fc-48a4-945a-67103c9ac9a4 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:27.194324 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7680fa5-7d38-4089-b094-5c6c4551d9d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:27.195145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7680fa5-7d38-4089-b094-5c6c4551d9d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:27.195606 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7680fa5-7d38-4089-b094-5c6c4551d9d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:27.196033 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7680fa5-7d38-4089-b094-5c6c4551d9d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:27.196900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b69a9-cad5-4524-8c91-e2d2f0fa0573 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:27.202004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e67e0-9754-46b6-bffb-7d3fdf0de0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:27.202825 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e67e0-9754-46b6-bffb-7d3fdf0de0ca admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:27.203099 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e67e0-9754-46b6-bffb-7d3fdf0de0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:27.203373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e67e0-9754-46b6-bffb-7d3fdf0de0ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:27.204020 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e67e0-9754-46b6-bffb-7d3fdf0de0ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:27.205911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e67e0-9754-46b6-bffb-7d3fdf0de0ca admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:27.210423 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7680fa5-7d38-4089-b094-5c6c4551d9d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:27.214466 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7680fa5-7d38-4089-b094-5c6c4551d9d6 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:27.220812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1216/2453] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:42:27.226110 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e67e0-9754-46b6-bffb-7d3fdf0de0ca admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:27.236230 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1238/2454] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:27.243942 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e67e0-9754-46b6-bffb-7d3fdf0de0ca admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:27.250182 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d010ba-7c77-43b7-954f-c476675d7dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:27.251230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d010ba-7c77-43b7-954f-c476675d7dea admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:27.251653 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d010ba-7c77-43b7-954f-c476675d7dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:27.252132 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d010ba-7c77-43b7-954f-c476675d7dea admin admin] PATH_INFO: `/v3/projects/c4d17576494f432ea2f2817baf487f21/users/2ecb7abff72f4f18ad477c799cd09091/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:27.274487 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d010ba-7c77-43b7-954f-c476675d7dea admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4d17576494f432ea2f2817baf487f21, user_id=2ecb7abff72f4f18ad477c799cd09091, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:27.278567 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d010ba-7c77-43b7-954f-c476675d7dea admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:27.296468 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1217/2455] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:27 2022] PUT /identity/v3/projects/c4d17576494f432ea2f2817baf487f21/users/2ecb7abff72f4f18ad477c799cd09091/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:27.309747 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e325c8e-8a47-4212-9c79-122b15c35b3b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:27.310274 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e325c8e-8a47-4212-9c79-122b15c35b3b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:27.310721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e325c8e-8a47-4212-9c79-122b15c35b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:27.359428 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1e325c8e-8a47-4212-9c79-122b15c35b3b None None] MFA Rules not processed for user `2ecb7abff72f4f18ad477c799cd09091`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:27.362303 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1e325c8e-8a47-4212-9c79-122b15c35b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:27.463120 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1239/2456] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:27.467599 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d010ba-7c77-43b7-954f-c476675d7dea admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:27.564943 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d010ba-7c77-43b7-954f-c476675d7dea admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:27.578094 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388d8dc-4459-4dff-b789-264c970bb0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:27.579769 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388d8dc-4459-4dff-b789-264c970bb0a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:27.580580 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388d8dc-4459-4dff-b789-264c970bb0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:27.581567 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388d8dc-4459-4dff-b789-264c970bb0a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:27.583932 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388d8dc-4459-4dff-b789-264c970bb0a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:27.590638 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388d8dc-4459-4dff-b789-264c970bb0a3 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:27.625981 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1218/2457] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:27 2022] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:27.632917 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e325c8e-8a47-4212-9c79-122b15c35b3b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:27.645837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e325c8e-8a47-4212-9c79-122b15c35b3b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:27.657670 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388d8dc-4459-4dff-b789-264c970bb0a3 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:27.661680 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6388d8dc-4459-4dff-b789-264c970bb0a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:27.764592 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d7de8-3715-4c58-925e-d14b412c8103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:27.765947 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d7de8-3715-4c58-925e-d14b412c8103 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:27.766416 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d7de8-3715-4c58-925e-d14b412c8103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:27.781108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d7de8-3715-4c58-925e-d14b412c8103 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:27.781894 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d7de8-3715-4c58-925e-d14b412c8103 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:27.784135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d7de8-3715-4c58-925e-d14b412c8103 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:27.837260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388d8dc-4459-4dff-b789-264c970bb0a3 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:27.845236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e00375-c700-4c12-8046-d29955b27e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:27.845871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e00375-c700-4c12-8046-d29955b27e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:27.846153 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e00375-c700-4c12-8046-d29955b27e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:27.846478 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e00375-c700-4c12-8046-d29955b27e7d admin admin] PATH_INFO: `/v3/projects/3208683e338241c89c540cf26c5bfa06` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:27.848660 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e00375-c700-4c12-8046-d29955b27e7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3208683e338241c89c540cf26c5bfa06)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:27.851028 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e00375-c700-4c12-8046-d29955b27e7d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:27.869836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1240/2458] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:27 2022] POST /identity/v3/users => generated 297 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:42:27.877725 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d7de8-3715-4c58-925e-d14b412c8103 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:27.896072 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d7de8-3715-4c58-925e-d14b412c8103 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:27.928660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13913ed5-9b79-45d3-8309-382b6cb41737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:27.929681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13913ed5-9b79-45d3-8309-382b6cb41737 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:27.936926 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13913ed5-9b79-45d3-8309-382b6cb41737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:27.937491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13913ed5-9b79-45d3-8309-382b6cb41737 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:27.938224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13913ed5-9b79-45d3-8309-382b6cb41737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:27.939977 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13913ed5-9b79-45d3-8309-382b6cb41737 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:27.956215 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1241/2459] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:27.958872 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:27.962287 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13913ed5-9b79-45d3-8309-382b6cb41737 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:27.974556 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-44e00375-c700-4c12-8046-d29955b27e7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3208683e338241c89c540cf26c5bfa06', 'request_id': 'req-44e00375-c700-4c12-8046-d29955b27e7d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:27.978978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13913ed5-9b79-45d3-8309-382b6cb41737 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:27.996721 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-44e00375-c700-4c12-8046-d29955b27e7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3208683e338241c89c540cf26c5bfa06', 'request_id': 'req-44e00375-c700-4c12-8046-d29955b27e7d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:28.018571 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-44e00375-c700-4c12-8046-d29955b27e7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3208683e338241c89c540cf26c5bfa06', 'request_id': 'req-44e00375-c700-4c12-8046-d29955b27e7d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:28.047868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:28.060400 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-44e00375-c700-4c12-8046-d29955b27e7d admin admin] The token cache is being invalidate because project 3208683e338241c89c540cf26c5bfa06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:28.060721 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-44e00375-c700-4c12-8046-d29955b27e7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:28.062267 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-44e00375-c700-4c12-8046-d29955b27e7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:28.065701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1219/2460] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:27 2022] DELETE /identity/v3/projects/3208683e338241c89c540cf26c5bfa06 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:28.077869 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c06c3-3258-4e6b-83ce-37b79d699a8e None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:28.078565 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c06c3-3258-4e6b-83ce-37b79d699a8e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:28.079271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c06c3-3258-4e6b-83ce-37b79d699a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:28.119306 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1e3c06c3-3258-4e6b-83ce-37b79d699a8e None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:28.121704 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1e3c06c3-3258-4e6b-83ce-37b79d699a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:28.189222 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32326feb-9e51-4a60-a7fa-0edea35485c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:28.189980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32326feb-9e51-4a60-a7fa-0edea35485c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:28.190946 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32326feb-9e51-4a60-a7fa-0edea35485c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:28.191243 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32326feb-9e51-4a60-a7fa-0edea35485c6 admin admin] PATH_INFO: `/v3/projects/bb58536c9a7046baa8e219715bc29553/users/45255946c2294b62b10c877e1fab9173/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:28.224363 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32326feb-9e51-4a60-a7fa-0edea35485c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb58536c9a7046baa8e219715bc29553, user_id=45255946c2294b62b10c877e1fab9173, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:28.229866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32326feb-9e51-4a60-a7fa-0edea35485c6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:28.252711 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1242/2462] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:27 2022] PUT /identity/v3/projects/bb58536c9a7046baa8e219715bc29553/users/45255946c2294b62b10c877e1fab9173/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:28.252933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1220/2462] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:28.262290 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32326feb-9e51-4a60-a7fa-0edea35485c6 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:28.264376 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9af0e-ec23-44bf-99de-925f75739e2b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:28.264574 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-32326feb-9e51-4a60-a7fa-0edea35485c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:28.265122 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9af0e-ec23-44bf-99de-925f75739e2b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:28.265542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9af0e-ec23-44bf-99de-925f75739e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:28.292342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-15e9af0e-ec23-44bf-99de-925f75739e2b None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:28.294064 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-15e9af0e-ec23-44bf-99de-925f75739e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:28.373827 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32326feb-9e51-4a60-a7fa-0edea35485c6 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:28.379687 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfe2a8-2906-4a08-b7cf-abe5117605ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:28.381780 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfe2a8-2906-4a08-b7cf-abe5117605ac admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:28.381975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfe2a8-2906-4a08-b7cf-abe5117605ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:28.382282 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfe2a8-2906-4a08-b7cf-abe5117605ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:28.382882 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfe2a8-2906-4a08-b7cf-abe5117605ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:28.384655 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfe2a8-2906-4a08-b7cf-abe5117605ac admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:28.399882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1221/2463] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:28.400193 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1243/2464] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:28.402003 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfe2a8-2906-4a08-b7cf-abe5117605ac admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:28.402256 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9af0e-ec23-44bf-99de-925f75739e2b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:28.412154 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9af0e-ec23-44bf-99de-925f75739e2b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:28.413928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfe2a8-2906-4a08-b7cf-abe5117605ac admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:28.417870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a87b3-d65c-4555-95d8-158a2ba18992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:28.418692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a87b3-d65c-4555-95d8-158a2ba18992 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:28.418979 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a87b3-d65c-4555-95d8-158a2ba18992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:28.419250 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a87b3-d65c-4555-95d8-158a2ba18992 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:28.419564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15132bf-4571-49e8-ab88-f62cd0270d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:28.419922 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a87b3-d65c-4555-95d8-158a2ba18992 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:42:28.420225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a87b3-d65c-4555-95d8-158a2ba18992 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:28.420339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15132bf-4571-49e8-ab88-f62cd0270d93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:28.420526 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15132bf-4571-49e8-ab88-f62cd0270d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:28.420843 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15132bf-4571-49e8-ab88-f62cd0270d93 admin admin] PATH_INFO: `/v3/projects/bb58536c9a7046baa8e219715bc29553/users/45255946c2294b62b10c877e1fab9173/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:28.422017 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a87b3-d65c-4555-95d8-158a2ba18992 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:28.423989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15132bf-4571-49e8-ab88-f62cd0270d93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb58536c9a7046baa8e219715bc29553, user_id=45255946c2294b62b10c877e1fab9173, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:28.426676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15132bf-4571-49e8-ab88-f62cd0270d93 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:28.443244 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1222/2465] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:42:28.444749 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a87b3-d65c-4555-95d8-158a2ba18992 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:28.452430 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1244/2466] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:28 2022] PUT /identity/v3/projects/bb58536c9a7046baa8e219715bc29553/users/45255946c2294b62b10c877e1fab9173/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:28.464647 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1482f4-a9d9-4fbb-a28a-f0483dd2f742 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:28.464929 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1482f4-a9d9-4fbb-a28a-f0483dd2f742 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:28.465254 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1482f4-a9d9-4fbb-a28a-f0483dd2f742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:28.465844 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a87b3-d65c-4555-95d8-158a2ba18992 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:28.501886 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-af1482f4-a9d9-4fbb-a28a-f0483dd2f742 None None] MFA Rules not processed for user `45255946c2294b62b10c877e1fab9173`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:28.503150 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-af1482f4-a9d9-4fbb-a28a-f0483dd2f742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:28.540466 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:28.550582 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167882ff-c608-4fed-bdf0-310b7a317bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:28.552040 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167882ff-c608-4fed-bdf0-310b7a317bff admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:28.554365 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167882ff-c608-4fed-bdf0-310b7a317bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:28.554794 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167882ff-c608-4fed-bdf0-310b7a317bff admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:28.555582 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167882ff-c608-4fed-bdf0-310b7a317bff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:28.558072 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167882ff-c608-4fed-bdf0-310b7a317bff admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:28.596517 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1223/2467] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:28 2022] POST /identity/v3/projects => generated 399 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:28.597454 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167882ff-c608-4fed-bdf0-310b7a317bff admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:28.599269 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-167882ff-c608-4fed-bdf0-310b7a317bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:28.618289 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1245/2468] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:28 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:28.619834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1482f4-a9d9-4fbb-a28a-f0483dd2f742 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:28.638815 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1482f4-a9d9-4fbb-a28a-f0483dd2f742 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:28.651260 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:28.685868 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167882ff-c608-4fed-bdf0-310b7a317bff admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:28.691008 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45aac76-e323-451c-b5c1-3c35276291dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:28.691669 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aac76-e323-451c-b5c1-3c35276291dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:28.691950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aac76-e323-451c-b5c1-3c35276291dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:28.692223 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aac76-e323-451c-b5c1-3c35276291dc admin admin] PATH_INFO: `/v3/users/d0df69f0d9a04b9c8fe3bd7309480d37` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:28.693495 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45aac76-e323-451c-b5c1-3c35276291dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0df69f0d9a04b9c8fe3bd7309480d37)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:28.695542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45aac76-e323-451c-b5c1-3c35276291dc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:28.714105 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c0a44-2ceb-4c4f-a5ef-3e228a2b5b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:28.714726 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c0a44-2ceb-4c4f-a5ef-3e228a2b5b10 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:28.715879 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c0a44-2ceb-4c4f-a5ef-3e228a2b5b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:28.715879 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c0a44-2ceb-4c4f-a5ef-3e228a2b5b10 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:28.716193 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c0a44-2ceb-4c4f-a5ef-3e228a2b5b10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:28.718319 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c0a44-2ceb-4c4f-a5ef-3e228a2b5b10 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:28.750725 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1246/2469] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:28 2022] POST /identity/v3/users => generated 300 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:28.756869 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c0a44-2ceb-4c4f-a5ef-3e228a2b5b10 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:28.758687 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f45c0a44-2ceb-4c4f-a5ef-3e228a2b5b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:28.759595 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a45aac76-e323-451c-b5c1-3c35276291dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0df69f0d9a04b9c8fe3bd7309480d37'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:28.778413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a45aac76-e323-451c-b5c1-3c35276291dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0df69f0d9a04b9c8fe3bd7309480d37'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:28.779452 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a45aac76-e323-451c-b5c1-3c35276291dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0df69f0d9a04b9c8fe3bd7309480d37'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:28.780203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a45aac76-e323-451c-b5c1-3c35276291dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0df69f0d9a04b9c8fe3bd7309480d37'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:28.790188 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a45aac76-e323-451c-b5c1-3c35276291dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0df69f0d9a04b9c8fe3bd7309480d37'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:28.809363 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1224/2470] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:28 2022] DELETE /identity/v3/users/d0df69f0d9a04b9c8fe3bd7309480d37 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:28.814032 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45aac76-e323-451c-b5c1-3c35276291dc admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:28.815852 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a45aac76-e323-451c-b5c1-3c35276291dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:28.827717 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c0a44-2ceb-4c4f-a5ef-3e228a2b5b10 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:28.889155 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc68604-0d6e-4fef-a157-de7941897fd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:28.890196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc68604-0d6e-4fef-a157-de7941897fd7 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:28.890601 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc68604-0d6e-4fef-a157-de7941897fd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:28.890975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc68604-0d6e-4fef-a157-de7941897fd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:28.893747 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-adc68604-0d6e-4fef-a157-de7941897fd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:28.895326 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45aac76-e323-451c-b5c1-3c35276291dc admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:28.900891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae2ed9-75b5-4f88-ba91-54487c785444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:28.901577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae2ed9-75b5-4f88-ba91-54487c785444 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:28.901811 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae2ed9-75b5-4f88-ba91-54487c785444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:28.902088 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae2ed9-75b5-4f88-ba91-54487c785444 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:28.902757 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae2ed9-75b5-4f88-ba91-54487c785444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:28.904405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae2ed9-75b5-4f88-ba91-54487c785444 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:28.907063 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:28.920729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1225/2471] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:28.920729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34f329-0259-4b2c-ada7-69cbcd13a7c5 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:28.920729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34f329-0259-4b2c-ada7-69cbcd13a7c5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:28.920729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34f329-0259-4b2c-ada7-69cbcd13a7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:28.941646 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5b34f329-0259-4b2c-ada7-69cbcd13a7c5 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:28.942938 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5b34f329-0259-4b2c-ada7-69cbcd13a7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:28.959245 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1226/2472] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:28.960232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34f329-0259-4b2c-ada7-69cbcd13a7c5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:28.970747 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34f329-0259-4b2c-ada7-69cbcd13a7c5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:28.976426 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af1844-768d-4ac4-b73c-9044d3c066f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:28.977091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af1844-768d-4ac4-b73c-9044d3c066f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:28.977370 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af1844-768d-4ac4-b73c-9044d3c066f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:28.977640 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af1844-768d-4ac4-b73c-9044d3c066f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:28.978309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af1844-768d-4ac4-b73c-9044d3c066f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:28.979968 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af1844-768d-4ac4-b73c-9044d3c066f1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:28.988022 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc68604-0d6e-4fef-a157-de7941897fd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:28.989813 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc68604-0d6e-4fef-a157-de7941897fd7 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:28.991597 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1227/2473] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:28.992474 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af1844-768d-4ac4-b73c-9044d3c066f1 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:28.994229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-49af1844-768d-4ac4-b73c-9044d3c066f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:29.005069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1247/2474] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:29.008493 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc68604-0d6e-4fef-a157-de7941897fd7 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:29.020039 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc68604-0d6e-4fef-a157-de7941897fd7 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:29.026172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977b7e9-ff3c-4502-8f1c-bc5fece1b36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:29.026624 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977b7e9-ff3c-4502-8f1c-bc5fece1b36e admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:29.027006 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977b7e9-ff3c-4502-8f1c-bc5fece1b36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:29.027285 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977b7e9-ff3c-4502-8f1c-bc5fece1b36e admin admin] PATH_INFO: `/v3/projects/cef9794a24bb4277abb691cd83b526f3/users/f6cf70f176584aada5858291b951c41c/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:29.030913 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:29.055219 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977b7e9-ff3c-4502-8f1c-bc5fece1b36e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef9794a24bb4277abb691cd83b526f3, user_id=f6cf70f176584aada5858291b951c41c, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:29.058681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977b7e9-ff3c-4502-8f1c-bc5fece1b36e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:29.079069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1248/2475] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:29 2022] PUT /identity/v3/projects/cef9794a24bb4277abb691cd83b526f3/users/f6cf70f176584aada5858291b951c41c/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:29.090157 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eef27c-aed1-417d-8d40-138290f8fa34 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:29.091098 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eef27c-aed1-417d-8d40-138290f8fa34 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:29.091740 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eef27c-aed1-417d-8d40-138290f8fa34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:29.104895 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af1844-768d-4ac4-b73c-9044d3c066f1 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:29.126643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c7eef27c-aed1-417d-8d40-138290f8fa34 None None] MFA Rules not processed for user `f6cf70f176584aada5858291b951c41c`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:29.127909 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c7eef27c-aed1-417d-8d40-138290f8fa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:29.178848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81535c-185c-4d53-8638-2b8ab5057504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:29.179375 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81535c-185c-4d53-8638-2b8ab5057504 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:29.179668 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81535c-185c-4d53-8638-2b8ab5057504 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:29.180107 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81535c-185c-4d53-8638-2b8ab5057504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:29.247597 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1249/2476] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:29 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:29.247597 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eef27c-aed1-417d-8d40-138290f8fa34 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:29.247597 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c7eef27c-aed1-417d-8d40-138290f8fa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:29.273076 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f81535c-185c-4d53-8638-2b8ab5057504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:29.274559 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f81535c-185c-4d53-8638-2b8ab5057504 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:29.285938 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1228/2477] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:29.286884 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81535c-185c-4d53-8638-2b8ab5057504 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:29.302479 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81535c-185c-4d53-8638-2b8ab5057504 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:29.313282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461e409-3c9f-41a9-aa97-32e7151b64d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:29.314786 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461e409-3c9f-41a9-aa97-32e7151b64d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:29.315532 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461e409-3c9f-41a9-aa97-32e7151b64d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:29.316250 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461e409-3c9f-41a9-aa97-32e7151b64d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:29.318966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461e409-3c9f-41a9-aa97-32e7151b64d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:29.323233 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461e409-3c9f-41a9-aa97-32e7151b64d6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:29.341682 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eef27c-aed1-417d-8d40-138290f8fa34 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:29.348121 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e631cb-37ab-42fe-a5fe-ea5f6f684176 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:29.349373 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e631cb-37ab-42fe-a5fe-ea5f6f684176 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:29.350103 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e631cb-37ab-42fe-a5fe-ea5f6f684176 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:29.350612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e631cb-37ab-42fe-a5fe-ea5f6f684176 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:29.354492 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-04e631cb-37ab-42fe-a5fe-ea5f6f684176 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:29.383665 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1229/2478] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:29 2022] POST /identity/v3/projects => generated 399 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:29.390812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461e409-3c9f-41a9-aa97-32e7151b64d6 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:29.449696 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:29.486200 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e631cb-37ab-42fe-a5fe-ea5f6f684176 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:29.487781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e631cb-37ab-42fe-a5fe-ea5f6f684176 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:29.499375 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1250/2479] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:29.534494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461e409-3c9f-41a9-aa97-32e7151b64d6 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:29.545347 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05b127-376f-45ab-93f7-1d7558b68e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:29.559671 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05b127-376f-45ab-93f7-1d7558b68e64 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:29.563370 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05b127-376f-45ab-93f7-1d7558b68e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:29.564296 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05b127-376f-45ab-93f7-1d7558b68e64 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:29.566321 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05b127-376f-45ab-93f7-1d7558b68e64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:29.566723 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7580e2-e50c-4e28-88ae-a83d26bfd2ca None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:29.567271 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7580e2-e50c-4e28-88ae-a83d26bfd2ca None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:29.567763 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7580e2-e50c-4e28-88ae-a83d26bfd2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:29.576852 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05b127-376f-45ab-93f7-1d7558b68e64 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:29.606552 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2a7580e2-e50c-4e28-88ae-a83d26bfd2ca None None] MFA Rules not processed for user `3c001a902faf4b3c8d8f23f2e017c706`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:29.610484 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2a7580e2-e50c-4e28-88ae-a83d26bfd2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:29.637015 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1230/2480] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:29 2022] POST /identity/v3/users => generated 306 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:29.640793 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05b127-376f-45ab-93f7-1d7558b68e64 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:29.657173 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05b127-376f-45ab-93f7-1d7558b68e64 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:29.663618 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:29.670014 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5940e-3afe-492d-b88f-e3f79ed0f4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:29.670982 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5940e-3afe-492d-b88f-e3f79ed0f4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:29.671487 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5940e-3afe-492d-b88f-e3f79ed0f4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:29.672193 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5940e-3afe-492d-b88f-e3f79ed0f4b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:29.673571 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5940e-3afe-492d-b88f-e3f79ed0f4b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:29.675765 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5940e-3afe-492d-b88f-e3f79ed0f4b1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:29.692995 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1231/2481] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:29.701344 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5940e-3afe-492d-b88f-e3f79ed0f4b1 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:29.715467 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5940e-3afe-492d-b88f-e3f79ed0f4b1 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:29.734758 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc9f75-890c-49f2-8f8c-efe0045e71bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:29.735457 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc9f75-890c-49f2-8f8c-efe0045e71bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:29.735738 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc9f75-890c-49f2-8f8c-efe0045e71bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:29.736011 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc9f75-890c-49f2-8f8c-efe0045e71bc admin admin] PATH_INFO: `/v3/projects/02745eef4a58484a9fa15c9ca874ad94/users/cd9bc50ba2314775b88c3490c095608a/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:29.752827 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1251/2482] 10.222.0.52 () {58 vars in 967 bytes} [Thu Sep 1 16:42:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:29.754444 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7580e2-e50c-4e28-88ae-a83d26bfd2ca None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:29.759537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2a7580e2-e50c-4e28-88ae-a83d26bfd2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:29.770517 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc9f75-890c-49f2-8f8c-efe0045e71bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=02745eef4a58484a9fa15c9ca874ad94, user_id=cd9bc50ba2314775b88c3490c095608a, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:29.775879 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc9f75-890c-49f2-8f8c-efe0045e71bc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:29.780247 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7580e2-e50c-4e28-88ae-a83d26bfd2ca None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:29.785885 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986d055-b8e7-4f05-9d78-39377593b8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:29.786731 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986d055-b8e7-4f05-9d78-39377593b8ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:29.787131 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986d055-b8e7-4f05-9d78-39377593b8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:29.788016 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986d055-b8e7-4f05-9d78-39377593b8ed admin admin] PATH_INFO: `/v3/projects/5db9a44e5e0941c091231fcf8db28f84` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:29.789460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986d055-b8e7-4f05-9d78-39377593b8ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db9a44e5e0941c091231fcf8db28f84)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:29.791666 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986d055-b8e7-4f05-9d78-39377593b8ed admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:29.808698 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1232/2483] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:29 2022] PUT /identity/v3/projects/02745eef4a58484a9fa15c9ca874ad94/users/cd9bc50ba2314775b88c3490c095608a/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:29.809918 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc9f75-890c-49f2-8f8c-efe0045e71bc admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:29.812038 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fdcc9f75-890c-49f2-8f8c-efe0045e71bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:29.852155 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7986d055-b8e7-4f05-9d78-39377593b8ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db9a44e5e0941c091231fcf8db28f84', 'request_id': 'req-7986d055-b8e7-4f05-9d78-39377593b8ed'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:29.859747 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7986d055-b8e7-4f05-9d78-39377593b8ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db9a44e5e0941c091231fcf8db28f84', 'request_id': 'req-7986d055-b8e7-4f05-9d78-39377593b8ed'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:29.869128 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7986d055-b8e7-4f05-9d78-39377593b8ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db9a44e5e0941c091231fcf8db28f84', 'request_id': 'req-7986d055-b8e7-4f05-9d78-39377593b8ed'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:29.882304 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7986d055-b8e7-4f05-9d78-39377593b8ed admin admin] The token cache is being invalidate because project 5db9a44e5e0941c091231fcf8db28f84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:29.882941 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7986d055-b8e7-4f05-9d78-39377593b8ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:29.883701 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7986d055-b8e7-4f05-9d78-39377593b8ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:29.885457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1252/2484] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:29 2022] DELETE /identity/v3/projects/5db9a44e5e0941c091231fcf8db28f84 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:29.886304 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986d055-b8e7-4f05-9d78-39377593b8ed admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:29.887908 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7986d055-b8e7-4f05-9d78-39377593b8ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:29.913031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc9f75-890c-49f2-8f8c-efe0045e71bc admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:29.979168 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986d055-b8e7-4f05-9d78-39377593b8ed admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:29.985266 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3237e-b67b-41b1-b55c-2504c68791b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:29.986112 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3237e-b67b-41b1-b55c-2504c68791b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:29.986397 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3237e-b67b-41b1-b55c-2504c68791b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:29.986673 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3237e-b67b-41b1-b55c-2504c68791b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:29.987348 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3237e-b67b-41b1-b55c-2504c68791b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:29.989138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3237e-b67b-41b1-b55c-2504c68791b8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:29.993174 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8dfd3-a9db-49a7-af15-5b1731d8a0d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748e35d9a1534920860b2234d45f6724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:29.993952 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8dfd3-a9db-49a7-af15-5b1731d8a0d2 service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:29.994295 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8dfd3-a9db-49a7-af15-5b1731d8a0d2 service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:29.994629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8dfd3-a9db-49a7-af15-5b1731d8a0d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:29.997287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-78a8dfd3-a9db-49a7-af15-5b1731d8a0d2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:30.002986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1253/2485] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:30.002986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3237e-b67b-41b1-b55c-2504c68791b8 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:30.007323 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-12e3237e-b67b-41b1-b55c-2504c68791b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:30.023777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3237e-b67b-41b1-b55c-2504c68791b8 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:30.029817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:30.030298 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb169c2a-0257-45b2-b8e8-9cf14bc607f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:30.031299 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb169c2a-0257-45b2-b8e8-9cf14bc607f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:30.031766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb169c2a-0257-45b2-b8e8-9cf14bc607f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:30.032149 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb169c2a-0257-45b2-b8e8-9cf14bc607f4 admin admin] PATH_INFO: `/v3/users/b322fe59bfae47939774fd91e2700f53` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:30.033885 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb169c2a-0257-45b2-b8e8-9cf14bc607f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b322fe59bfae47939774fd91e2700f53)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:30.037032 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb169c2a-0257-45b2-b8e8-9cf14bc607f4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:30.078410 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a8dfd3-a9db-49a7-af15-5b1731d8a0d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:30.080081 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a8dfd3-a9db-49a7-af15-5b1731d8a0d2 service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:30.091006 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1233/2486] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 1 16:42:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:30.091577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8dfd3-a9db-49a7-af15-5b1731d8a0d2 service swift] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:30.110230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8dfd3-a9db-49a7-af15-5b1731d8a0d2 service swift] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:30.112686 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:30.115031 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cb169c2a-0257-45b2-b8e8-9cf14bc607f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b322fe59bfae47939774fd91e2700f53'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:30.123629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174800db-747e-4d9c-9796-80995e51c783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:30.124950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174800db-747e-4d9c-9796-80995e51c783 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:30.128795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174800db-747e-4d9c-9796-80995e51c783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:30.129803 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174800db-747e-4d9c-9796-80995e51c783 admin admin] PATH_INFO: `/v3/projects/02745eef4a58484a9fa15c9ca874ad94/users/cd9bc50ba2314775b88c3490c095608a/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:30.133368 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174800db-747e-4d9c-9796-80995e51c783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02745eef4a58484a9fa15c9ca874ad94, user_id=cd9bc50ba2314775b88c3490c095608a, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:30.137753 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174800db-747e-4d9c-9796-80995e51c783 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:30.139072 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cb169c2a-0257-45b2-b8e8-9cf14bc607f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b322fe59bfae47939774fd91e2700f53'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:30.140078 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cb169c2a-0257-45b2-b8e8-9cf14bc607f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b322fe59bfae47939774fd91e2700f53'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:30.151144 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cb169c2a-0257-45b2-b8e8-9cf14bc607f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b322fe59bfae47939774fd91e2700f53'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:30.162681 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cb169c2a-0257-45b2-b8e8-9cf14bc607f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b322fe59bfae47939774fd91e2700f53'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:30.165125 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1234/2487] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:30 2022] PUT /identity/v3/projects/02745eef4a58484a9fa15c9ca874ad94/users/cd9bc50ba2314775b88c3490c095608a/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:30.175161 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8a20e-e8e0-411f-b83b-409b5c5f5b26 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:30.175835 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8a20e-e8e0-411f-b83b-409b5c5f5b26 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:30.176294 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8a20e-e8e0-411f-b83b-409b5c5f5b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:30.182613 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1254/2488] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:30 2022] DELETE /identity/v3/users/b322fe59bfae47939774fd91e2700f53 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:30.224428 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a7a8a20e-e8e0-411f-b83b-409b5c5f5b26 None None] MFA Rules not processed for user `cd9bc50ba2314775b88c3490c095608a`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:30.226293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a7a8a20e-e8e0-411f-b83b-409b5c5f5b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:30.368405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1235/2489] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:30 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:30.381674 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb169c2a-0257-45b2-b8e8-9cf14bc607f4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:30.383234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cb169c2a-0257-45b2-b8e8-9cf14bc607f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:30.484449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb169c2a-0257-45b2-b8e8-9cf14bc607f4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:30.491024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1af6f4-f517-4bb8-a05c-58296fca8085 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:30.492013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1af6f4-f517-4bb8-a05c-58296fca8085 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:30.492482 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1af6f4-f517-4bb8-a05c-58296fca8085 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:30.492762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1af6f4-f517-4bb8-a05c-58296fca8085 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:30.507982 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1af6f4-f517-4bb8-a05c-58296fca8085 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:30.509964 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1af6f4-f517-4bb8-a05c-58296fca8085 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:30.523693 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1255/2490] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:30 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:30.637509 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8a20e-e8e0-411f-b83b-409b5c5f5b26 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:30.649844 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8a20e-e8e0-411f-b83b-409b5c5f5b26 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:30.654392 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58810114-acec-4a44-8781-295246f59a24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:30.655505 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58810114-acec-4a44-8781-295246f59a24 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:30.655505 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58810114-acec-4a44-8781-295246f59a24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:30.655675 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58810114-acec-4a44-8781-295246f59a24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:30.658110 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-58810114-acec-4a44-8781-295246f59a24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:30.706426 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1af6f4-f517-4bb8-a05c-58296fca8085 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:30.708185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1a1af6f4-f517-4bb8-a05c-58296fca8085 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:30.809190 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58810114-acec-4a44-8781-295246f59a24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:30.812189 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58810114-acec-4a44-8781-295246f59a24 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:30.824891 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1236/2491] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:30 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:30.872996 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1af6f4-f517-4bb8-a05c-58296fca8085 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:30.883057 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29aeaa2-8e22-4a7d-a5cd-58031fe38c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:30.884400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29aeaa2-8e22-4a7d-a5cd-58031fe38c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:30.884931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29aeaa2-8e22-4a7d-a5cd-58031fe38c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:30.886028 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29aeaa2-8e22-4a7d-a5cd-58031fe38c3c admin admin] PATH_INFO: `/v3/projects/4af9e5c1ed914b7491838e83c2c50a19` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:30.888248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29aeaa2-8e22-4a7d-a5cd-58031fe38c3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4af9e5c1ed914b7491838e83c2c50a19)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:30.891528 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29aeaa2-8e22-4a7d-a5cd-58031fe38c3c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:30.971148 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c29aeaa2-8e22-4a7d-a5cd-58031fe38c3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4af9e5c1ed914b7491838e83c2c50a19', 'request_id': 'req-c29aeaa2-8e22-4a7d-a5cd-58031fe38c3c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:30.980962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c29aeaa2-8e22-4a7d-a5cd-58031fe38c3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4af9e5c1ed914b7491838e83c2c50a19', 'request_id': 'req-c29aeaa2-8e22-4a7d-a5cd-58031fe38c3c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:30.995419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c29aeaa2-8e22-4a7d-a5cd-58031fe38c3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4af9e5c1ed914b7491838e83c2c50a19', 'request_id': 'req-c29aeaa2-8e22-4a7d-a5cd-58031fe38c3c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:31.003954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:31.015908 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c29aeaa2-8e22-4a7d-a5cd-58031fe38c3c admin admin] The token cache is being invalidate because project 4af9e5c1ed914b7491838e83c2c50a19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:31.017328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c29aeaa2-8e22-4a7d-a5cd-58031fe38c3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:31.018827 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c29aeaa2-8e22-4a7d-a5cd-58031fe38c3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:31.026787 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1256/2492] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:30 2022] DELETE /identity/v3/projects/4af9e5c1ed914b7491838e83c2c50a19 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:31.034183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac231076-eb0b-4e19-929e-45a32960e1de None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:31.035075 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac231076-eb0b-4e19-929e-45a32960e1de None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:31.035755 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac231076-eb0b-4e19-929e-45a32960e1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:31.070307 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ac231076-eb0b-4e19-929e-45a32960e1de None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:31.071770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ac231076-eb0b-4e19-929e-45a32960e1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:31.146163 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:31.216704 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1237/2493] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:31.226031 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f63721-e63b-46ab-8e9a-7989d0b119b0 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:31.226900 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f63721-e63b-46ab-8e9a-7989d0b119b0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:31.227312 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f63721-e63b-46ab-8e9a-7989d0b119b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:31.258069 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b6f63721-e63b-46ab-8e9a-7989d0b119b0 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:31.259351 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b6f63721-e63b-46ab-8e9a-7989d0b119b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:31.273246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1257/2494] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:31.277465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac231076-eb0b-4e19-929e-45a32960e1de None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:31.292886 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac231076-eb0b-4e19-929e-45a32960e1de None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:31.300435 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae895794-f9c9-4d75-9224-6490160776b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:31.301996 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae895794-f9c9-4d75-9224-6490160776b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:31.303355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae895794-f9c9-4d75-9224-6490160776b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:31.304139 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae895794-f9c9-4d75-9224-6490160776b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:31.305476 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae895794-f9c9-4d75-9224-6490160776b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:42:31.305872 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae895794-f9c9-4d75-9224-6490160776b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:31.308754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae895794-f9c9-4d75-9224-6490160776b5 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:31.339662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1238/2495] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:42:31.346117 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f63721-e63b-46ab-8e9a-7989d0b119b0 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:31.359763 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f63721-e63b-46ab-8e9a-7989d0b119b0 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:31.371334 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ccc25-af4c-43f8-8754-195988027de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:31.371975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ccc25-af4c-43f8-8754-195988027de0 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:31.372363 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ccc25-af4c-43f8-8754-195988027de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:31.372676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ccc25-af4c-43f8-8754-195988027de0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:31.374555 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ccc25-af4c-43f8-8754-195988027de0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:31.377674 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ccc25-af4c-43f8-8754-195988027de0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:31.418591 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1258/2496] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:31 2022] POST /identity/v3/projects => generated 369 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:42:31.426715 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae895794-f9c9-4d75-9224-6490160776b5 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:31.442179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae895794-f9c9-4d75-9224-6490160776b5 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:31.569275 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd224b-159e-4838-ae58-364dcd2e0bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:31.570446 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd224b-159e-4838-ae58-364dcd2e0bfc admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:31.570950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd224b-159e-4838-ae58-364dcd2e0bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:31.571532 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd224b-159e-4838-ae58-364dcd2e0bfc admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:31.572437 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd224b-159e-4838-ae58-364dcd2e0bfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:31.575133 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd224b-159e-4838-ae58-364dcd2e0bfc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:31.602826 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1239/2497] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:31 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:42:31.607660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ccc25-af4c-43f8-8754-195988027de0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:31.624023 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ccc25-af4c-43f8-8754-195988027de0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:31.630439 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f8b50-0de1-4168-8945-435037f35b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:31.630748 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f8b50-0de1-4168-8945-435037f35b66 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:31.631189 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f8b50-0de1-4168-8945-435037f35b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:31.631548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f8b50-0de1-4168-8945-435037f35b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:31.632236 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f8b50-0de1-4168-8945-435037f35b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:31.634093 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f8b50-0de1-4168-8945-435037f35b66 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:31.649682 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1259/2498] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:42:31.650952 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd224b-159e-4838-ae58-364dcd2e0bfc admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:31.662188 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd224b-159e-4838-ae58-364dcd2e0bfc admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:31.667122 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758d59f-12bf-4f72-b627-c5100ed1da46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:31.667764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758d59f-12bf-4f72-b627-c5100ed1da46 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:31.668048 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758d59f-12bf-4f72-b627-c5100ed1da46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:31.668322 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758d59f-12bf-4f72-b627-c5100ed1da46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:31.669045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758d59f-12bf-4f72-b627-c5100ed1da46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:31.670688 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758d59f-12bf-4f72-b627-c5100ed1da46 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:31.683723 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1240/2499] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:31.690230 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f8b50-0de1-4168-8945-435037f35b66 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:31.701326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f8b50-0de1-4168-8945-435037f35b66 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:31.706377 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c5e1f-6ca0-4cbd-8928-f8cadea2171f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:31.707092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c5e1f-6ca0-4cbd-8928-f8cadea2171f admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:31.707377 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c5e1f-6ca0-4cbd-8928-f8cadea2171f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:31.707658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c5e1f-6ca0-4cbd-8928-f8cadea2171f admin admin] PATH_INFO: `/v3/projects/ec635e2bd4c04230aad79106c00521b6/users/f50097a0121d448a8df27aab1053b200/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:31.726919 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c5e1f-6ca0-4cbd-8928-f8cadea2171f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec635e2bd4c04230aad79106c00521b6, user_id=f50097a0121d448a8df27aab1053b200, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:31.729992 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c5e1f-6ca0-4cbd-8928-f8cadea2171f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:31.746371 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1260/2500] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:31 2022] PUT /identity/v3/projects/ec635e2bd4c04230aad79106c00521b6/users/f50097a0121d448a8df27aab1053b200/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:31.759730 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ae3fe-8fe8-4317-9b71-9c9b53cbd4f8 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:31.760067 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ae3fe-8fe8-4317-9b71-9c9b53cbd4f8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:31.760537 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ae3fe-8fe8-4317-9b71-9c9b53cbd4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:31.794914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2f8ae3fe-8fe8-4317-9b71-9c9b53cbd4f8 None None] MFA Rules not processed for user `f50097a0121d448a8df27aab1053b200`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:31.796413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2f8ae3fe-8fe8-4317-9b71-9c9b53cbd4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:31.890414 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1241/2501] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:31.895501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c5e1f-6ca0-4cbd-8928-f8cadea2171f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:31.978230 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c5e1f-6ca0-4cbd-8928-f8cadea2171f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:31.983854 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c96577-25be-4709-8bd7-2952ee3e98ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:31.984488 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c96577-25be-4709-8bd7-2952ee3e98ce admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:31.984801 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c96577-25be-4709-8bd7-2952ee3e98ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:31.985091 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c96577-25be-4709-8bd7-2952ee3e98ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:31.985907 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c96577-25be-4709-8bd7-2952ee3e98ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:31.987921 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c96577-25be-4709-8bd7-2952ee3e98ce admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:32.030415 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1261/2502] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:31 2022] POST /identity/v3/projects => generated 369 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:42:32.035797 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ae3fe-8fe8-4317-9b71-9c9b53cbd4f8 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:32.061798 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ae3fe-8fe8-4317-9b71-9c9b53cbd4f8 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:32.110506 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:32.154629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac45f85-efd3-4b5e-811d-4d29537b7691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:32.155291 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac45f85-efd3-4b5e-811d-4d29537b7691 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:32.155566 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac45f85-efd3-4b5e-811d-4d29537b7691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:32.155871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac45f85-efd3-4b5e-811d-4d29537b7691 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:32.156524 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac45f85-efd3-4b5e-811d-4d29537b7691 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:32.158607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac45f85-efd3-4b5e-811d-4d29537b7691 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:32.187930 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1242/2503] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:32 2022] POST /identity/v3/users => generated 291 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:32.192241 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c96577-25be-4709-8bd7-2952ee3e98ce admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:32.206861 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c96577-25be-4709-8bd7-2952ee3e98ce admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:32.213079 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e8c2e-f32a-47e0-8da7-a54929aba107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:32.214232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e8c2e-f32a-47e0-8da7-a54929aba107 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:32.214746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e8c2e-f32a-47e0-8da7-a54929aba107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:32.215076 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e8c2e-f32a-47e0-8da7-a54929aba107 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:32.215994 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e8c2e-f32a-47e0-8da7-a54929aba107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:32.218152 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e8c2e-f32a-47e0-8da7-a54929aba107 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:32.230963 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1262/2504] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:42:32.235614 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac45f85-efd3-4b5e-811d-4d29537b7691 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:32.250125 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac45f85-efd3-4b5e-811d-4d29537b7691 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:32.255511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead6beb-87c3-4062-9e5b-150bb240e484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:32.256455 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead6beb-87c3-4062-9e5b-150bb240e484 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:32.256819 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead6beb-87c3-4062-9e5b-150bb240e484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:32.257205 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead6beb-87c3-4062-9e5b-150bb240e484 admin admin] PATH_INFO: `/v3/projects/44876d48b94b4f6fad60e8632aef01ae/users/ff4c6080054b4e3c802342a93e7c1623/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:32.278886 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead6beb-87c3-4062-9e5b-150bb240e484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44876d48b94b4f6fad60e8632aef01ae, user_id=ff4c6080054b4e3c802342a93e7c1623, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:32.281815 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead6beb-87c3-4062-9e5b-150bb240e484 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:32.298008 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1243/2505] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:32 2022] PUT /identity/v3/projects/44876d48b94b4f6fad60e8632aef01ae/users/ff4c6080054b4e3c802342a93e7c1623/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:32.303209 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e8c2e-f32a-47e0-8da7-a54929aba107 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:32.314546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e8c2e-f32a-47e0-8da7-a54929aba107 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:32.384796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747cc5d-ed2a-4eb5-852d-169ac7ae6203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:32.385432 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747cc5d-ed2a-4eb5-852d-169ac7ae6203 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:32.385717 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747cc5d-ed2a-4eb5-852d-169ac7ae6203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:32.385999 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747cc5d-ed2a-4eb5-852d-169ac7ae6203 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:32.386719 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5747cc5d-ed2a-4eb5-852d-169ac7ae6203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:32.388409 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5747cc5d-ed2a-4eb5-852d-169ac7ae6203 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:32.401192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1263/2506] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:32.405713 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead6beb-87c3-4062-9e5b-150bb240e484 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:32.417602 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead6beb-87c3-4062-9e5b-150bb240e484 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:32.422726 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478702b-db47-4422-81fe-55521f1270ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:32.423423 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478702b-db47-4422-81fe-55521f1270ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:32.423705 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478702b-db47-4422-81fe-55521f1270ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:32.423986 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478702b-db47-4422-81fe-55521f1270ad admin admin] PATH_INFO: `/v3/projects/44876d48b94b4f6fad60e8632aef01ae/users/ff4c6080054b4e3c802342a93e7c1623/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:32.426116 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478702b-db47-4422-81fe-55521f1270ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=44876d48b94b4f6fad60e8632aef01ae, user_id=ff4c6080054b4e3c802342a93e7c1623, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:32.429355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478702b-db47-4422-81fe-55521f1270ad admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:32.442942 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1244/2507] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:32 2022] PUT /identity/v3/projects/44876d48b94b4f6fad60e8632aef01ae/users/ff4c6080054b4e3c802342a93e7c1623/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:32.454594 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36b27d-da78-412b-86d3-6d8db18ab48a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:32.454891 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36b27d-da78-412b-86d3-6d8db18ab48a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:32.455141 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36b27d-da78-412b-86d3-6d8db18ab48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:32.464275 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:32.500933 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0b36b27d-da78-412b-86d3-6d8db18ab48a None None] MFA Rules not processed for user `ff4c6080054b4e3c802342a93e7c1623`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:32.503508 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0b36b27d-da78-412b-86d3-6d8db18ab48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:32.635188 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1264/2508] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:32.686399 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478702b-db47-4422-81fe-55521f1270ad admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:32.690970 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0478702b-db47-4422-81fe-55521f1270ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:32.781826 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478702b-db47-4422-81fe-55521f1270ad admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:32.786585 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842af71-eb81-4b1a-8de2-9b9f0cbb8ace service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:32.787858 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842af71-eb81-4b1a-8de2-9b9f0cbb8ace service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:32.788131 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842af71-eb81-4b1a-8de2-9b9f0cbb8ace service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:32.788517 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842af71-eb81-4b1a-8de2-9b9f0cbb8ace service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:32.801646 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842af71-eb81-4b1a-8de2-9b9f0cbb8ace service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:32.803484 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842af71-eb81-4b1a-8de2-9b9f0cbb8ace service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:32.817156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1245/2509] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:32.909426 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36b27d-da78-412b-86d3-6d8db18ab48a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:32.910528 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0b36b27d-da78-412b-86d3-6d8db18ab48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:32.929482 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36b27d-da78-412b-86d3-6d8db18ab48a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:32.935638 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8bbf6-abe0-4206-a46d-603f3b41c4a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:32.936490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8bbf6-abe0-4206-a46d-603f3b41c4a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:32.936968 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8bbf6-abe0-4206-a46d-603f3b41c4a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:32.937421 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8bbf6-abe0-4206-a46d-603f3b41c4a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:33.032362 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8bbf6-abe0-4206-a46d-603f3b41c4a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:33.036049 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8bbf6-abe0-4206-a46d-603f3b41c4a3 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:33.062323 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1265/2510] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:35.027265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842af71-eb81-4b1a-8de2-9b9f0cbb8ace service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:35.030862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8842af71-eb81-4b1a-8de2-9b9f0cbb8ace service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:35.155024 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842af71-eb81-4b1a-8de2-9b9f0cbb8ace service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:35.163214 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c0827-3096-4490-acad-24403ff35c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:35.164190 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c0827-3096-4490-acad-24403ff35c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:35.164544 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c0827-3096-4490-acad-24403ff35c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:35.165054 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c0827-3096-4490-acad-24403ff35c6d admin admin] PATH_INFO: `/v3/users/f6cf70f176584aada5858291b951c41c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:35.167218 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c0827-3096-4490-acad-24403ff35c6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6cf70f176584aada5858291b951c41c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:35.170171 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c0827-3096-4490-acad-24403ff35c6d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:35.216393 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:35.241837 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f10c0827-3096-4490-acad-24403ff35c6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6cf70f176584aada5858291b951c41c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:35.259323 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f10c0827-3096-4490-acad-24403ff35c6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6cf70f176584aada5858291b951c41c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:35.260308 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f10c0827-3096-4490-acad-24403ff35c6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6cf70f176584aada5858291b951c41c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:35.261143 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f10c0827-3096-4490-acad-24403ff35c6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6cf70f176584aada5858291b951c41c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:35.274668 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f10c0827-3096-4490-acad-24403ff35c6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6cf70f176584aada5858291b951c41c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:35.300336 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1246/2511] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:35 2022] DELETE /identity/v3/users/f6cf70f176584aada5858291b951c41c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:35.307203 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca52e25-2be8-4134-b64c-0bca4aa669aa None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:35.307791 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca52e25-2be8-4134-b64c-0bca4aa669aa None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:35.308092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca52e25-2be8-4134-b64c-0bca4aa669aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:35.331112 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7ca52e25-2be8-4134-b64c-0bca4aa669aa None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:35.332358 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7ca52e25-2be8-4134-b64c-0bca4aa669aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:35.414205 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1266/2512] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:35.433566 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c0827-3096-4490-acad-24403ff35c6d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:35.433566 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f10c0827-3096-4490-acad-24403ff35c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:35.515066 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c0827-3096-4490-acad-24403ff35c6d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:35.520879 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d8c0d-8867-43ab-802d-e99696117fc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:35.522206 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d8c0d-8867-43ab-802d-e99696117fc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:35.522484 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d8c0d-8867-43ab-802d-e99696117fc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:35.523224 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d8c0d-8867-43ab-802d-e99696117fc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:35.544060 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d8c0d-8867-43ab-802d-e99696117fc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:35.547533 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d8c0d-8867-43ab-802d-e99696117fc2 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:35.568270 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1247/2513] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:42:35.873094 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca52e25-2be8-4134-b64c-0bca4aa669aa None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:35.875047 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7ca52e25-2be8-4134-b64c-0bca4aa669aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:35.894034 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca52e25-2be8-4134-b64c-0bca4aa669aa None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:35.902735 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fcd22a-6844-48d5-ba77-c0173e932b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:35.903986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcd22a-6844-48d5-ba77-c0173e932b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:35.904378 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcd22a-6844-48d5-ba77-c0173e932b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:35.904996 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcd22a-6844-48d5-ba77-c0173e932b38 admin admin] PATH_INFO: `/v3/projects/cef9794a24bb4277abb691cd83b526f3` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:35.906898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fcd22a-6844-48d5-ba77-c0173e932b38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cef9794a24bb4277abb691cd83b526f3)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:35.910244 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fcd22a-6844-48d5-ba77-c0173e932b38 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:35.937202 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:35.966272 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e4fcd22a-6844-48d5-ba77-c0173e932b38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cef9794a24bb4277abb691cd83b526f3', 'request_id': 'req-e4fcd22a-6844-48d5-ba77-c0173e932b38'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:35.973748 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e4fcd22a-6844-48d5-ba77-c0173e932b38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cef9794a24bb4277abb691cd83b526f3', 'request_id': 'req-e4fcd22a-6844-48d5-ba77-c0173e932b38'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:35.983093 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e4fcd22a-6844-48d5-ba77-c0173e932b38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cef9794a24bb4277abb691cd83b526f3', 'request_id': 'req-e4fcd22a-6844-48d5-ba77-c0173e932b38'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:35.997084 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e4fcd22a-6844-48d5-ba77-c0173e932b38 admin admin] The token cache is being invalidate because project cef9794a24bb4277abb691cd83b526f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:35.997377 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e4fcd22a-6844-48d5-ba77-c0173e932b38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:35.998038 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e4fcd22a-6844-48d5-ba77-c0173e932b38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:35.999685 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1267/2514] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:35 2022] DELETE /identity/v3/projects/cef9794a24bb4277abb691cd83b526f3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:36.004484 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d8c0d-8867-43ab-802d-e99696117fc2 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:36.015063 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d8c0d-8867-43ab-802d-e99696117fc2 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:36.087382 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed520f-4a9b-46ef-a243-ffefb5ca8270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:36.088046 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed520f-4a9b-46ef-a243-ffefb5ca8270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:36.088324 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed520f-4a9b-46ef-a243-ffefb5ca8270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:36.088596 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed520f-4a9b-46ef-a243-ffefb5ca8270 admin admin] PATH_INFO: `/v3/users/cd9bc50ba2314775b88c3490c095608a` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:36.089872 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed520f-4a9b-46ef-a243-ffefb5ca8270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd9bc50ba2314775b88c3490c095608a)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:36.091904 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed520f-4a9b-46ef-a243-ffefb5ca8270 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:36.150878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c9ed520f-4a9b-46ef-a243-ffefb5ca8270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd9bc50ba2314775b88c3490c095608a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:36.152359 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:36.170638 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c9ed520f-4a9b-46ef-a243-ffefb5ca8270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd9bc50ba2314775b88c3490c095608a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:36.171851 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c9ed520f-4a9b-46ef-a243-ffefb5ca8270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd9bc50ba2314775b88c3490c095608a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:36.172477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c9ed520f-4a9b-46ef-a243-ffefb5ca8270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd9bc50ba2314775b88c3490c095608a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:36.183156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c9ed520f-4a9b-46ef-a243-ffefb5ca8270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd9bc50ba2314775b88c3490c095608a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:36.210621 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1248/2515] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:36 2022] DELETE /identity/v3/users/cd9bc50ba2314775b88c3490c095608a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:36.653903 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fcd22a-6844-48d5-ba77-c0173e932b38 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:36.655722 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e4fcd22a-6844-48d5-ba77-c0173e932b38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:36.683082 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fcd22a-6844-48d5-ba77-c0173e932b38 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:36.809120 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54ec8a-a342-41f1-8f15-319d474550c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:36.810011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54ec8a-a342-41f1-8f15-319d474550c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:36.810467 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54ec8a-a342-41f1-8f15-319d474550c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:36.810944 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54ec8a-a342-41f1-8f15-319d474550c1 admin admin] PATH_INFO: `/v3/projects/02745eef4a58484a9fa15c9ca874ad94` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:36.812443 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54ec8a-a342-41f1-8f15-319d474550c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02745eef4a58484a9fa15c9ca874ad94)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:36.814869 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54ec8a-a342-41f1-8f15-319d474550c1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:36.899099 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8a54ec8a-a342-41f1-8f15-319d474550c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02745eef4a58484a9fa15c9ca874ad94', 'request_id': 'req-8a54ec8a-a342-41f1-8f15-319d474550c1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:36.911664 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8a54ec8a-a342-41f1-8f15-319d474550c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02745eef4a58484a9fa15c9ca874ad94', 'request_id': 'req-8a54ec8a-a342-41f1-8f15-319d474550c1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:36.924406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8a54ec8a-a342-41f1-8f15-319d474550c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02745eef4a58484a9fa15c9ca874ad94', 'request_id': 'req-8a54ec8a-a342-41f1-8f15-319d474550c1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:36.942560 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8a54ec8a-a342-41f1-8f15-319d474550c1 admin admin] The token cache is being invalidate because project 02745eef4a58484a9fa15c9ca874ad94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:36.942861 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8a54ec8a-a342-41f1-8f15-319d474550c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:36.943659 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8a54ec8a-a342-41f1-8f15-319d474550c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:36.945453 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1268/2516] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:36 2022] DELETE /identity/v3/projects/02745eef4a58484a9fa15c9ca874ad94 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:36.950983 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124140d-1a27-41ee-867f-bc3a9a7fc052 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:36.951420 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124140d-1a27-41ee-867f-bc3a9a7fc052 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:36.951898 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124140d-1a27-41ee-867f-bc3a9a7fc052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:36.977180 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2124140d-1a27-41ee-867f-bc3a9a7fc052 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:36.978725 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2124140d-1a27-41ee-867f-bc3a9a7fc052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:37.069770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1249/2517] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:37.086415 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa3643-0310-4da2-be8e-8a845aa6681b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:37.086885 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa3643-0310-4da2-be8e-8a845aa6681b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:37.087332 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa3643-0310-4da2-be8e-8a845aa6681b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:37.123676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-11aa3643-0310-4da2-be8e-8a845aa6681b None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:37.125225 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-11aa3643-0310-4da2-be8e-8a845aa6681b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:37.137331 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1269/2518] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:37.144690 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124140d-1a27-41ee-867f-bc3a9a7fc052 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:37.164044 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124140d-1a27-41ee-867f-bc3a9a7fc052 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:37.171415 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd3771-5353-45a9-8bf7-e361ecf0a96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:37.172310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd3771-5353-45a9-8bf7-e361ecf0a96c admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:37.172671 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd3771-5353-45a9-8bf7-e361ecf0a96c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:37.173023 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd3771-5353-45a9-8bf7-e361ecf0a96c admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:37.174106 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd3771-5353-45a9-8bf7-e361ecf0a96c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:42:37.174519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd3771-5353-45a9-8bf7-e361ecf0a96c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:37.177070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd3771-5353-45a9-8bf7-e361ecf0a96c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:37.199122 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1250/2519] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:42:37.206475 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa3643-0310-4da2-be8e-8a845aa6681b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:37.221176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa3643-0310-4da2-be8e-8a845aa6681b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:37.229230 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e22c56-3137-4048-a226-fee848b7d12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:37.230200 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e22c56-3137-4048-a226-fee848b7d12b admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:37.230643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e22c56-3137-4048-a226-fee848b7d12b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:37.231113 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e22c56-3137-4048-a226-fee848b7d12b admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:37.232231 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e22c56-3137-4048-a226-fee848b7d12b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:37.236074 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e22c56-3137-4048-a226-fee848b7d12b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:37.284500 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1270/2520] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:37 2022] POST /identity/v3/projects => generated 361 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:42:37.286647 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd3771-5353-45a9-8bf7-e361ecf0a96c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:37.305349 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd3771-5353-45a9-8bf7-e361ecf0a96c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:37.352944 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e22c56-3137-4048-a226-fee848b7d12b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:37.355415 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-65e22c56-3137-4048-a226-fee848b7d12b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:37.376240 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:37.404895 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfc475-56f1-4bb7-87e1-7ebdcae899e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:37.405985 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfc475-56f1-4bb7-87e1-7ebdcae899e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:37.406710 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfc475-56f1-4bb7-87e1-7ebdcae899e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:37.407195 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfc475-56f1-4bb7-87e1-7ebdcae899e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:37.408385 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfc475-56f1-4bb7-87e1-7ebdcae899e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:37.413720 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfc475-56f1-4bb7-87e1-7ebdcae899e8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:37.450580 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1251/2521] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:37 2022] POST /identity/v3/users => generated 281 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:37.457814 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfc475-56f1-4bb7-87e1-7ebdcae899e8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:37.470413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e22c56-3137-4048-a226-fee848b7d12b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:37.480002 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf08749-22ad-44e3-a635-6ca18bcdc728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:37.480428 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfc475-56f1-4bb7-87e1-7ebdcae899e8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:37.483647 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf08749-22ad-44e3-a635-6ca18bcdc728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:37.484253 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf08749-22ad-44e3-a635-6ca18bcdc728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:37.484838 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf08749-22ad-44e3-a635-6ca18bcdc728 admin admin] PATH_INFO: `/v3/users/f50097a0121d448a8df27aab1053b200` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:37.486799 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf08749-22ad-44e3-a635-6ca18bcdc728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f50097a0121d448a8df27aab1053b200)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:37.487032 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e9539-94dd-48e5-9a11-334b5f9578d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:37.487712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e9539-94dd-48e5-9a11-334b5f9578d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:37.487975 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e9539-94dd-48e5-9a11-334b5f9578d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:37.488313 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e9539-94dd-48e5-9a11-334b5f9578d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:37.489141 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e9539-94dd-48e5-9a11-334b5f9578d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:37.491152 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf08749-22ad-44e3-a635-6ca18bcdc728 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:37.491560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e9539-94dd-48e5-9a11-334b5f9578d1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:37.504072 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1252/2522] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:37.512317 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e9539-94dd-48e5-9a11-334b5f9578d1 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:37.541537 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e9539-94dd-48e5-9a11-334b5f9578d1 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:37.549314 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177fc92-171b-4209-821f-f3c388af130b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:37.550290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177fc92-171b-4209-821f-f3c388af130b admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:37.550816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177fc92-171b-4209-821f-f3c388af130b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:37.551259 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177fc92-171b-4209-821f-f3c388af130b admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:37.552274 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177fc92-171b-4209-821f-f3c388af130b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:37.554940 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177fc92-171b-4209-821f-f3c388af130b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:37.573333 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1253/2523] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:37.580909 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177fc92-171b-4209-821f-f3c388af130b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:37.600711 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177fc92-171b-4209-821f-f3c388af130b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:37.608341 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00541ccb-f467-4c1c-a11f-bc014d0073be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:37.609703 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00541ccb-f467-4c1c-a11f-bc014d0073be admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:37.610168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00541ccb-f467-4c1c-a11f-bc014d0073be admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:37.610579 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00541ccb-f467-4c1c-a11f-bc014d0073be admin admin] PATH_INFO: `/v3/projects/9a842a19632b440e8f307f05e34a30df/users/29df5cae258a4b2f9590fc553d4da5f9/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:37.622785 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-edf08749-22ad-44e3-a635-6ca18bcdc728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f50097a0121d448a8df27aab1053b200'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:37.641743 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00541ccb-f467-4c1c-a11f-bc014d0073be admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a842a19632b440e8f307f05e34a30df, user_id=29df5cae258a4b2f9590fc553d4da5f9, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:37.647129 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00541ccb-f467-4c1c-a11f-bc014d0073be admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:37.652943 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:37.655091 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-edf08749-22ad-44e3-a635-6ca18bcdc728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f50097a0121d448a8df27aab1053b200'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:37.656079 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-edf08749-22ad-44e3-a635-6ca18bcdc728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f50097a0121d448a8df27aab1053b200'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:37.669416 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-edf08749-22ad-44e3-a635-6ca18bcdc728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f50097a0121d448a8df27aab1053b200'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:37.673271 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1254/2524] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:37 2022] PUT /identity/v3/projects/9a842a19632b440e8f307f05e34a30df/users/29df5cae258a4b2f9590fc553d4da5f9/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:37.687284 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-edf08749-22ad-44e3-a635-6ca18bcdc728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f50097a0121d448a8df27aab1053b200'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:37.689414 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff6753-21cf-4f14-9ad3-f437a7b968d1 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:37.689893 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff6753-21cf-4f14-9ad3-f437a7b968d1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:37.690331 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff6753-21cf-4f14-9ad3-f437a7b968d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:37.707342 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1271/2525] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:37 2022] DELETE /identity/v3/users/f50097a0121d448a8df27aab1053b200 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:37.714848 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33f107-169f-469e-9955-62cafb840c1f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:37.715334 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33f107-169f-469e-9955-62cafb840c1f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:37.715788 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33f107-169f-469e-9955-62cafb840c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:37.742015 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-faff6753-21cf-4f14-9ad3-f437a7b968d1 None None] MFA Rules not processed for user `29df5cae258a4b2f9590fc553d4da5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:37.743918 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-faff6753-21cf-4f14-9ad3-f437a7b968d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:37.756781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4b33f107-169f-469e-9955-62cafb840c1f None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:37.758949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4b33f107-169f-469e-9955-62cafb840c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:37.869816 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1272/2526] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:37.871210 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33f107-169f-469e-9955-62cafb840c1f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:37.873890 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4b33f107-169f-469e-9955-62cafb840c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:37.876206 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1255/2527] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:37.880257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff6753-21cf-4f14-9ad3-f437a7b968d1 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:37.882759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-faff6753-21cf-4f14-9ad3-f437a7b968d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:37.901406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33f107-169f-469e-9955-62cafb840c1f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:37.912901 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767536f4-3c20-41a0-a0bf-d6c48319f845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:37.912901 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767536f4-3c20-41a0-a0bf-d6c48319f845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:37.912901 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767536f4-3c20-41a0-a0bf-d6c48319f845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:37.912901 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767536f4-3c20-41a0-a0bf-d6c48319f845 admin admin] PATH_INFO: `/v3/users/2ecb7abff72f4f18ad477c799cd09091` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:37.913414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767536f4-3c20-41a0-a0bf-d6c48319f845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ecb7abff72f4f18ad477c799cd09091)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:37.913414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767536f4-3c20-41a0-a0bf-d6c48319f845 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:37.959335 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:37.976275 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff6753-21cf-4f14-9ad3-f437a7b968d1 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:37.981798 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294d2f8-f2c5-4d34-b364-0a9173799adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:37.982627 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294d2f8-f2c5-4d34-b364-0a9173799adc service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:37.983059 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294d2f8-f2c5-4d34-b364-0a9173799adc service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:37.983511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294d2f8-f2c5-4d34-b364-0a9173799adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:37.989446 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-767536f4-3c20-41a0-a0bf-d6c48319f845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ecb7abff72f4f18ad477c799cd09091'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:37.995547 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294d2f8-f2c5-4d34-b364-0a9173799adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:37.997224 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294d2f8-f2c5-4d34-b364-0a9173799adc service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:38.005498 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-767536f4-3c20-41a0-a0bf-d6c48319f845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ecb7abff72f4f18ad477c799cd09091'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:38.007037 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-767536f4-3c20-41a0-a0bf-d6c48319f845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ecb7abff72f4f18ad477c799cd09091'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:38.010348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1256/2528] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:42:38.011919 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294d2f8-f2c5-4d34-b364-0a9173799adc service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:38.013646 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c294d2f8-f2c5-4d34-b364-0a9173799adc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:38.020822 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-767536f4-3c20-41a0-a0bf-d6c48319f845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ecb7abff72f4f18ad477c799cd09091'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:38.034891 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-767536f4-3c20-41a0-a0bf-d6c48319f845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ecb7abff72f4f18ad477c799cd09091'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:38.048915 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1273/2529] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:37 2022] DELETE /identity/v3/users/2ecb7abff72f4f18ad477c799cd09091 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:38.056039 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d2dd0-6b06-4802-b2b6-6aa11bb3078b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:38.056535 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d2dd0-6b06-4802-b2b6-6aa11bb3078b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:38.057151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d2dd0-6b06-4802-b2b6-6aa11bb3078b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:38.091604 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-889d2dd0-6b06-4802-b2b6-6aa11bb3078b None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:38.094367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-889d2dd0-6b06-4802-b2b6-6aa11bb3078b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:38.148574 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294d2f8-f2c5-4d34-b364-0a9173799adc service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:38.192416 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1274/2530] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:38.211117 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d2dd0-6b06-4802-b2b6-6aa11bb3078b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:38.213478 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-889d2dd0-6b06-4802-b2b6-6aa11bb3078b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:38.235745 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:38.250631 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b61981-b6c1-499e-a0bb-d993bb734988 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:38.251687 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b61981-b6c1-499e-a0bb-d993bb734988 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:38.252725 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b61981-b6c1-499e-a0bb-d993bb734988 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:38.253216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b61981-b6c1-499e-a0bb-d993bb734988 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:38.257328 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-96b61981-b6c1-499e-a0bb-d993bb734988 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:38.326944 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d2dd0-6b06-4802-b2b6-6aa11bb3078b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:38.331984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa17a3-4553-4fcd-ae8a-d9a3600e7bc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:38.332667 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa17a3-4553-4fcd-ae8a-d9a3600e7bc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:38.333155 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa17a3-4553-4fcd-ae8a-d9a3600e7bc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:38.333430 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa17a3-4553-4fcd-ae8a-d9a3600e7bc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:38.347615 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa17a3-4553-4fcd-ae8a-d9a3600e7bc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:38.349197 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa17a3-4553-4fcd-ae8a-d9a3600e7bc3 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:38.352241 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b61981-b6c1-499e-a0bb-d993bb734988 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:38.354376 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b61981-b6c1-499e-a0bb-d993bb734988 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:38.363258 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1275/2531] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:42:38.368691 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1257/2532] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:38.386221 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa17a3-4553-4fcd-ae8a-d9a3600e7bc3 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:38.387920 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-80aa17a3-4553-4fcd-ae8a-d9a3600e7bc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:38.402805 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa17a3-4553-4fcd-ae8a-d9a3600e7bc3 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:38.408019 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdfb57-0b9d-4410-897f-287f3188d1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:38.408785 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdfb57-0b9d-4410-897f-287f3188d1b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:38.409163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdfb57-0b9d-4410-897f-287f3188d1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:38.409503 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdfb57-0b9d-4410-897f-287f3188d1b0 admin admin] PATH_INFO: `/v3/users/29df5cae258a4b2f9590fc553d4da5f9` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:38.410814 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdfb57-0b9d-4410-897f-287f3188d1b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29df5cae258a4b2f9590fc553d4da5f9)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:38.413165 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdfb57-0b9d-4410-897f-287f3188d1b0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:38.467462 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:38.475815 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-74fdfb57-0b9d-4410-897f-287f3188d1b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29df5cae258a4b2f9590fc553d4da5f9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:38.496398 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-74fdfb57-0b9d-4410-897f-287f3188d1b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29df5cae258a4b2f9590fc553d4da5f9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:38.497374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-74fdfb57-0b9d-4410-897f-287f3188d1b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29df5cae258a4b2f9590fc553d4da5f9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:38.508560 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-74fdfb57-0b9d-4410-897f-287f3188d1b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29df5cae258a4b2f9590fc553d4da5f9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:38.519147 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-74fdfb57-0b9d-4410-897f-287f3188d1b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29df5cae258a4b2f9590fc553d4da5f9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:38.529751 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1276/2533] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:38 2022] DELETE /identity/v3/users/29df5cae258a4b2f9590fc553d4da5f9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:38.536205 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c1881-ac65-4c10-9e1e-55dcb0afcc5a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:38.536883 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c1881-ac65-4c10-9e1e-55dcb0afcc5a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:38.537368 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c1881-ac65-4c10-9e1e-55dcb0afcc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:38.577852 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-d83c1881-ac65-4c10-9e1e-55dcb0afcc5a None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:38.580418 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d83c1881-ac65-4c10-9e1e-55dcb0afcc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:38.609531 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdfb57-0b9d-4410-897f-287f3188d1b0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:38.611901 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-74fdfb57-0b9d-4410-897f-287f3188d1b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:38.717289 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1258/2534] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:38.741510 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c1881-ac65-4c10-9e1e-55dcb0afcc5a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:38.743967 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d83c1881-ac65-4c10-9e1e-55dcb0afcc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:38.777245 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdfb57-0b9d-4410-897f-287f3188d1b0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:38.785856 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2784c-bc9a-4cca-8e2d-1ec74d5aaff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:38.787363 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2784c-bc9a-4cca-8e2d-1ec74d5aaff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:38.787859 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2784c-bc9a-4cca-8e2d-1ec74d5aaff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:38.788345 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2784c-bc9a-4cca-8e2d-1ec74d5aaff4 admin admin] PATH_INFO: `/v3/projects/ec635e2bd4c04230aad79106c00521b6` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:38.791041 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2784c-bc9a-4cca-8e2d-1ec74d5aaff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec635e2bd4c04230aad79106c00521b6)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:38.794764 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2784c-bc9a-4cca-8e2d-1ec74d5aaff4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:38.870442 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c1881-ac65-4c10-9e1e-55dcb0afcc5a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:38.893907 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b4e2784c-bc9a-4cca-8e2d-1ec74d5aaff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec635e2bd4c04230aad79106c00521b6', 'request_id': 'req-b4e2784c-bc9a-4cca-8e2d-1ec74d5aaff4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:38.909833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b4e2784c-bc9a-4cca-8e2d-1ec74d5aaff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec635e2bd4c04230aad79106c00521b6', 'request_id': 'req-b4e2784c-bc9a-4cca-8e2d-1ec74d5aaff4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:38.934202 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b4e2784c-bc9a-4cca-8e2d-1ec74d5aaff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec635e2bd4c04230aad79106c00521b6', 'request_id': 'req-b4e2784c-bc9a-4cca-8e2d-1ec74d5aaff4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:38.956777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b4e2784c-bc9a-4cca-8e2d-1ec74d5aaff4 admin admin] The token cache is being invalidate because project ec635e2bd4c04230aad79106c00521b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:38.957426 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b4e2784c-bc9a-4cca-8e2d-1ec74d5aaff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:38.958801 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b4e2784c-bc9a-4cca-8e2d-1ec74d5aaff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:38.960784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1277/2535] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:38 2022] DELETE /identity/v3/projects/ec635e2bd4c04230aad79106c00521b6 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:38.964771 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afca16c-d976-4495-abc0-62d5f29a763d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:38.965494 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2784c-bc9a-4cca-8e2d-1ec74d5aaff4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:38.965792 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afca16c-d976-4495-abc0-62d5f29a763d service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:38.966230 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afca16c-d976-4495-abc0-62d5f29a763d service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:38.966518 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afca16c-d976-4495-abc0-62d5f29a763d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:38.967716 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b4e2784c-bc9a-4cca-8e2d-1ec74d5aaff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:38.971663 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9afca16c-d976-4495-abc0-62d5f29a763d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:38.983989 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:39.060359 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:39.076220 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afca16c-d976-4495-abc0-62d5f29a763d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:39.078072 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afca16c-d976-4495-abc0-62d5f29a763d service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:39.087287 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2784c-bc9a-4cca-8e2d-1ec74d5aaff4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:39.095732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1259/2536] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:39.096758 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afca16c-d976-4495-abc0-62d5f29a763d service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:39.097321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f197c-3dc4-4d72-be47-800b0da97c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:39.098705 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f197c-3dc4-4d72-be47-800b0da97c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:39.099155 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9afca16c-d976-4495-abc0-62d5f29a763d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:39.099398 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f197c-3dc4-4d72-be47-800b0da97c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:39.100224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f197c-3dc4-4d72-be47-800b0da97c8d admin admin] PATH_INFO: `/v3/users/ff4c6080054b4e3c802342a93e7c1623` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:39.102507 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f197c-3dc4-4d72-be47-800b0da97c8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff4c6080054b4e3c802342a93e7c1623)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:39.106228 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f197c-3dc4-4d72-be47-800b0da97c8d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:39.124951 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afca16c-d976-4495-abc0-62d5f29a763d service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:39.130214 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f93a8-4fd3-4bd7-8e5c-63e5fcf57347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:39.130912 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f93a8-4fd3-4bd7-8e5c-63e5fcf57347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:39.131186 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f93a8-4fd3-4bd7-8e5c-63e5fcf57347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:39.131543 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f93a8-4fd3-4bd7-8e5c-63e5fcf57347 admin admin] PATH_INFO: `/v3/projects/c4d17576494f432ea2f2817baf487f21` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:39.133334 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f93a8-4fd3-4bd7-8e5c-63e5fcf57347 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4d17576494f432ea2f2817baf487f21)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:39.135712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f93a8-4fd3-4bd7-8e5c-63e5fcf57347 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:39.225461 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4b8f197c-3dc4-4d72-be47-800b0da97c8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff4c6080054b4e3c802342a93e7c1623'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:39.225700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f55f93a8-4fd3-4bd7-8e5c-63e5fcf57347 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4d17576494f432ea2f2817baf487f21', 'request_id': 'req-f55f93a8-4fd3-4bd7-8e5c-63e5fcf57347'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:39.239119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f55f93a8-4fd3-4bd7-8e5c-63e5fcf57347 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4d17576494f432ea2f2817baf487f21', 'request_id': 'req-f55f93a8-4fd3-4bd7-8e5c-63e5fcf57347'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:39.251242 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f55f93a8-4fd3-4bd7-8e5c-63e5fcf57347 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4d17576494f432ea2f2817baf487f21', 'request_id': 'req-f55f93a8-4fd3-4bd7-8e5c-63e5fcf57347'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:39.261890 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4b8f197c-3dc4-4d72-be47-800b0da97c8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff4c6080054b4e3c802342a93e7c1623'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:39.263381 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4b8f197c-3dc4-4d72-be47-800b0da97c8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff4c6080054b4e3c802342a93e7c1623'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:39.273538 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f55f93a8-4fd3-4bd7-8e5c-63e5fcf57347 admin admin] The token cache is being invalidate because project c4d17576494f432ea2f2817baf487f21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:39.273856 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f55f93a8-4fd3-4bd7-8e5c-63e5fcf57347 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:39.274718 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f55f93a8-4fd3-4bd7-8e5c-63e5fcf57347 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:39.277821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1260/2537] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:39 2022] DELETE /identity/v3/projects/c4d17576494f432ea2f2817baf487f21 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:39.279775 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4b8f197c-3dc4-4d72-be47-800b0da97c8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff4c6080054b4e3c802342a93e7c1623'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:39.282593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f93a8-4fd3-4bd7-8e5c-63e5fcf57347 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:39.284258 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f55f93a8-4fd3-4bd7-8e5c-63e5fcf57347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:39.291667 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4b8f197c-3dc4-4d72-be47-800b0da97c8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff4c6080054b4e3c802342a93e7c1623'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:39.299692 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1278/2538] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:38 2022] DELETE /identity/v3/users/ff4c6080054b4e3c802342a93e7c1623 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:39.389765 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f93a8-4fd3-4bd7-8e5c-63e5fcf57347 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:39.443803 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:39.485143 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d650b-75ed-4d64-8809-a4f4ce6ddfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:39.485933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d650b-75ed-4d64-8809-a4f4ce6ddfdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:39.486203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d650b-75ed-4d64-8809-a4f4ce6ddfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:39.486469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d650b-75ed-4d64-8809-a4f4ce6ddfdc admin admin] PATH_INFO: `/v3/users/45255946c2294b62b10c877e1fab9173` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:39.487703 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d650b-75ed-4d64-8809-a4f4ce6ddfdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=45255946c2294b62b10c877e1fab9173)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:39.489770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d650b-75ed-4d64-8809-a4f4ce6ddfdc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:39.552478 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0c1d650b-75ed-4d64-8809-a4f4ce6ddfdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45255946c2294b62b10c877e1fab9173'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:39.567437 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0c1d650b-75ed-4d64-8809-a4f4ce6ddfdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45255946c2294b62b10c877e1fab9173'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:39.569220 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0c1d650b-75ed-4d64-8809-a4f4ce6ddfdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45255946c2294b62b10c877e1fab9173'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:39.570008 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0c1d650b-75ed-4d64-8809-a4f4ce6ddfdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45255946c2294b62b10c877e1fab9173'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:39.579071 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0c1d650b-75ed-4d64-8809-a4f4ce6ddfdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45255946c2294b62b10c877e1fab9173'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:39.602958 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1261/2539] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:39 2022] DELETE /identity/v3/users/45255946c2294b62b10c877e1fab9173 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:39.655204 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f197c-3dc4-4d72-be47-800b0da97c8d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:39.663075 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4b8f197c-3dc4-4d72-be47-800b0da97c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:39.692140 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f197c-3dc4-4d72-be47-800b0da97c8d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:39.833157 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae537a08-6650-40d8-966d-c6423acf1767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:39.834702 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae537a08-6650-40d8-966d-c6423acf1767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:39.835099 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae537a08-6650-40d8-966d-c6423acf1767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:39.835383 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae537a08-6650-40d8-966d-c6423acf1767 admin admin] PATH_INFO: `/v3/projects/9a842a19632b440e8f307f05e34a30df` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:39.836711 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae537a08-6650-40d8-966d-c6423acf1767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a842a19632b440e8f307f05e34a30df)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:39.838973 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae537a08-6650-40d8-966d-c6423acf1767 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:39.911159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ae537a08-6650-40d8-966d-c6423acf1767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a842a19632b440e8f307f05e34a30df', 'request_id': 'req-ae537a08-6650-40d8-966d-c6423acf1767'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:39.919633 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ae537a08-6650-40d8-966d-c6423acf1767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a842a19632b440e8f307f05e34a30df', 'request_id': 'req-ae537a08-6650-40d8-966d-c6423acf1767'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:39.936771 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ae537a08-6650-40d8-966d-c6423acf1767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a842a19632b440e8f307f05e34a30df', 'request_id': 'req-ae537a08-6650-40d8-966d-c6423acf1767'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:39.950116 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:39.962125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ae537a08-6650-40d8-966d-c6423acf1767 admin admin] The token cache is being invalidate because project 9a842a19632b440e8f307f05e34a30df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:39.963820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ae537a08-6650-40d8-966d-c6423acf1767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:39.965553 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ae537a08-6650-40d8-966d-c6423acf1767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:39.969321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1279/2540] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:39 2022] DELETE /identity/v3/projects/9a842a19632b440e8f307f05e34a30df => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:39.978352 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae537a08-6650-40d8-966d-c6423acf1767 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:39.978960 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2425b82-b1b6-4277-8a38-d00706910a2b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:39.979444 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2425b82-b1b6-4277-8a38-d00706910a2b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:39.979917 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2425b82-b1b6-4277-8a38-d00706910a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:39.981014 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ae537a08-6650-40d8-966d-c6423acf1767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:40.016322 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a2425b82-b1b6-4277-8a38-d00706910a2b None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:40.019226 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a2425b82-b1b6-4277-8a38-d00706910a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:40.139367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae537a08-6650-40d8-966d-c6423acf1767 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:40.145914 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3dbbb0-5d1e-4bbf-ad1b-25837c5ee93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:40.147048 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dbbb0-5d1e-4bbf-ad1b-25837c5ee93a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:40.148280 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dbbb0-5d1e-4bbf-ad1b-25837c5ee93a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:40.149094 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dbbb0-5d1e-4bbf-ad1b-25837c5ee93a admin admin] PATH_INFO: `/v3/projects/44876d48b94b4f6fad60e8632aef01ae` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:40.151931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3dbbb0-5d1e-4bbf-ad1b-25837c5ee93a admin admin] RBAC: Authorizing `identity:delete_project(project_id=44876d48b94b4f6fad60e8632aef01ae)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:40.156670 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1262/2541] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:40.157212 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2425b82-b1b6-4277-8a38-d00706910a2b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:40.157742 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3dbbb0-5d1e-4bbf-ad1b-25837c5ee93a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:40.160175 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a2425b82-b1b6-4277-8a38-d00706910a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:40.180308 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2425b82-b1b6-4277-8a38-d00706910a2b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:40.186081 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3e7be-cda0-45b6-bd4d-abfdf4c79358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:40.186880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3e7be-cda0-45b6-bd4d-abfdf4c79358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:40.187092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3e7be-cda0-45b6-bd4d-abfdf4c79358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:40.187479 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3e7be-cda0-45b6-bd4d-abfdf4c79358 admin admin] PATH_INFO: `/v3/projects/bb58536c9a7046baa8e219715bc29553` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:40.189729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3e7be-cda0-45b6-bd4d-abfdf4c79358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb58536c9a7046baa8e219715bc29553)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:40.191846 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3e7be-cda0-45b6-bd4d-abfdf4c79358 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:40.229206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0c3dbbb0-5d1e-4bbf-ad1b-25837c5ee93a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44876d48b94b4f6fad60e8632aef01ae', 'request_id': 'req-0c3dbbb0-5d1e-4bbf-ad1b-25837c5ee93a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:40.239840 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0c3dbbb0-5d1e-4bbf-ad1b-25837c5ee93a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44876d48b94b4f6fad60e8632aef01ae', 'request_id': 'req-0c3dbbb0-5d1e-4bbf-ad1b-25837c5ee93a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:40.250437 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0c3dbbb0-5d1e-4bbf-ad1b-25837c5ee93a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44876d48b94b4f6fad60e8632aef01ae', 'request_id': 'req-0c3dbbb0-5d1e-4bbf-ad1b-25837c5ee93a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:40.259352 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d1c3e7be-cda0-45b6-bd4d-abfdf4c79358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb58536c9a7046baa8e219715bc29553', 'request_id': 'req-d1c3e7be-cda0-45b6-bd4d-abfdf4c79358'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:40.261535 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:40.263098 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0c3dbbb0-5d1e-4bbf-ad1b-25837c5ee93a admin admin] The token cache is being invalidate because project 44876d48b94b4f6fad60e8632aef01ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:40.263577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0c3dbbb0-5d1e-4bbf-ad1b-25837c5ee93a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:40.264463 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0c3dbbb0-5d1e-4bbf-ad1b-25837c5ee93a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:40.266217 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1280/2542] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:39 2022] DELETE /identity/v3/projects/44876d48b94b4f6fad60e8632aef01ae => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:40.267861 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe80aa-6ec8-4ea3-bc88-c10900017b00 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:40.268146 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe80aa-6ec8-4ea3-bc88-c10900017b00 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:40.268418 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe80aa-6ec8-4ea3-bc88-c10900017b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:40.275077 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d1c3e7be-cda0-45b6-bd4d-abfdf4c79358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb58536c9a7046baa8e219715bc29553', 'request_id': 'req-d1c3e7be-cda0-45b6-bd4d-abfdf4c79358'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:40.285790 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d1c3e7be-cda0-45b6-bd4d-abfdf4c79358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb58536c9a7046baa8e219715bc29553', 'request_id': 'req-d1c3e7be-cda0-45b6-bd4d-abfdf4c79358'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:40.294312 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-82fe80aa-6ec8-4ea3-bc88-c10900017b00 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:40.295672 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-82fe80aa-6ec8-4ea3-bc88-c10900017b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:40.307566 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d1c3e7be-cda0-45b6-bd4d-abfdf4c79358 admin admin] The token cache is being invalidate because project bb58536c9a7046baa8e219715bc29553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:40.307566 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d1c3e7be-cda0-45b6-bd4d-abfdf4c79358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:40.308697 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d1c3e7be-cda0-45b6-bd4d-abfdf4c79358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:40.311443 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1263/2543] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:40 2022] DELETE /identity/v3/projects/bb58536c9a7046baa8e219715bc29553 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:40.313637 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3089d96-9a6a-4631-9c6d-ba8603e31d3f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:40.314130 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3089d96-9a6a-4631-9c6d-ba8603e31d3f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:40.314603 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3089d96-9a6a-4631-9c6d-ba8603e31d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:40.341881 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e3089d96-9a6a-4631-9c6d-ba8603e31d3f None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:40.343150 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e3089d96-9a6a-4631-9c6d-ba8603e31d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:40.383456 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1281/2544] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:40.385740 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b60d81-4b31-40e6-a305-986109abc96c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:40.386190 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b60d81-4b31-40e6-a305-986109abc96c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:40.386945 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b60d81-4b31-40e6-a305-986109abc96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:40.410656 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-94b60d81-4b31-40e6-a305-986109abc96c None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:40.412588 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-94b60d81-4b31-40e6-a305-986109abc96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:40.421087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1282/2545] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:40.421980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b60d81-4b31-40e6-a305-986109abc96c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:40.424106 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1264/2546] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:40.433668 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b60d81-4b31-40e6-a305-986109abc96c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:40.433941 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8264290-9214-43c0-a46f-f1089301ab39 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:40.434076 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8264290-9214-43c0-a46f-f1089301ab39 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:40.434291 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8264290-9214-43c0-a46f-f1089301ab39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:40.438876 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab00682-e5cd-4b54-b5f7-df255c58754a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:40.439381 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab00682-e5cd-4b54-b5f7-df255c58754a admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:40.439658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab00682-e5cd-4b54-b5f7-df255c58754a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:40.439938 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab00682-e5cd-4b54-b5f7-df255c58754a admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:40.440655 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab00682-e5cd-4b54-b5f7-df255c58754a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:42:40.440954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab00682-e5cd-4b54-b5f7-df255c58754a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:40.442663 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab00682-e5cd-4b54-b5f7-df255c58754a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:40.455948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-d8264290-9214-43c0-a46f-f1089301ab39 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:40.456869 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1283/2547] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:42:40.457237 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d8264290-9214-43c0-a46f-f1089301ab39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:40.457980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06020c-741d-4c53-87e5-68120e7892b0 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:40.458269 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06020c-741d-4c53-87e5-68120e7892b0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:40.458546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06020c-741d-4c53-87e5-68120e7892b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:40.468540 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1265/2548] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:40.469689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8264290-9214-43c0-a46f-f1089301ab39 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:40.480754 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6d06020c-741d-4c53-87e5-68120e7892b0 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:40.482020 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6d06020c-741d-4c53-87e5-68120e7892b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:40.483418 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8264290-9214-43c0-a46f-f1089301ab39 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:40.497257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81339b-006d-4550-ab98-c8cba88350a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:40.497658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1284/2549] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:40.498546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06020c-741d-4c53-87e5-68120e7892b0 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:40.501706 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81339b-006d-4550-ab98-c8cba88350a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:40.502179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81339b-006d-4550-ab98-c8cba88350a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:40.502665 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81339b-006d-4550-ab98-c8cba88350a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:40.503638 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81339b-006d-4550-ab98-c8cba88350a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:40.503977 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:40.507034 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81339b-006d-4550-ab98-c8cba88350a8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:40.511410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06020c-741d-4c53-87e5-68120e7892b0 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:40.518989 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f5b87-3bb1-4052-af21-b03129b5a0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:40.519789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f5b87-3bb1-4052-af21-b03129b5a0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:40.520159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f5b87-3bb1-4052-af21-b03129b5a0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:40.520512 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f5b87-3bb1-4052-af21-b03129b5a0a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:40.522108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f5b87-3bb1-4052-af21-b03129b5a0a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:42:40.522512 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f5b87-3bb1-4052-af21-b03129b5a0a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:40.524892 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f5b87-3bb1-4052-af21-b03129b5a0a8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:40.542308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1285/2550] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:42:40.543039 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f5b87-3bb1-4052-af21-b03129b5a0a8 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:40.548944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1266/2551] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:40 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:40.550419 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81339b-006d-4550-ab98-c8cba88350a8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:40.557957 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f5b87-3bb1-4052-af21-b03129b5a0a8 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:40.637666 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cac467-9e6c-4c66-8965-5a1f1cb26371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:40.638360 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cac467-9e6c-4c66-8965-5a1f1cb26371 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:40.638708 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cac467-9e6c-4c66-8965-5a1f1cb26371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:40.639095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cac467-9e6c-4c66-8965-5a1f1cb26371 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:40.639838 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cac467-9e6c-4c66-8965-5a1f1cb26371 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:42:40.640210 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cac467-9e6c-4c66-8965-5a1f1cb26371 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:40.642632 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cac467-9e6c-4c66-8965-5a1f1cb26371 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:40.644108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81339b-006d-4550-ab98-c8cba88350a8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:40.650268 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11654227-50fe-48c3-8316-097f64aad7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:40.651130 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11654227-50fe-48c3-8316-097f64aad7bc admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:40.651509 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11654227-50fe-48c3-8316-097f64aad7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:40.651925 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11654227-50fe-48c3-8316-097f64aad7bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:40.652852 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11654227-50fe-48c3-8316-097f64aad7bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:40.654965 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11654227-50fe-48c3-8316-097f64aad7bc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:40.657299 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1286/2552] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:42:40.658341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cac467-9e6c-4c66-8965-5a1f1cb26371 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:40.672547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cac467-9e6c-4c66-8965-5a1f1cb26371 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:40.678161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1ab56-33dd-498c-a154-58e2b72b2537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:40.679108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1ab56-33dd-498c-a154-58e2b72b2537 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:40.679547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1ab56-33dd-498c-a154-58e2b72b2537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:40.679992 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1ab56-33dd-498c-a154-58e2b72b2537 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:40.681092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1ab56-33dd-498c-a154-58e2b72b2537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:40.684562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1ab56-33dd-498c-a154-58e2b72b2537 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:40.692443 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1267/2553] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:40 2022] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:40.693658 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11654227-50fe-48c3-8316-097f64aad7bc admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:40.716954 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1287/2554] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:40 2022] POST /identity/v3/users => generated 293 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:40.718351 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1ab56-33dd-498c-a154-58e2b72b2537 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:40.735042 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1ab56-33dd-498c-a154-58e2b72b2537 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:40.760052 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:40.791647 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11654227-50fe-48c3-8316-097f64aad7bc admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:40.796999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0a03d-bca1-4b1c-b675-90b919cfd41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:40.797649 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0a03d-bca1-4b1c-b675-90b919cfd41b admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:40.797923 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0a03d-bca1-4b1c-b675-90b919cfd41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:40.798197 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0a03d-bca1-4b1c-b675-90b919cfd41b admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:40.798857 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0a03d-bca1-4b1c-b675-90b919cfd41b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:40.800865 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0a03d-bca1-4b1c-b675-90b919cfd41b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:40.809786 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de740b-f4b4-4c28-82f5-63faabf73480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:40.810409 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de740b-f4b4-4c28-82f5-63faabf73480 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:40.810693 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de740b-f4b4-4c28-82f5-63faabf73480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:40.810992 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de740b-f4b4-4c28-82f5-63faabf73480 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:40.811650 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de740b-f4b4-4c28-82f5-63faabf73480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:40.813731 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de740b-f4b4-4c28-82f5-63faabf73480 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:40.834489 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1268/2555] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:40 2022] POST /identity/v3/projects => generated 389 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:40.835144 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0a03d-bca1-4b1c-b675-90b919cfd41b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:40.842283 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1288/2556] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:40 2022] POST /identity/v3/users => generated 286 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:40.843100 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de740b-f4b4-4c28-82f5-63faabf73480 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:40.854675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de740b-f4b4-4c28-82f5-63faabf73480 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:40.918832 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:40.924014 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0a03d-bca1-4b1c-b675-90b919cfd41b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:40.929797 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87f044-c9f1-43b8-baf0-0f5a7ae796ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:40.931105 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87f044-c9f1-43b8-baf0-0f5a7ae796ba admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:40.931231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab9fc0-1e2b-4b6d-ac4f-2f2e4099db14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:40.931562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87f044-c9f1-43b8-baf0-0f5a7ae796ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:40.932070 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87f044-c9f1-43b8-baf0-0f5a7ae796ba admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:40.932286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab9fc0-1e2b-4b6d-ac4f-2f2e4099db14 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:40.932769 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab9fc0-1e2b-4b6d-ac4f-2f2e4099db14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:40.933201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab9fc0-1e2b-4b6d-ac4f-2f2e4099db14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:40.933314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87f044-c9f1-43b8-baf0-0f5a7ae796ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:40.934272 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab9fc0-1e2b-4b6d-ac4f-2f2e4099db14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:40.936727 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87f044-c9f1-43b8-baf0-0f5a7ae796ba admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:40.937048 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab9fc0-1e2b-4b6d-ac4f-2f2e4099db14 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:40.951343 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1269/2557] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:40.953216 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab9fc0-1e2b-4b6d-ac4f-2f2e4099db14 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:40.963071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1289/2558] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:40 2022] POST /identity/v3/users => generated 295 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:40.964041 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87f044-c9f1-43b8-baf0-0f5a7ae796ba admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:40.970424 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab9fc0-1e2b-4b6d-ac4f-2f2e4099db14 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:40.976929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7da03-fb7e-461f-a700-32815c9060a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:40.977605 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7da03-fb7e-461f-a700-32815c9060a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:40.977950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7da03-fb7e-461f-a700-32815c9060a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:40.978276 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7da03-fb7e-461f-a700-32815c9060a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:40.979021 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7da03-fb7e-461f-a700-32815c9060a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:40.979739 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87f044-c9f1-43b8-baf0-0f5a7ae796ba admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:40.981173 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7da03-fb7e-461f-a700-32815c9060a8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:40.985909 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f6801-ba1b-4dcd-8a31-c583d619c3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:40.986542 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f6801-ba1b-4dcd-8a31-c583d619c3cf admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:40.986823 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f6801-ba1b-4dcd-8a31-c583d619c3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:40.987101 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f6801-ba1b-4dcd-8a31-c583d619c3cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:40.987764 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f6801-ba1b-4dcd-8a31-c583d619c3cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:40.990196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f6801-ba1b-4dcd-8a31-c583d619c3cf admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:40.994460 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1270/2559] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:40.995594 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7da03-fb7e-461f-a700-32815c9060a8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:41.002459 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1290/2560] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:41.002459 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f6801-ba1b-4dcd-8a31-c583d619c3cf admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:41.012895 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7da03-fb7e-461f-a700-32815c9060a8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:41.014492 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f6801-ba1b-4dcd-8a31-c583d619c3cf admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:41.018788 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84eefa7-3109-4a2c-b3a8-9362595d0da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:41.019526 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84eefa7-3109-4a2c-b3a8-9362595d0da9 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:41.019777 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff379b0-1e68-4e88-b3f8-7b2d5b8e1fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:41.019944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84eefa7-3109-4a2c-b3a8-9362595d0da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:41.020231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84eefa7-3109-4a2c-b3a8-9362595d0da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:41.020392 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff379b0-1e68-4e88-b3f8-7b2d5b8e1fac admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:41.020748 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff379b0-1e68-4e88-b3f8-7b2d5b8e1fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:41.021040 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff379b0-1e68-4e88-b3f8-7b2d5b8e1fac admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:41.021443 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84eefa7-3109-4a2c-b3a8-9362595d0da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:41.021756 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff379b0-1e68-4e88-b3f8-7b2d5b8e1fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:41.023393 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff379b0-1e68-4e88-b3f8-7b2d5b8e1fac admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:41.023528 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84eefa7-3109-4a2c-b3a8-9362595d0da9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:41.035061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1271/2561] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:41.035524 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1291/2562] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:41.038161 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84eefa7-3109-4a2c-b3a8-9362595d0da9 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:41.040470 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff379b0-1e68-4e88-b3f8-7b2d5b8e1fac admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:41.052357 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84eefa7-3109-4a2c-b3a8-9362595d0da9 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:41.057678 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e29f3-155c-467a-9c44-dc77c2f001b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:41.058357 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e29f3-155c-467a-9c44-dc77c2f001b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:41.058638 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e29f3-155c-467a-9c44-dc77c2f001b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:41.058911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e29f3-155c-467a-9c44-dc77c2f001b9 admin admin] PATH_INFO: `/v3/projects/25346b478dfb4751bf74d17f96cb7119/users/e16d937024a844469cc3de233ea2ddf5/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:41.059546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff379b0-1e68-4e88-b3f8-7b2d5b8e1fac admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:41.064467 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d4aa6-36ee-4a30-be5c-883b75e03969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:41.065124 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d4aa6-36ee-4a30-be5c-883b75e03969 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:41.065402 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d4aa6-36ee-4a30-be5c-883b75e03969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:41.065672 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d4aa6-36ee-4a30-be5c-883b75e03969 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:41.066326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d4aa6-36ee-4a30-be5c-883b75e03969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:41.068550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d4aa6-36ee-4a30-be5c-883b75e03969 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:41.077341 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e29f3-155c-467a-9c44-dc77c2f001b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25346b478dfb4751bf74d17f96cb7119, user_id=e16d937024a844469cc3de233ea2ddf5, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:41.080088 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1292/2563] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:41.080294 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e29f3-155c-467a-9c44-dc77c2f001b9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:41.080675 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d4aa6-36ee-4a30-be5c-883b75e03969 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:41.097860 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1272/2564] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:41 2022] PUT /identity/v3/projects/25346b478dfb4751bf74d17f96cb7119/users/e16d937024a844469cc3de233ea2ddf5/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:41.113026 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e29f3-155c-467a-9c44-dc77c2f001b9 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:41.113739 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d4aa6-36ee-4a30-be5c-883b75e03969 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:41.197917 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e29f3-155c-467a-9c44-dc77c2f001b9 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:41.199013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5b38e-3b5f-4221-a94a-604b99576c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:41.199696 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5b38e-3b5f-4221-a94a-604b99576c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:41.199976 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5b38e-3b5f-4221-a94a-604b99576c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:41.200261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5b38e-3b5f-4221-a94a-604b99576c07 admin admin] PATH_INFO: `/v3/projects/dccf7f8b235847fa92205207ed2a510b/users/439188ac0692478fb4159e8fc25a7e77/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:41.204399 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3565878-7786-44f2-8e04-04c7d411a246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:41.205681 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3565878-7786-44f2-8e04-04c7d411a246 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:41.206029 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3565878-7786-44f2-8e04-04c7d411a246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:41.206491 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3565878-7786-44f2-8e04-04c7d411a246 admin admin] PATH_INFO: `/v3/projects/7b4b37ef68f44e92bcffbf9d3e10195a/users/4c267a87fd314fb88e37f246b79bf377/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:41.218164 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5b38e-3b5f-4221-a94a-604b99576c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dccf7f8b235847fa92205207ed2a510b, user_id=439188ac0692478fb4159e8fc25a7e77, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:41.220983 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5b38e-3b5f-4221-a94a-604b99576c07 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:41.225083 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3565878-7786-44f2-8e04-04c7d411a246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b4b37ef68f44e92bcffbf9d3e10195a, user_id=4c267a87fd314fb88e37f246b79bf377, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:41.228433 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3565878-7786-44f2-8e04-04c7d411a246 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:41.231411 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:41.237498 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1293/2565] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:41 2022] PUT /identity/v3/projects/dccf7f8b235847fa92205207ed2a510b/users/439188ac0692478fb4159e8fc25a7e77/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:41.242174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d5b1c-c4fb-402a-aa5c-361a5b28f311 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:41.242522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d5b1c-c4fb-402a-aa5c-361a5b28f311 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:41.242727 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d5b1c-c4fb-402a-aa5c-361a5b28f311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:41.254223 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1273/2566] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:41 2022] PUT /identity/v3/projects/7b4b37ef68f44e92bcffbf9d3e10195a/users/4c267a87fd314fb88e37f246b79bf377/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:41.256088 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fec0c0-4d18-409b-89c5-8b6551b999fe None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:41.256556 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fec0c0-4d18-409b-89c5-8b6551b999fe None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:41.257069 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fec0c0-4d18-409b-89c5-8b6551b999fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:41.276230 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5c9d5b1c-c4fb-402a-aa5c-361a5b28f311 None None] MFA Rules not processed for user `e16d937024a844469cc3de233ea2ddf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:41.277545 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5c9d5b1c-c4fb-402a-aa5c-361a5b28f311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:41.291318 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-31fec0c0-4d18-409b-89c5-8b6551b999fe None None] MFA Rules not processed for user `439188ac0692478fb4159e8fc25a7e77`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:41.293538 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-31fec0c0-4d18-409b-89c5-8b6551b999fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:41.363665 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1294/2567] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:41.365490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683654c6-7e4a-4096-b516-f0393b2f272a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:41.365896 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683654c6-7e4a-4096-b516-f0393b2f272a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:41.366149 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683654c6-7e4a-4096-b516-f0393b2f272a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:41.380465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1274/2568] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:41.382071 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fec0c0-4d18-409b-89c5-8b6551b999fe None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:41.400848 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-683654c6-7e4a-4096-b516-f0393b2f272a None None] MFA Rules not processed for user `4c267a87fd314fb88e37f246b79bf377`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:41.402136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-683654c6-7e4a-4096-b516-f0393b2f272a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:41.415452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:41.469170 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fec0c0-4d18-409b-89c5-8b6551b999fe None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:41.474698 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5d180-c482-4b06-8072-89180a0735d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:41.475344 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5d180-c482-4b06-8072-89180a0735d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:41.475624 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5d180-c482-4b06-8072-89180a0735d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:41.475899 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5d180-c482-4b06-8072-89180a0735d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:41.476563 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5d180-c482-4b06-8072-89180a0735d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:41.478685 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5d180-c482-4b06-8072-89180a0735d1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:41.485695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1295/2569] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:41.486551 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683654c6-7e4a-4096-b516-f0393b2f272a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:41.502190 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683654c6-7e4a-4096-b516-f0393b2f272a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:41.508259 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209dfe5-3f77-4440-a03b-18fee47be8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:41.509138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209dfe5-3f77-4440-a03b-18fee47be8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:41.509554 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209dfe5-3f77-4440-a03b-18fee47be8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:41.509937 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209dfe5-3f77-4440-a03b-18fee47be8c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:41.510677 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209dfe5-3f77-4440-a03b-18fee47be8c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:41.513064 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209dfe5-3f77-4440-a03b-18fee47be8c1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:41.513223 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1275/2570] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:41 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:41.513958 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5d180-c482-4b06-8072-89180a0735d1 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:41.554679 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1296/2571] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:41 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:41.556076 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209dfe5-3f77-4440-a03b-18fee47be8c1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:41.596519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5d180-c482-4b06-8072-89180a0735d1 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:41.611689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:41.635447 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209dfe5-3f77-4440-a03b-18fee47be8c1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:41.640868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec597bf-5607-4e58-b51c-5f2a5759c256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:41.641497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec597bf-5607-4e58-b51c-5f2a5759c256 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:41.642042 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec597bf-5607-4e58-b51c-5f2a5759c256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:41.642366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec597bf-5607-4e58-b51c-5f2a5759c256 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:41.642965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec597bf-5607-4e58-b51c-5f2a5759c256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:41.645094 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec597bf-5607-4e58-b51c-5f2a5759c256 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:41.670741 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1297/2572] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:41 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:41.672241 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec597bf-5607-4e58-b51c-5f2a5759c256 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:41.679454 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2f0e0-85dd-4d51-8fb3-0c4991ed0f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:41.679454 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2f0e0-85dd-4d51-8fb3-0c4991ed0f6d admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:41.679454 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2f0e0-85dd-4d51-8fb3-0c4991ed0f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:41.679454 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2f0e0-85dd-4d51-8fb3-0c4991ed0f6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:41.680345 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2f0e0-85dd-4d51-8fb3-0c4991ed0f6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:41.683923 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2f0e0-85dd-4d51-8fb3-0c4991ed0f6d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:41.690026 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec597bf-5607-4e58-b51c-5f2a5759c256 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:41.697418 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81e23e-d272-41e4-b7b1-12e22c3c103e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:41.698211 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81e23e-d272-41e4-b7b1-12e22c3c103e admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:41.699459 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81e23e-d272-41e4-b7b1-12e22c3c103e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:41.699459 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81e23e-d272-41e4-b7b1-12e22c3c103e admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:41.700034 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81e23e-d272-41e4-b7b1-12e22c3c103e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:41.702942 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81e23e-d272-41e4-b7b1-12e22c3c103e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:41.727759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1276/2573] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:41 2022] POST /identity/v3/projects => generated 393 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:41.727759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2f0e0-85dd-4d51-8fb3-0c4991ed0f6d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:41.733090 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1298/2574] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:41 2022] POST /identity/v3/users => generated 292 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:41.733090 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81e23e-d272-41e4-b7b1-12e22c3c103e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:41.741395 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81e23e-d272-41e4-b7b1-12e22c3c103e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:41.805538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daead46c-1712-4e28-a3c1-fd646063a2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:41.806158 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daead46c-1712-4e28-a3c1-fd646063a2fd admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:41.806450 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daead46c-1712-4e28-a3c1-fd646063a2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:41.806839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daead46c-1712-4e28-a3c1-fd646063a2fd admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:41.807400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daead46c-1712-4e28-a3c1-fd646063a2fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:41.809457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daead46c-1712-4e28-a3c1-fd646063a2fd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:41.809741 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2f0e0-85dd-4d51-8fb3-0c4991ed0f6d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:41.814856 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effe2c3-0629-4427-9907-ff17ded66bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:41.815519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effe2c3-0629-4427-9907-ff17ded66bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:41.815800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effe2c3-0629-4427-9907-ff17ded66bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:41.816074 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effe2c3-0629-4427-9907-ff17ded66bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:41.816980 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effe2c3-0629-4427-9907-ff17ded66bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:41.819234 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effe2c3-0629-4427-9907-ff17ded66bd7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:41.821415 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:41.837435 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1277/2575] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:41.837435 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effe2c3-0629-4427-9907-ff17ded66bd7 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:41.837867 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1299/2576] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:41 2022] POST /identity/v3/users => generated 303 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:41.839340 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daead46c-1712-4e28-a3c1-fd646063a2fd admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:41.851371 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daead46c-1712-4e28-a3c1-fd646063a2fd admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:41.852785 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effe2c3-0629-4427-9907-ff17ded66bd7 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:41.856885 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02610e-b264-4e8e-9d21-25b051138be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:41.857545 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02610e-b264-4e8e-9d21-25b051138be8 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:41.857822 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02610e-b264-4e8e-9d21-25b051138be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:41.858122 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02610e-b264-4e8e-9d21-25b051138be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:41.858937 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02610e-b264-4e8e-9d21-25b051138be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:41.859399 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692e637-3bcd-47d9-a855-61ccea817d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:41.860200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692e637-3bcd-47d9-a855-61ccea817d36 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:41.860534 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692e637-3bcd-47d9-a855-61ccea817d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:41.860666 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02610e-b264-4e8e-9d21-25b051138be8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:41.860907 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692e637-3bcd-47d9-a855-61ccea817d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:41.861634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692e637-3bcd-47d9-a855-61ccea817d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:41.863940 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692e637-3bcd-47d9-a855-61ccea817d36 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:41.876207 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1300/2577] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:42:41.877467 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02610e-b264-4e8e-9d21-25b051138be8 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:41.878353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1278/2578] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:41.883601 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692e637-3bcd-47d9-a855-61ccea817d36 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:41.892860 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02610e-b264-4e8e-9d21-25b051138be8 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:41.897832 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692e637-3bcd-47d9-a855-61ccea817d36 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:41.898127 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94577005-b62b-4282-b3f3-db88617ce566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:41.898720 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94577005-b62b-4282-b3f3-db88617ce566 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:41.898995 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94577005-b62b-4282-b3f3-db88617ce566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:41.899349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94577005-b62b-4282-b3f3-db88617ce566 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:41.899915 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94577005-b62b-4282-b3f3-db88617ce566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:41.901607 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94577005-b62b-4282-b3f3-db88617ce566 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:41.902758 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6134fa-4754-4fa3-ac2b-eec7e6533d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:41.903440 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6134fa-4754-4fa3-ac2b-eec7e6533d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:41.903759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6134fa-4754-4fa3-ac2b-eec7e6533d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:41.904167 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6134fa-4754-4fa3-ac2b-eec7e6533d08 admin admin] PATH_INFO: `/v3/projects/aef2f60d7e2b4dc4bdb90491bf19f459/users/1ef0a877c0df4526b1c115e8b839cde0/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:41.914203 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1301/2579] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:41.915252 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94577005-b62b-4282-b3f3-db88617ce566 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:41.925450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6134fa-4754-4fa3-ac2b-eec7e6533d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aef2f60d7e2b4dc4bdb90491bf19f459, user_id=1ef0a877c0df4526b1c115e8b839cde0, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:41.928779 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6134fa-4754-4fa3-ac2b-eec7e6533d08 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:41.929453 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94577005-b62b-4282-b3f3-db88617ce566 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:41.934666 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8f9ee-238d-40de-99a3-31017c918ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:41.935363 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8f9ee-238d-40de-99a3-31017c918ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:41.935642 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8f9ee-238d-40de-99a3-31017c918ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:41.935917 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8f9ee-238d-40de-99a3-31017c918ed2 admin admin] PATH_INFO: `/v3/projects/44fe8e1fc7824c4c957f9496c2e77eeb/users/8d4b03b281d240f0aab5ec9c13c9e710/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:41.946453 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1279/2580] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:41 2022] PUT /identity/v3/projects/aef2f60d7e2b4dc4bdb90491bf19f459/users/1ef0a877c0df4526b1c115e8b839cde0/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:41.947399 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6134fa-4754-4fa3-ac2b-eec7e6533d08 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:41.955470 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8f9ee-238d-40de-99a3-31017c918ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44fe8e1fc7824c4c957f9496c2e77eeb, user_id=8d4b03b281d240f0aab5ec9c13c9e710, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:41.958369 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8f9ee-238d-40de-99a3-31017c918ed2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:41.994528 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1302/2581] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:41 2022] PUT /identity/v3/projects/44fe8e1fc7824c4c957f9496c2e77eeb/users/8d4b03b281d240f0aab5ec9c13c9e710/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:41.994528 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8f9ee-238d-40de-99a3-31017c918ed2 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:42.054985 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6134fa-4754-4fa3-ac2b-eec7e6533d08 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:42.063310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:42.077352 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8f9ee-238d-40de-99a3-31017c918ed2 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:42.090526 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b86dda-b84e-4e6d-8f07-ec5c384559d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:42.091300 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b86dda-b84e-4e6d-8f07-ec5c384559d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:42.091645 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b86dda-b84e-4e6d-8f07-ec5c384559d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:42.092147 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b86dda-b84e-4e6d-8f07-ec5c384559d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:42.092969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b86dda-b84e-4e6d-8f07-ec5c384559d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:42.095013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b86dda-b84e-4e6d-8f07-ec5c384559d3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:42.108556 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1303/2582] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:42.110129 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596822e-b0f4-4e1d-90e2-8487aa266a62 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:42.110612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596822e-b0f4-4e1d-90e2-8487aa266a62 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:42.111159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596822e-b0f4-4e1d-90e2-8487aa266a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:42.140269 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2a072-59e8-4f5f-8a64-649c72fce9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:42.141394 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2a072-59e8-4f5f-8a64-649c72fce9f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:42.142095 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2a072-59e8-4f5f-8a64-649c72fce9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:42.142503 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2a072-59e8-4f5f-8a64-649c72fce9f1 admin admin] PATH_INFO: `/v3/projects/1e646dfb700c4f5783bce3eefb7a9f2c/users/c55b5fad2d1e49258d6c46a1c33ea9b8/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:42.152540 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e596822e-b0f4-4e1d-90e2-8487aa266a62 None None] MFA Rules not processed for user `8d4b03b281d240f0aab5ec9c13c9e710`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:42.154091 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e596822e-b0f4-4e1d-90e2-8487aa266a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:42.165351 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2a072-59e8-4f5f-8a64-649c72fce9f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e646dfb700c4f5783bce3eefb7a9f2c, user_id=c55b5fad2d1e49258d6c46a1c33ea9b8, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:42.168838 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2a072-59e8-4f5f-8a64-649c72fce9f1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:42.189320 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1280/2583] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:41 2022] PUT /identity/v3/projects/1e646dfb700c4f5783bce3eefb7a9f2c/users/c55b5fad2d1e49258d6c46a1c33ea9b8/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:42.190837 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2a072-59e8-4f5f-8a64-649c72fce9f1 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:42.256661 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1304/2584] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:42.258337 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596822e-b0f4-4e1d-90e2-8487aa266a62 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:42.274969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596822e-b0f4-4e1d-90e2-8487aa266a62 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:42.281251 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb38877-6e28-471c-a5da-8401274ac276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:42.282109 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb38877-6e28-471c-a5da-8401274ac276 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:42.282452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb38877-6e28-471c-a5da-8401274ac276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:42.282790 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb38877-6e28-471c-a5da-8401274ac276 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:42.283551 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb38877-6e28-471c-a5da-8401274ac276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:42.284758 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2a072-59e8-4f5f-8a64-649c72fce9f1 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:42.285474 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb38877-6e28-471c-a5da-8401274ac276 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:42.291727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51168e48-9304-4255-9799-fa4fc60554da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:42.292506 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51168e48-9304-4255-9799-fa4fc60554da admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:42.292729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51168e48-9304-4255-9799-fa4fc60554da admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:42.293002 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51168e48-9304-4255-9799-fa4fc60554da admin admin] PATH_INFO: `/v3/projects/aef2f60d7e2b4dc4bdb90491bf19f459/users/1ef0a877c0df4526b1c115e8b839cde0/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:42.295664 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51168e48-9304-4255-9799-fa4fc60554da admin admin] RBAC: Authorizing `identity:create_grant(project_id=aef2f60d7e2b4dc4bdb90491bf19f459, user_id=1ef0a877c0df4526b1c115e8b839cde0, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:42.298508 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51168e48-9304-4255-9799-fa4fc60554da admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:42.305001 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1305/2585] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:42.305001 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb38877-6e28-471c-a5da-8401274ac276 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:42.312162 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1281/2586] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:42 2022] PUT /identity/v3/projects/aef2f60d7e2b4dc4bdb90491bf19f459/users/1ef0a877c0df4526b1c115e8b839cde0/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:42.313063 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51168e48-9304-4255-9799-fa4fc60554da admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:42.324723 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb38877-6e28-471c-a5da-8401274ac276 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:42.360869 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:42.402678 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51168e48-9304-4255-9799-fa4fc60554da admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:42.410748 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e70e50-4cf9-4b5e-9891-79b67720994d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:42.412429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e70e50-4cf9-4b5e-9891-79b67720994d admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:42.412941 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e70e50-4cf9-4b5e-9891-79b67720994d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:42.413308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52fb1e-bdb5-45e0-97b3-61dfa1abbd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:42.413484 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e70e50-4cf9-4b5e-9891-79b67720994d admin admin] PATH_INFO: `/v3/projects/1e646dfb700c4f5783bce3eefb7a9f2c/users/c55b5fad2d1e49258d6c46a1c33ea9b8/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:42.413938 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52fb1e-bdb5-45e0-97b3-61dfa1abbd0c admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:42.414240 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52fb1e-bdb5-45e0-97b3-61dfa1abbd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:42.414515 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52fb1e-bdb5-45e0-97b3-61dfa1abbd0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:42.415131 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52fb1e-bdb5-45e0-97b3-61dfa1abbd0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:42.416822 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e70e50-4cf9-4b5e-9891-79b67720994d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e646dfb700c4f5783bce3eefb7a9f2c, user_id=c55b5fad2d1e49258d6c46a1c33ea9b8, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:42.417154 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52fb1e-bdb5-45e0-97b3-61dfa1abbd0c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:42.421978 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e70e50-4cf9-4b5e-9891-79b67720994d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:42.441478 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1282/2587] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:42 2022] PUT /identity/v3/projects/1e646dfb700c4f5783bce3eefb7a9f2c/users/c55b5fad2d1e49258d6c46a1c33ea9b8/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:42.443711 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780991d-4b83-4ebe-b35a-2f45493ab66c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:42.444184 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780991d-4b83-4ebe-b35a-2f45493ab66c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:42.444684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780991d-4b83-4ebe-b35a-2f45493ab66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:42.459650 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1306/2588] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:42 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:42.461472 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04170ec9-85b9-48fb-a1c4-ad8f209b78e2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:42.462052 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04170ec9-85b9-48fb-a1c4-ad8f209b78e2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:42.462546 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04170ec9-85b9-48fb-a1c4-ad8f209b78e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:42.494142 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f780991d-4b83-4ebe-b35a-2f45493ab66c None None] MFA Rules not processed for user `1ef0a877c0df4526b1c115e8b839cde0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:42.495419 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f780991d-4b83-4ebe-b35a-2f45493ab66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:42.497366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-04170ec9-85b9-48fb-a1c4-ad8f209b78e2 None None] MFA Rules not processed for user `c55b5fad2d1e49258d6c46a1c33ea9b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:42.499312 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-04170ec9-85b9-48fb-a1c4-ad8f209b78e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:42.505919 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:42.597691 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1283/2589] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:42.599058 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780991d-4b83-4ebe-b35a-2f45493ab66c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:42.600609 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1307/2590] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:42 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:42.617051 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04170ec9-85b9-48fb-a1c4-ad8f209b78e2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:42.619347 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-04170ec9-85b9-48fb-a1c4-ad8f209b78e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:42.681485 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780991d-4b83-4ebe-b35a-2f45493ab66c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:42.686746 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263885c-0acd-446c-be20-e4ed5afbda3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:42.687377 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263885c-0acd-446c-be20-e4ed5afbda3d admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:42.687650 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263885c-0acd-446c-be20-e4ed5afbda3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:42.687949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263885c-0acd-446c-be20-e4ed5afbda3d admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:42.688648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263885c-0acd-446c-be20-e4ed5afbda3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:42.690669 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263885c-0acd-446c-be20-e4ed5afbda3d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:42.695095 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04170ec9-85b9-48fb-a1c4-ad8f209b78e2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:42.701510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259be8d-db24-478f-9f89-34e0b5f4c229 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:42.702557 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259be8d-db24-478f-9f89-34e0b5f4c229 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:42.703046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259be8d-db24-478f-9f89-34e0b5f4c229 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:42.703534 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259be8d-db24-478f-9f89-34e0b5f4c229 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:42.720124 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259be8d-db24-478f-9f89-34e0b5f4c229 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:42.720417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1284/2591] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:42 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:42.721873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263885c-0acd-446c-be20-e4ed5afbda3d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:42.722345 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259be8d-db24-478f-9f89-34e0b5f4c229 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:42.725244 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a263885c-0acd-446c-be20-e4ed5afbda3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:42.736226 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1308/2592] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:42 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:42:42.737354 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259be8d-db24-478f-9f89-34e0b5f4c229 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:42.747929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263885c-0acd-446c-be20-e4ed5afbda3d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:42.755191 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b57a88-21ff-4c40-b528-bb201dda2595 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:42.756222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b57a88-21ff-4c40-b528-bb201dda2595 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:42.756602 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259be8d-db24-478f-9f89-34e0b5f4c229 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:42.756817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b57a88-21ff-4c40-b528-bb201dda2595 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:42.757182 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b57a88-21ff-4c40-b528-bb201dda2595 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:42.766340 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f01a1-8593-44bc-8c23-d3afdea7b959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:42.767981 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f01a1-8593-44bc-8c23-d3afdea7b959 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:42.768443 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f01a1-8593-44bc-8c23-d3afdea7b959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:42.768961 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f01a1-8593-44bc-8c23-d3afdea7b959 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:42.769963 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f01a1-8593-44bc-8c23-d3afdea7b959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:42.773669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f01a1-8593-44bc-8c23-d3afdea7b959 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:42.774878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b57a88-21ff-4c40-b528-bb201dda2595 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:42.777664 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b57a88-21ff-4c40-b528-bb201dda2595 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:42.795865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1309/2593] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:42.797261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f01a1-8593-44bc-8c23-d3afdea7b959 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:42.804258 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1285/2594] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:42.814097 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b57a88-21ff-4c40-b528-bb201dda2595 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:42.815074 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f01a1-8593-44bc-8c23-d3afdea7b959 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:42.822056 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0721cb-d26f-4f70-a19a-42350c2cb329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:42.822923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0721cb-d26f-4f70-a19a-42350c2cb329 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:42.825313 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0721cb-d26f-4f70-a19a-42350c2cb329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:42.825863 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0721cb-d26f-4f70-a19a-42350c2cb329 admin admin] PATH_INFO: `/v3/projects/8364e1a812724082826171204a2652d2/users/c9e127ef392f4bb0947f6e3a5837f1f3/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:42.833148 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b57a88-21ff-4c40-b528-bb201dda2595 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:42.846160 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b345d-baca-4ddc-b223-c628bf59a6b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:42.846791 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b345d-baca-4ddc-b223-c628bf59a6b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:42.847065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b345d-baca-4ddc-b223-c628bf59a6b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:42.847330 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b345d-baca-4ddc-b223-c628bf59a6b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:42.850030 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0721cb-d26f-4f70-a19a-42350c2cb329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8364e1a812724082826171204a2652d2, user_id=c9e127ef392f4bb0947f6e3a5837f1f3, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:42.854075 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0721cb-d26f-4f70-a19a-42350c2cb329 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:42.871153 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:42.884792 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1310/2595] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:42 2022] PUT /identity/v3/projects/8364e1a812724082826171204a2652d2/users/c9e127ef392f4bb0947f6e3a5837f1f3/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:42.889844 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0721cb-d26f-4f70-a19a-42350c2cb329 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:42.964444 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b345d-baca-4ddc-b223-c628bf59a6b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:42.966850 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b345d-baca-4ddc-b223-c628bf59a6b1 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:42.980292 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0721cb-d26f-4f70-a19a-42350c2cb329 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:42.985540 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa5784-2fa6-46dc-85ba-2d15262d3abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:42.986175 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa5784-2fa6-46dc-85ba-2d15262d3abb admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:42.986450 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa5784-2fa6-46dc-85ba-2d15262d3abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:42.986725 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa5784-2fa6-46dc-85ba-2d15262d3abb admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:42.987841 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa5784-2fa6-46dc-85ba-2d15262d3abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:42.990959 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa5784-2fa6-46dc-85ba-2d15262d3abb admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:42.992818 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1286/2596] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:42 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:42:43.003510 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1311/2597] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:43.012745 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b345d-baca-4ddc-b223-c628bf59a6b1 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:43.022163 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b345d-baca-4ddc-b223-c628bf59a6b1 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:43.027861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5a139-ea99-499d-b8ed-b2c59678780c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:43.028693 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5a139-ea99-499d-b8ed-b2c59678780c admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:43.029126 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5a139-ea99-499d-b8ed-b2c59678780c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:43.029454 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5a139-ea99-499d-b8ed-b2c59678780c admin admin] PATH_INFO: `/v3/projects/8364e1a812724082826171204a2652d2/users/c9e127ef392f4bb0947f6e3a5837f1f3/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:43.031693 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5a139-ea99-499d-b8ed-b2c59678780c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8364e1a812724082826171204a2652d2, user_id=c9e127ef392f4bb0947f6e3a5837f1f3, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:43.034573 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5a139-ea99-499d-b8ed-b2c59678780c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:43.051730 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1287/2598] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:43 2022] PUT /identity/v3/projects/8364e1a812724082826171204a2652d2/users/c9e127ef392f4bb0947f6e3a5837f1f3/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:43.125516 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d798cf0-28f5-47a7-8352-9c1af5a93acc None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:43.126245 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d798cf0-28f5-47a7-8352-9c1af5a93acc None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:43.126945 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d798cf0-28f5-47a7-8352-9c1af5a93acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:43.183597 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9d798cf0-28f5-47a7-8352-9c1af5a93acc None None] MFA Rules not processed for user `c9e127ef392f4bb0947f6e3a5837f1f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:43.187173 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9d798cf0-28f5-47a7-8352-9c1af5a93acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:43.334486 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1312/2599] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:43.377324 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5a139-ea99-499d-b8ed-b2c59678780c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:43.389410 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:43.501734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5a139-ea99-499d-b8ed-b2c59678780c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:43.506527 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead27f3-c006-4b25-af86-a9785165b62c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:43.507642 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead27f3-c006-4b25-af86-a9785165b62c service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:43.508167 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead27f3-c006-4b25-af86-a9785165b62c service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:43.508661 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead27f3-c006-4b25-af86-a9785165b62c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:43.594912 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d798cf0-28f5-47a7-8352-9c1af5a93acc None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:43.617477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead27f3-c006-4b25-af86-a9785165b62c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:43.619078 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead27f3-c006-4b25-af86-a9785165b62c service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:43.631928 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1288/2600] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:43.688633 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d798cf0-28f5-47a7-8352-9c1af5a93acc None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:43.693865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52490e-dcfc-4872-bbf3-5171eae6096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:43.694676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52490e-dcfc-4872-bbf3-5171eae6096a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:43.694971 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52490e-dcfc-4872-bbf3-5171eae6096a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:43.695248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52490e-dcfc-4872-bbf3-5171eae6096a admin admin] PATH_INFO: `/v3/users/439188ac0692478fb4159e8fc25a7e77` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:43.696483 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52490e-dcfc-4872-bbf3-5171eae6096a admin admin] RBAC: Authorizing `identity:delete_user(user_id=439188ac0692478fb4159e8fc25a7e77)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:43.698506 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52490e-dcfc-4872-bbf3-5171eae6096a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:43.727307 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:43.761704 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2c52490e-dcfc-4872-bbf3-5171eae6096a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '439188ac0692478fb4159e8fc25a7e77'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:43.776004 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2c52490e-dcfc-4872-bbf3-5171eae6096a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '439188ac0692478fb4159e8fc25a7e77'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:43.776791 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2c52490e-dcfc-4872-bbf3-5171eae6096a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '439188ac0692478fb4159e8fc25a7e77'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:43.785098 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2c52490e-dcfc-4872-bbf3-5171eae6096a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '439188ac0692478fb4159e8fc25a7e77'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:43.795370 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2c52490e-dcfc-4872-bbf3-5171eae6096a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '439188ac0692478fb4159e8fc25a7e77'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:43.804214 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1313/2601] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:43 2022] DELETE /identity/v3/users/439188ac0692478fb4159e8fc25a7e77 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:43.811062 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abde653-ce80-4da6-9be0-1b6ca551337f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:43.811395 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abde653-ce80-4da6-9be0-1b6ca551337f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:43.811568 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abde653-ce80-4da6-9be0-1b6ca551337f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:43.835954 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9abde653-ce80-4da6-9be0-1b6ca551337f None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:43.837650 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9abde653-ce80-4da6-9be0-1b6ca551337f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:43.941410 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1289/2602] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:43.958863 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52490e-dcfc-4872-bbf3-5171eae6096a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:43.961231 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2c52490e-dcfc-4872-bbf3-5171eae6096a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:44.050374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52490e-dcfc-4872-bbf3-5171eae6096a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:44.054323 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01969c7-0ebf-4889-a9f3-8881555a986d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:44.055388 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01969c7-0ebf-4889-a9f3-8881555a986d service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:44.055388 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01969c7-0ebf-4889-a9f3-8881555a986d service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:44.055672 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01969c7-0ebf-4889-a9f3-8881555a986d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:44.068960 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01969c7-0ebf-4889-a9f3-8881555a986d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:44.070436 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01969c7-0ebf-4889-a9f3-8881555a986d service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:44.090397 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1314/2603] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:42:44.428380 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abde653-ce80-4da6-9be0-1b6ca551337f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:44.430152 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9abde653-ce80-4da6-9be0-1b6ca551337f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:44.442971 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abde653-ce80-4da6-9be0-1b6ca551337f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:44.448441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1788d37-f333-4f85-9108-ffa66243a13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:44.449145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1788d37-f333-4f85-9108-ffa66243a13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:44.449416 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1788d37-f333-4f85-9108-ffa66243a13a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:44.449684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1788d37-f333-4f85-9108-ffa66243a13a admin admin] PATH_INFO: `/v3/projects/dccf7f8b235847fa92205207ed2a510b` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:44.451052 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1788d37-f333-4f85-9108-ffa66243a13a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dccf7f8b235847fa92205207ed2a510b)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:44.453081 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1788d37-f333-4f85-9108-ffa66243a13a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:44.515217 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c1788d37-f333-4f85-9108-ffa66243a13a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dccf7f8b235847fa92205207ed2a510b', 'request_id': 'req-c1788d37-f333-4f85-9108-ffa66243a13a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:44.523243 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c1788d37-f333-4f85-9108-ffa66243a13a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dccf7f8b235847fa92205207ed2a510b', 'request_id': 'req-c1788d37-f333-4f85-9108-ffa66243a13a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:44.525722 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:44.531404 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c1788d37-f333-4f85-9108-ffa66243a13a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dccf7f8b235847fa92205207ed2a510b', 'request_id': 'req-c1788d37-f333-4f85-9108-ffa66243a13a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:44.546086 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c1788d37-f333-4f85-9108-ffa66243a13a admin admin] The token cache is being invalidate because project dccf7f8b235847fa92205207ed2a510b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:44.546367 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c1788d37-f333-4f85-9108-ffa66243a13a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:44.547063 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c1788d37-f333-4f85-9108-ffa66243a13a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:44.549128 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1290/2604] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:44 2022] DELETE /identity/v3/projects/dccf7f8b235847fa92205207ed2a510b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:44.554507 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01969c7-0ebf-4889-a9f3-8881555a986d service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:44.576411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01969c7-0ebf-4889-a9f3-8881555a986d service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:44.657036 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e9160-1e62-46de-b611-8108fe7eeaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:44.657684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e9160-1e62-46de-b611-8108fe7eeaaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:44.657972 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e9160-1e62-46de-b611-8108fe7eeaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:44.658248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e9160-1e62-46de-b611-8108fe7eeaaa admin admin] PATH_INFO: `/v3/users/1ef0a877c0df4526b1c115e8b839cde0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:44.659444 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e9160-1e62-46de-b611-8108fe7eeaaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ef0a877c0df4526b1c115e8b839cde0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:44.661482 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e9160-1e62-46de-b611-8108fe7eeaaa admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:44.724299 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:44.726495 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c60e9160-1e62-46de-b611-8108fe7eeaaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ef0a877c0df4526b1c115e8b839cde0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:44.743406 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c60e9160-1e62-46de-b611-8108fe7eeaaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ef0a877c0df4526b1c115e8b839cde0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:44.745505 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c60e9160-1e62-46de-b611-8108fe7eeaaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ef0a877c0df4526b1c115e8b839cde0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:44.754501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c60e9160-1e62-46de-b611-8108fe7eeaaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ef0a877c0df4526b1c115e8b839cde0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:44.764017 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c60e9160-1e62-46de-b611-8108fe7eeaaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ef0a877c0df4526b1c115e8b839cde0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:44.771824 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1315/2605] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:44 2022] DELETE /identity/v3/users/1ef0a877c0df4526b1c115e8b839cde0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:45.132134 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1788d37-f333-4f85-9108-ffa66243a13a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:45.134051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c1788d37-f333-4f85-9108-ffa66243a13a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:45.152291 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1788d37-f333-4f85-9108-ffa66243a13a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:45.242146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cbd4d-7ff1-4547-bb05-ad56e9f79aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:45.243114 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cbd4d-7ff1-4547-bb05-ad56e9f79aa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:45.243552 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cbd4d-7ff1-4547-bb05-ad56e9f79aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:45.243979 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cbd4d-7ff1-4547-bb05-ad56e9f79aa3 admin admin] PATH_INFO: `/v3/projects/aef2f60d7e2b4dc4bdb90491bf19f459` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:45.246149 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38cbd4d-7ff1-4547-bb05-ad56e9f79aa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aef2f60d7e2b4dc4bdb90491bf19f459)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:45.248389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38cbd4d-7ff1-4547-bb05-ad56e9f79aa3 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:45.314784 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a38cbd4d-7ff1-4547-bb05-ad56e9f79aa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aef2f60d7e2b4dc4bdb90491bf19f459', 'request_id': 'req-a38cbd4d-7ff1-4547-bb05-ad56e9f79aa3'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:45.324244 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a38cbd4d-7ff1-4547-bb05-ad56e9f79aa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aef2f60d7e2b4dc4bdb90491bf19f459', 'request_id': 'req-a38cbd4d-7ff1-4547-bb05-ad56e9f79aa3'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:45.338664 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a38cbd4d-7ff1-4547-bb05-ad56e9f79aa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aef2f60d7e2b4dc4bdb90491bf19f459', 'request_id': 'req-a38cbd4d-7ff1-4547-bb05-ad56e9f79aa3'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:45.362145 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a38cbd4d-7ff1-4547-bb05-ad56e9f79aa3 admin admin] The token cache is being invalidate because project aef2f60d7e2b4dc4bdb90491bf19f459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:45.362776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a38cbd4d-7ff1-4547-bb05-ad56e9f79aa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:45.364136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a38cbd4d-7ff1-4547-bb05-ad56e9f79aa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:45.370448 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1291/2606] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:45 2022] DELETE /identity/v3/projects/aef2f60d7e2b4dc4bdb90491bf19f459 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:45.373369 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d601e4-5af7-4c47-9e77-c287e4a98b0d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:45.373895 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d601e4-5af7-4c47-9e77-c287e4a98b0d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:45.374467 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d601e4-5af7-4c47-9e77-c287e4a98b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:45.392573 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cbd4d-7ff1-4547-bb05-ad56e9f79aa3 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:45.395045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a38cbd4d-7ff1-4547-bb05-ad56e9f79aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:45.405808 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-57d601e4-5af7-4c47-9e77-c287e4a98b0d None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:45.407660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-57d601e4-5af7-4c47-9e77-c287e4a98b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:45.487750 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1316/2607] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:45.500223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e990b-1d56-4577-bf5c-f701c02d38b8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:45.500846 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e990b-1d56-4577-bf5c-f701c02d38b8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:45.501427 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e990b-1d56-4577-bf5c-f701c02d38b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:45.527621 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cbd4d-7ff1-4547-bb05-ad56e9f79aa3 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:45.532008 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60afb8-d480-4c2e-8476-549035b3d6f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:45.532668 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60afb8-d480-4c2e-8476-549035b3d6f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:45.533637 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60afb8-d480-4c2e-8476-549035b3d6f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:45.533816 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0d9e990b-1d56-4577-bf5c-f701c02d38b8 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:45.533924 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60afb8-d480-4c2e-8476-549035b3d6f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:45.534953 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0d9e990b-1d56-4577-bf5c-f701c02d38b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:45.535883 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-dd60afb8-d480-4c2e-8476-549035b3d6f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:45.544596 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1317/2608] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:45.549091 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e990b-1d56-4577-bf5c-f701c02d38b8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:45.559746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e990b-1d56-4577-bf5c-f701c02d38b8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:45.565339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbd78c-03e8-441e-8a6a-02be501b382f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:45.566173 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbd78c-03e8-441e-8a6a-02be501b382f admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:45.566570 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbd78c-03e8-441e-8a6a-02be501b382f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:45.566932 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbd78c-03e8-441e-8a6a-02be501b382f admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:45.568257 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bbd78c-03e8-441e-8a6a-02be501b382f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:42:45.569048 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bbd78c-03e8-441e-8a6a-02be501b382f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:45.570763 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bbd78c-03e8-441e-8a6a-02be501b382f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:45.578377 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:45.590678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1318/2609] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:42:45.593164 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbd78c-03e8-441e-8a6a-02be501b382f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:45.606191 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbd78c-03e8-441e-8a6a-02be501b382f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:45.615680 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00bbba-42c8-48bc-8334-b2a2120ed9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:45.616314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00bbba-42c8-48bc-8334-b2a2120ed9e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:45.616600 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00bbba-42c8-48bc-8334-b2a2120ed9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:45.616903 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00bbba-42c8-48bc-8334-b2a2120ed9e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:45.617550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00bbba-42c8-48bc-8334-b2a2120ed9e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:45.619522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00bbba-42c8-48bc-8334-b2a2120ed9e4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:45.620328 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60afb8-d480-4c2e-8476-549035b3d6f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:45.622310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60afb8-d480-4c2e-8476-549035b3d6f6 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:45.637158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1292/2610] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:45.656686 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1319/2611] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:45 2022] POST /identity/v3/projects => generated 355 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:45.660206 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60afb8-d480-4c2e-8476-549035b3d6f6 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:45.673582 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60afb8-d480-4c2e-8476-549035b3d6f6 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:45.750345 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a98ad-219b-4bb4-a22d-19b3cd1df4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:45.751008 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a98ad-219b-4bb4-a22d-19b3cd1df4d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:45.751293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a98ad-219b-4bb4-a22d-19b3cd1df4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:45.752159 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a98ad-219b-4bb4-a22d-19b3cd1df4d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:45.752294 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a98ad-219b-4bb4-a22d-19b3cd1df4d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:45.754618 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a98ad-219b-4bb4-a22d-19b3cd1df4d0 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:45.792130 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1293/2612] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:45 2022] POST /identity/v3/users => generated 278 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:42:45.794643 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00bbba-42c8-48bc-8334-b2a2120ed9e4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:45.812025 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00bbba-42c8-48bc-8334-b2a2120ed9e4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:45.819490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829ee9a-ba14-4ab7-b719-b1878e9aa8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:45.820370 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829ee9a-ba14-4ab7-b719-b1878e9aa8fc admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:45.820909 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829ee9a-ba14-4ab7-b719-b1878e9aa8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:45.821367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829ee9a-ba14-4ab7-b719-b1878e9aa8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:45.822174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4829ee9a-ba14-4ab7-b719-b1878e9aa8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:45.824290 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4829ee9a-ba14-4ab7-b719-b1878e9aa8fc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:45.837647 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1320/2613] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:45.842505 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a98ad-219b-4bb4-a22d-19b3cd1df4d0 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:45.856320 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a98ad-219b-4bb4-a22d-19b3cd1df4d0 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:45.862147 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be56b2-50ad-46d0-90c6-48f77299865e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:45.862776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be56b2-50ad-46d0-90c6-48f77299865e admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:45.863056 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be56b2-50ad-46d0-90c6-48f77299865e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:45.863330 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be56b2-50ad-46d0-90c6-48f77299865e admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:45.864005 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be56b2-50ad-46d0-90c6-48f77299865e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:45.866349 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be56b2-50ad-46d0-90c6-48f77299865e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:45.878444 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1294/2614] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:42:45.883542 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829ee9a-ba14-4ab7-b719-b1878e9aa8fc admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:45.895077 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829ee9a-ba14-4ab7-b719-b1878e9aa8fc admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:45.902385 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025d3a2-2f2a-45b5-86a4-fb0c6dd4ec7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:45.903067 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025d3a2-2f2a-45b5-86a4-fb0c6dd4ec7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:45.903851 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025d3a2-2f2a-45b5-86a4-fb0c6dd4ec7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:45.904157 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025d3a2-2f2a-45b5-86a4-fb0c6dd4ec7d admin admin] PATH_INFO: `/v3/projects/1a3b8ebe028e4433bd56f6240c292057/users/a982359c8a8f4ba8a47c71f07de9b3dd/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:45.924814 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025d3a2-2f2a-45b5-86a4-fb0c6dd4ec7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a3b8ebe028e4433bd56f6240c292057, user_id=a982359c8a8f4ba8a47c71f07de9b3dd, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:45.929391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025d3a2-2f2a-45b5-86a4-fb0c6dd4ec7d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:45.948454 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1321/2615] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:45 2022] PUT /identity/v3/projects/1a3b8ebe028e4433bd56f6240c292057/users/a982359c8a8f4ba8a47c71f07de9b3dd/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:45.960487 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a172c0-add3-4449-9ba7-dae014db59d6 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:45.960793 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a172c0-add3-4449-9ba7-dae014db59d6 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:45.961088 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a172c0-add3-4449-9ba7-dae014db59d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:45.994050 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c3a172c0-add3-4449-9ba7-dae014db59d6 None None] MFA Rules not processed for user `a982359c8a8f4ba8a47c71f07de9b3dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:45.995330 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c3a172c0-add3-4449-9ba7-dae014db59d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:46.094012 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1295/2616] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:46.101274 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025d3a2-2f2a-45b5-86a4-fb0c6dd4ec7d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:46.195280 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:46.226296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025d3a2-2f2a-45b5-86a4-fb0c6dd4ec7d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:46.234710 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2369a30-756c-4b45-93bd-a0c269360b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:46.235778 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2369a30-756c-4b45-93bd-a0c269360b64 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:46.236280 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2369a30-756c-4b45-93bd-a0c269360b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:46.237056 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2369a30-756c-4b45-93bd-a0c269360b64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:46.238270 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2369a30-756c-4b45-93bd-a0c269360b64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:46.242353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2369a30-756c-4b45-93bd-a0c269360b64 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:46.292884 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1322/2617] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:46 2022] POST /identity/v3/projects => generated 355 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:42:46.297703 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a172c0-add3-4449-9ba7-dae014db59d6 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:46.311595 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a172c0-add3-4449-9ba7-dae014db59d6 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:46.354954 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:46.388987 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4902e-24c3-4501-963b-8ed7f1e0b85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:46.389753 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4902e-24c3-4501-963b-8ed7f1e0b85f admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:46.390283 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4902e-24c3-4501-963b-8ed7f1e0b85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:46.390667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4902e-24c3-4501-963b-8ed7f1e0b85f admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:46.391638 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4902e-24c3-4501-963b-8ed7f1e0b85f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:46.394187 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4902e-24c3-4501-963b-8ed7f1e0b85f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:46.425582 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1296/2618] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:46 2022] POST /identity/v3/users => generated 284 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:42:46.430504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2369a30-756c-4b45-93bd-a0c269360b64 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:46.431706 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4902e-24c3-4501-963b-8ed7f1e0b85f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:46.442663 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4902e-24c3-4501-963b-8ed7f1e0b85f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:46.448410 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a74d7-26a2-4eb0-b408-ae0a3301ed5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:46.449373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a74d7-26a2-4eb0-b408-ae0a3301ed5a admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:46.449373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a74d7-26a2-4eb0-b408-ae0a3301ed5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:46.449649 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a74d7-26a2-4eb0-b408-ae0a3301ed5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:46.450311 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a74d7-26a2-4eb0-b408-ae0a3301ed5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:46.451982 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a74d7-26a2-4eb0-b408-ae0a3301ed5a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:46.463471 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1297/2619] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:46.468611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a74d7-26a2-4eb0-b408-ae0a3301ed5a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:46.480300 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a74d7-26a2-4eb0-b408-ae0a3301ed5a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:46.485390 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e9249-a87a-4324-88a4-a564d52c8128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:46.486068 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e9249-a87a-4324-88a4-a564d52c8128 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:46.486351 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e9249-a87a-4324-88a4-a564d52c8128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:46.486626 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e9249-a87a-4324-88a4-a564d52c8128 admin admin] PATH_INFO: `/v3/projects/a595fa308887469592fd84675cba57d2/users/c68aeb86ebee437bae84b0e333f582df/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:46.503999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e9249-a87a-4324-88a4-a564d52c8128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a595fa308887469592fd84675cba57d2, user_id=c68aeb86ebee437bae84b0e333f582df, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:46.506930 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e9249-a87a-4324-88a4-a564d52c8128 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:46.524730 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1298/2620] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:46 2022] PUT /identity/v3/projects/a595fa308887469592fd84675cba57d2/users/c68aeb86ebee437bae84b0e333f582df/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:46.529666 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e9249-a87a-4324-88a4-a564d52c8128 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:46.532571 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2369a30-756c-4b45-93bd-a0c269360b64 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:46.606169 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87eb51e-fab1-4185-b621-7e8e673c8775 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:46.606771 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87eb51e-fab1-4185-b621-7e8e673c8775 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:46.607064 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87eb51e-fab1-4185-b621-7e8e673c8775 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:46.607419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87eb51e-fab1-4185-b621-7e8e673c8775 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:46.609587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c87eb51e-fab1-4185-b621-7e8e673c8775 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:46.617361 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e9249-a87a-4324-88a4-a564d52c8128 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:46.625882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b52c06-0a1d-47a6-81d6-b9042a4d71a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:46.626892 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b52c06-0a1d-47a6-81d6-b9042a4d71a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:46.627397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b52c06-0a1d-47a6-81d6-b9042a4d71a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:46.627876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b52c06-0a1d-47a6-81d6-b9042a4d71a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:46.629179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b52c06-0a1d-47a6-81d6-b9042a4d71a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:46.632741 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b52c06-0a1d-47a6-81d6-b9042a4d71a9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:46.651098 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1299/2621] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:42:46.656045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b52c06-0a1d-47a6-81d6-b9042a4d71a9 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:46.667788 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b52c06-0a1d-47a6-81d6-b9042a4d71a9 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:46.673513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d5d5c-81bb-4edf-8493-c274f841e7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:46.673839 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d5d5c-81bb-4edf-8493-c274f841e7cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:46.674221 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d5d5c-81bb-4edf-8493-c274f841e7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:46.674406 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d5d5c-81bb-4edf-8493-c274f841e7cc admin admin] PATH_INFO: `/v3/projects/a595fa308887469592fd84675cba57d2/users/c68aeb86ebee437bae84b0e333f582df/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:46.676486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d5d5c-81bb-4edf-8493-c274f841e7cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a595fa308887469592fd84675cba57d2, user_id=c68aeb86ebee437bae84b0e333f582df, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:46.679269 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d5d5c-81bb-4edf-8493-c274f841e7cc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:46.690173 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87eb51e-fab1-4185-b621-7e8e673c8775 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:46.692231 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87eb51e-fab1-4185-b621-7e8e673c8775 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:46.693266 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1300/2622] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:46 2022] PUT /identity/v3/projects/a595fa308887469592fd84675cba57d2/users/c68aeb86ebee437bae84b0e333f582df/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:46.704740 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f3a9f-2c03-44e8-baff-fd4da0a15f4c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:46.705144 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f3a9f-2c03-44e8-baff-fd4da0a15f4c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:46.705469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f3a9f-2c03-44e8-baff-fd4da0a15f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:46.705743 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1323/2623] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:46.739443 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4f3f3a9f-2c03-44e8-baff-fd4da0a15f4c None None] MFA Rules not processed for user `c68aeb86ebee437bae84b0e333f582df`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:46.741282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4f3f3a9f-2c03-44e8-baff-fd4da0a15f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:46.866904 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:46.871868 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1301/2624] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:46 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:46.891570 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87eb51e-fab1-4185-b621-7e8e673c8775 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:46.901896 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87eb51e-fab1-4185-b621-7e8e673c8775 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:46.957163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:46.983011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec18ae-4666-4e05-88ae-b9834b55d05f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:46.983836 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec18ae-4666-4e05-88ae-b9834b55d05f service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:46.984376 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec18ae-4666-4e05-88ae-b9834b55d05f service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:46.984829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec18ae-4666-4e05-88ae-b9834b55d05f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:47.001415 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec18ae-4666-4e05-88ae-b9834b55d05f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:47.003411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec18ae-4666-4e05-88ae-b9834b55d05f service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:47.024189 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1324/2625] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:46 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:42:47.064564 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f3a9f-2c03-44e8-baff-fd4da0a15f4c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:47.067457 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4f3f3a9f-2c03-44e8-baff-fd4da0a15f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:47.164039 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec18ae-4666-4e05-88ae-b9834b55d05f service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:47.178254 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f3a9f-2c03-44e8-baff-fd4da0a15f4c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:47.180652 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec18ae-4666-4e05-88ae-b9834b55d05f service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:47.183136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fe770-ed85-4dd9-b4f6-7915167d364e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:47.183794 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fe770-ed85-4dd9-b4f6-7915167d364e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:47.184075 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fe770-ed85-4dd9-b4f6-7915167d364e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:47.184409 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fe770-ed85-4dd9-b4f6-7915167d364e admin admin] PATH_INFO: `/v3/users/4c267a87fd314fb88e37f246b79bf377` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:47.185638 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498fe770-ed85-4dd9-b4f6-7915167d364e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c267a87fd314fb88e37f246b79bf377)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:47.187898 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498fe770-ed85-4dd9-b4f6-7915167d364e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:47.188082 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626268bd-f66f-4c04-8730-e69769abb671 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:47.189063 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626268bd-f66f-4c04-8730-e69769abb671 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:47.189556 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626268bd-f66f-4c04-8730-e69769abb671 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:47.190029 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626268bd-f66f-4c04-8730-e69769abb671 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:47.252426 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-498fe770-ed85-4dd9-b4f6-7915167d364e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c267a87fd314fb88e37f246b79bf377'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:47.271629 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-498fe770-ed85-4dd9-b4f6-7915167d364e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c267a87fd314fb88e37f246b79bf377'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:47.272581 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-498fe770-ed85-4dd9-b4f6-7915167d364e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c267a87fd314fb88e37f246b79bf377'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:47.273512 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-498fe770-ed85-4dd9-b4f6-7915167d364e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c267a87fd314fb88e37f246b79bf377'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:47.283170 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-498fe770-ed85-4dd9-b4f6-7915167d364e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c267a87fd314fb88e37f246b79bf377'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:47.284436 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626268bd-f66f-4c04-8730-e69769abb671 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:47.285985 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626268bd-f66f-4c04-8730-e69769abb671 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:47.300036 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1325/2626] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:42:47.303742 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1302/2627] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:47 2022] DELETE /identity/v3/users/4c267a87fd314fb88e37f246b79bf377 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:47.309383 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf53f2-52aa-4788-acf2-973119f98e5e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:47.309884 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf53f2-52aa-4788-acf2-973119f98e5e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:47.310364 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf53f2-52aa-4788-acf2-973119f98e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:47.345377 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-fcbf53f2-52aa-4788-acf2-973119f98e5e None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:47.347522 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fcbf53f2-52aa-4788-acf2-973119f98e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:47.454985 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1326/2628] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:47.466348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fe770-ed85-4dd9-b4f6-7915167d364e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:47.469108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-498fe770-ed85-4dd9-b4f6-7915167d364e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:47.590975 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fe770-ed85-4dd9-b4f6-7915167d364e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:47.595182 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244e024-e238-427a-8a1a-931620e218a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:47.595944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244e024-e238-427a-8a1a-931620e218a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:47.596393 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244e024-e238-427a-8a1a-931620e218a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:47.596604 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244e024-e238-427a-8a1a-931620e218a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:47.608096 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244e024-e238-427a-8a1a-931620e218a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:47.609609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244e024-e238-427a-8a1a-931620e218a5 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:47.621695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1303/2629] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:47.952469 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf53f2-52aa-4788-acf2-973119f98e5e None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:47.954409 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fcbf53f2-52aa-4788-acf2-973119f98e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:47.972780 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf53f2-52aa-4788-acf2-973119f98e5e None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:47.980380 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab153a4-3b4c-498a-9789-db7ab47c39c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:47.980824 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab153a4-3b4c-498a-9789-db7ab47c39c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:47.981292 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab153a4-3b4c-498a-9789-db7ab47c39c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:47.981767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab153a4-3b4c-498a-9789-db7ab47c39c5 admin admin] PATH_INFO: `/v3/projects/7b4b37ef68f44e92bcffbf9d3e10195a` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:47.984451 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab153a4-3b4c-498a-9789-db7ab47c39c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b4b37ef68f44e92bcffbf9d3e10195a)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:47.988540 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab153a4-3b4c-498a-9789-db7ab47c39c5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:48.068580 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cab153a4-3b4c-498a-9789-db7ab47c39c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b4b37ef68f44e92bcffbf9d3e10195a', 'request_id': 'req-cab153a4-3b4c-498a-9789-db7ab47c39c5'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:48.076837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cab153a4-3b4c-498a-9789-db7ab47c39c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b4b37ef68f44e92bcffbf9d3e10195a', 'request_id': 'req-cab153a4-3b4c-498a-9789-db7ab47c39c5'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:48.094423 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cab153a4-3b4c-498a-9789-db7ab47c39c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b4b37ef68f44e92bcffbf9d3e10195a', 'request_id': 'req-cab153a4-3b4c-498a-9789-db7ab47c39c5'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:48.116372 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cab153a4-3b4c-498a-9789-db7ab47c39c5 admin admin] The token cache is being invalidate because project 7b4b37ef68f44e92bcffbf9d3e10195a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:48.116937 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cab153a4-3b4c-498a-9789-db7ab47c39c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:48.118233 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cab153a4-3b4c-498a-9789-db7ab47c39c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:48.124186 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1327/2630] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:47 2022] DELETE /identity/v3/projects/7b4b37ef68f44e92bcffbf9d3e10195a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:48.129370 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244e024-e238-427a-8a1a-931620e218a5 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:48.147456 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244e024-e238-427a-8a1a-931620e218a5 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:48.180611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:48.275368 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4632741-5974-4163-9935-2bdce37d59b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:48.276062 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4632741-5974-4163-9935-2bdce37d59b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:48.277540 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4632741-5974-4163-9935-2bdce37d59b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:48.278015 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4632741-5974-4163-9935-2bdce37d59b3 admin admin] PATH_INFO: `/v3/users/c55b5fad2d1e49258d6c46a1c33ea9b8` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:48.280980 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4632741-5974-4163-9935-2bdce37d59b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c55b5fad2d1e49258d6c46a1c33ea9b8)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:48.285424 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4632741-5974-4163-9935-2bdce37d59b3 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:48.373218 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d4632741-5974-4163-9935-2bdce37d59b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c55b5fad2d1e49258d6c46a1c33ea9b8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:48.423654 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d4632741-5974-4163-9935-2bdce37d59b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c55b5fad2d1e49258d6c46a1c33ea9b8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:48.426498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d4632741-5974-4163-9935-2bdce37d59b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c55b5fad2d1e49258d6c46a1c33ea9b8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:48.427624 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d4632741-5974-4163-9935-2bdce37d59b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c55b5fad2d1e49258d6c46a1c33ea9b8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:48.448595 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d4632741-5974-4163-9935-2bdce37d59b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c55b5fad2d1e49258d6c46a1c33ea9b8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:48.476879 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1304/2631] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:48 2022] DELETE /identity/v3/users/c55b5fad2d1e49258d6c46a1c33ea9b8 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:48.880117 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab153a4-3b4c-498a-9789-db7ab47c39c5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:48.881990 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cab153a4-3b4c-498a-9789-db7ab47c39c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:48.893855 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:48.903080 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab153a4-3b4c-498a-9789-db7ab47c39c5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:48.984328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0b375-82d8-4288-9939-ec31c87551eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:48.985125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0b375-82d8-4288-9939-ec31c87551eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:48.985494 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0b375-82d8-4288-9939-ec31c87551eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:48.985848 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0b375-82d8-4288-9939-ec31c87551eb admin admin] PATH_INFO: `/v3/projects/1e646dfb700c4f5783bce3eefb7a9f2c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:48.987498 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0b375-82d8-4288-9939-ec31c87551eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e646dfb700c4f5783bce3eefb7a9f2c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:48.991012 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0b375-82d8-4288-9939-ec31c87551eb admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:49.048670 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c4a0b375-82d8-4288-9939-ec31c87551eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e646dfb700c4f5783bce3eefb7a9f2c', 'request_id': 'req-c4a0b375-82d8-4288-9939-ec31c87551eb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:49.058410 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c4a0b375-82d8-4288-9939-ec31c87551eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e646dfb700c4f5783bce3eefb7a9f2c', 'request_id': 'req-c4a0b375-82d8-4288-9939-ec31c87551eb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:49.067661 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c4a0b375-82d8-4288-9939-ec31c87551eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e646dfb700c4f5783bce3eefb7a9f2c', 'request_id': 'req-c4a0b375-82d8-4288-9939-ec31c87551eb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:49.082441 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c4a0b375-82d8-4288-9939-ec31c87551eb admin admin] The token cache is being invalidate because project 1e646dfb700c4f5783bce3eefb7a9f2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:49.083027 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c4a0b375-82d8-4288-9939-ec31c87551eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:49.084579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c4a0b375-82d8-4288-9939-ec31c87551eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:49.087173 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1328/2632] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:48 2022] DELETE /identity/v3/projects/1e646dfb700c4f5783bce3eefb7a9f2c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:49.095062 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81cbd4-bdcb-41e3-9807-0c588afd537b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:49.095654 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81cbd4-bdcb-41e3-9807-0c588afd537b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:49.095845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81cbd4-bdcb-41e3-9807-0c588afd537b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:49.121018 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ab81cbd4-bdcb-41e3-9807-0c588afd537b None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:49.122301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ab81cbd4-bdcb-41e3-9807-0c588afd537b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:49.195167 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1305/2633] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:49.205288 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390153e2-9171-4b38-b106-fe7e1da3a9c8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:49.205555 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390153e2-9171-4b38-b106-fe7e1da3a9c8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:49.205841 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390153e2-9171-4b38-b106-fe7e1da3a9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:49.228171 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-390153e2-9171-4b38-b106-fe7e1da3a9c8 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:49.229473 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-390153e2-9171-4b38-b106-fe7e1da3a9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:49.241175 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1329/2634] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:49.246076 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81cbd4-bdcb-41e3-9807-0c588afd537b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:49.256894 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81cbd4-bdcb-41e3-9807-0c588afd537b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:49.262082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f57dc-9a94-4ac9-9021-bfb01a695a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:49.262760 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f57dc-9a94-4ac9-9021-bfb01a695a10 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:49.263050 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f57dc-9a94-4ac9-9021-bfb01a695a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:49.263324 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f57dc-9a94-4ac9-9021-bfb01a695a10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:49.264026 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f57dc-9a94-4ac9-9021-bfb01a695a10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:42:49.264330 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f57dc-9a94-4ac9-9021-bfb01a695a10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:49.266194 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f57dc-9a94-4ac9-9021-bfb01a695a10 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:49.280833 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1306/2635] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:42:49.285494 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390153e2-9171-4b38-b106-fe7e1da3a9c8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:49.296320 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390153e2-9171-4b38-b106-fe7e1da3a9c8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:49.301819 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a57e31-f4bb-4871-8004-c84bc396ae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:49.302664 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a57e31-f4bb-4871-8004-c84bc396ae1e admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:49.302948 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a57e31-f4bb-4871-8004-c84bc396ae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:49.303225 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a57e31-f4bb-4871-8004-c84bc396ae1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:49.303892 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a57e31-f4bb-4871-8004-c84bc396ae1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:49.305909 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a57e31-f4bb-4871-8004-c84bc396ae1e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:49.343736 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1330/2636] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:49 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:49.348349 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f57dc-9a94-4ac9-9021-bfb01a695a10 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:49.359147 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f57dc-9a94-4ac9-9021-bfb01a695a10 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:49.395659 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:49.447743 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf534174-41a4-4329-9172-807a374ffe65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:49.448359 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf534174-41a4-4329-9172-807a374ffe65 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:49.448666 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf534174-41a4-4329-9172-807a374ffe65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:49.448936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf534174-41a4-4329-9172-807a374ffe65 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:49.449586 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf534174-41a4-4329-9172-807a374ffe65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:49.453440 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf534174-41a4-4329-9172-807a374ffe65 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:49.485447 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1307/2637] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:49 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:42:49.488912 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a57e31-f4bb-4871-8004-c84bc396ae1e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:49.511950 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a57e31-f4bb-4871-8004-c84bc396ae1e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:49.533494 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e11ed8-8c16-4a9e-bf48-c3313f8696d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:49.534795 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e11ed8-8c16-4a9e-bf48-c3313f8696d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:49.534795 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e11ed8-8c16-4a9e-bf48-c3313f8696d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:49.534795 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e11ed8-8c16-4a9e-bf48-c3313f8696d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:49.535290 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e11ed8-8c16-4a9e-bf48-c3313f8696d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:49.537269 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e11ed8-8c16-4a9e-bf48-c3313f8696d8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:49.561638 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1331/2638] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:49.565903 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf534174-41a4-4329-9172-807a374ffe65 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:49.591976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf534174-41a4-4329-9172-807a374ffe65 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:49.603528 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff4d3f-915d-40b3-a1f4-919cfb3c3823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:49.604792 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff4d3f-915d-40b3-a1f4-919cfb3c3823 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:49.605560 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff4d3f-915d-40b3-a1f4-919cfb3c3823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:49.606123 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff4d3f-915d-40b3-a1f4-919cfb3c3823 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:49.607360 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff4d3f-915d-40b3-a1f4-919cfb3c3823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:49.610666 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff4d3f-915d-40b3-a1f4-919cfb3c3823 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:49.634612 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1308/2639] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:49.639178 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e11ed8-8c16-4a9e-bf48-c3313f8696d8 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:49.651088 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e11ed8-8c16-4a9e-bf48-c3313f8696d8 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:49.660544 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f72a0c-2f3e-4887-9b7c-fdf954c50d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:49.661752 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f72a0c-2f3e-4887-9b7c-fdf954c50d2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:49.662239 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f72a0c-2f3e-4887-9b7c-fdf954c50d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:49.662721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f72a0c-2f3e-4887-9b7c-fdf954c50d2f admin admin] PATH_INFO: `/v3/projects/027cfde8b2c743f7a986f5a516b6029f/users/5e28974a80fd4901bbfe9f20d29f4420/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:49.698724 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f72a0c-2f3e-4887-9b7c-fdf954c50d2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=027cfde8b2c743f7a986f5a516b6029f, user_id=5e28974a80fd4901bbfe9f20d29f4420, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:49.704208 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f72a0c-2f3e-4887-9b7c-fdf954c50d2f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:49.727655 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1332/2640] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:49 2022] PUT /identity/v3/projects/027cfde8b2c743f7a986f5a516b6029f/users/5e28974a80fd4901bbfe9f20d29f4420/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:49.743402 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6d1ae-fb49-4775-a756-7968c8432411 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:49.743846 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6d1ae-fb49-4775-a756-7968c8432411 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:49.744288 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6d1ae-fb49-4775-a756-7968c8432411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:49.799726 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b8b6d1ae-fb49-4775-a756-7968c8432411 None None] MFA Rules not processed for user `5e28974a80fd4901bbfe9f20d29f4420`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:49.801623 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b8b6d1ae-fb49-4775-a756-7968c8432411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:49.959519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1309/2641] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:50.027704 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f72a0c-2f3e-4887-9b7c-fdf954c50d2f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:50.030541 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-55f72a0c-2f3e-4887-9b7c-fdf954c50d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:50.085665 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:50.132175 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f72a0c-2f3e-4887-9b7c-fdf954c50d2f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:50.138102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef45fd8-1eb9-471e-9187-c4f5ade983d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:50.138720 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef45fd8-1eb9-471e-9187-c4f5ade983d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:50.139020 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef45fd8-1eb9-471e-9187-c4f5ade983d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:50.139285 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef45fd8-1eb9-471e-9187-c4f5ade983d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:50.150775 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef45fd8-1eb9-471e-9187-c4f5ade983d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:50.152525 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef45fd8-1eb9-471e-9187-c4f5ade983d5 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:50.166595 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1333/2642] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:50.562514 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6d1ae-fb49-4775-a756-7968c8432411 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:50.564498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b8b6d1ae-fb49-4775-a756-7968c8432411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:50.671649 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6d1ae-fb49-4775-a756-7968c8432411 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:50.677654 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8c467-8f0d-4dce-8476-1d9e67ccf0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:50.678591 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8c467-8f0d-4dce-8476-1d9e67ccf0fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:50.678976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8c467-8f0d-4dce-8476-1d9e67ccf0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:50.679257 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8c467-8f0d-4dce-8476-1d9e67ccf0fb admin admin] PATH_INFO: `/v3/users/e16d937024a844469cc3de233ea2ddf5` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:50.680581 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8c467-8f0d-4dce-8476-1d9e67ccf0fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e16d937024a844469cc3de233ea2ddf5)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:50.682599 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8c467-8f0d-4dce-8476-1d9e67ccf0fb admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:50.754411 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:50.768183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7dd8c467-8f0d-4dce-8476-1d9e67ccf0fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e16d937024a844469cc3de233ea2ddf5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:50.784579 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7dd8c467-8f0d-4dce-8476-1d9e67ccf0fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e16d937024a844469cc3de233ea2ddf5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:50.785380 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7dd8c467-8f0d-4dce-8476-1d9e67ccf0fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e16d937024a844469cc3de233ea2ddf5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:50.786002 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7dd8c467-8f0d-4dce-8476-1d9e67ccf0fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e16d937024a844469cc3de233ea2ddf5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:50.795127 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7dd8c467-8f0d-4dce-8476-1d9e67ccf0fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e16d937024a844469cc3de233ea2ddf5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:50.810419 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1310/2643] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:50 2022] DELETE /identity/v3/users/e16d937024a844469cc3de233ea2ddf5 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:50.816975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e8bea-0c5d-468c-8200-a687896a6040 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:50.817488 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e8bea-0c5d-468c-8200-a687896a6040 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:50.818477 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e8bea-0c5d-468c-8200-a687896a6040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:50.845371 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-799e8bea-0c5d-468c-8200-a687896a6040 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:50.846846 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-799e8bea-0c5d-468c-8200-a687896a6040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:50.922550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1334/2644] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:50.933208 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8c467-8f0d-4dce-8476-1d9e67ccf0fb admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:50.935015 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7dd8c467-8f0d-4dce-8476-1d9e67ccf0fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:51.005909 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8c467-8f0d-4dce-8476-1d9e67ccf0fb admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:51.010243 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ec0c5-b3cd-4d47-9a67-724495deb3fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:51.010870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ec0c5-b3cd-4d47-9a67-724495deb3fa service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:51.011158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ec0c5-b3cd-4d47-9a67-724495deb3fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:51.011480 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ec0c5-b3cd-4d47-9a67-724495deb3fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:51.022566 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ec0c5-b3cd-4d47-9a67-724495deb3fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:51.024021 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ec0c5-b3cd-4d47-9a67-724495deb3fa service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:51.035655 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1311/2645] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:51.435665 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e8bea-0c5d-468c-8200-a687896a6040 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:51.437721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-799e8bea-0c5d-468c-8200-a687896a6040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:51.454813 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e8bea-0c5d-468c-8200-a687896a6040 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:51.460431 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91a970-0cdf-426d-ad87-7f71e2fdca83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:51.461209 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91a970-0cdf-426d-ad87-7f71e2fdca83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:51.461555 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91a970-0cdf-426d-ad87-7f71e2fdca83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:51.461834 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91a970-0cdf-426d-ad87-7f71e2fdca83 admin admin] PATH_INFO: `/v3/projects/25346b478dfb4751bf74d17f96cb7119` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:51.463207 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91a970-0cdf-426d-ad87-7f71e2fdca83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25346b478dfb4751bf74d17f96cb7119)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:51.465346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91a970-0cdf-426d-ad87-7f71e2fdca83 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:51.537062 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6c91a970-0cdf-426d-ad87-7f71e2fdca83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25346b478dfb4751bf74d17f96cb7119', 'request_id': 'req-6c91a970-0cdf-426d-ad87-7f71e2fdca83'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:51.548089 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6c91a970-0cdf-426d-ad87-7f71e2fdca83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25346b478dfb4751bf74d17f96cb7119', 'request_id': 'req-6c91a970-0cdf-426d-ad87-7f71e2fdca83'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:51.559106 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6c91a970-0cdf-426d-ad87-7f71e2fdca83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25346b478dfb4751bf74d17f96cb7119', 'request_id': 'req-6c91a970-0cdf-426d-ad87-7f71e2fdca83'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:51.576538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6c91a970-0cdf-426d-ad87-7f71e2fdca83 admin admin] The token cache is being invalidate because project 25346b478dfb4751bf74d17f96cb7119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:51.576538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6c91a970-0cdf-426d-ad87-7f71e2fdca83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:51.577560 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6c91a970-0cdf-426d-ad87-7f71e2fdca83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:51.579910 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1335/2646] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:51 2022] DELETE /identity/v3/projects/25346b478dfb4751bf74d17f96cb7119 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:51.585433 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ec0c5-b3cd-4d47-9a67-724495deb3fa service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:51.599977 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ec0c5-b3cd-4d47-9a67-724495deb3fa service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:51.691728 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443824f-99f5-406f-ac72-f78c5b0532c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:51.692943 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443824f-99f5-406f-ac72-f78c5b0532c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:51.693326 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443824f-99f5-406f-ac72-f78c5b0532c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:51.693833 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443824f-99f5-406f-ac72-f78c5b0532c2 admin admin] PATH_INFO: `/v3/users/8d4b03b281d240f0aab5ec9c13c9e710` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:51.695290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443824f-99f5-406f-ac72-f78c5b0532c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d4b03b281d240f0aab5ec9c13c9e710)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:51.697848 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443824f-99f5-406f-ac72-f78c5b0532c2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:51.779916 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e443824f-99f5-406f-ac72-f78c5b0532c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d4b03b281d240f0aab5ec9c13c9e710'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:51.806692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:51.810310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e443824f-99f5-406f-ac72-f78c5b0532c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d4b03b281d240f0aab5ec9c13c9e710'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:51.811707 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e443824f-99f5-406f-ac72-f78c5b0532c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d4b03b281d240f0aab5ec9c13c9e710'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:51.812182 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e443824f-99f5-406f-ac72-f78c5b0532c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d4b03b281d240f0aab5ec9c13c9e710'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:51.827993 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e443824f-99f5-406f-ac72-f78c5b0532c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d4b03b281d240f0aab5ec9c13c9e710'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:51.853061 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1312/2647] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:51 2022] DELETE /identity/v3/users/8d4b03b281d240f0aab5ec9c13c9e710 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:52.374206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91a970-0cdf-426d-ad87-7f71e2fdca83 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:52.376842 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6c91a970-0cdf-426d-ad87-7f71e2fdca83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:52.417537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91a970-0cdf-426d-ad87-7f71e2fdca83 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:52.504823 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:52.515580 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a390522-a87e-4593-8acc-6112d6c3520a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:52.516269 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a390522-a87e-4593-8acc-6112d6c3520a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:52.517665 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a390522-a87e-4593-8acc-6112d6c3520a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:52.518144 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a390522-a87e-4593-8acc-6112d6c3520a admin admin] PATH_INFO: `/v3/projects/44fe8e1fc7824c4c957f9496c2e77eeb` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:52.520190 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a390522-a87e-4593-8acc-6112d6c3520a admin admin] RBAC: Authorizing `identity:delete_project(project_id=44fe8e1fc7824c4c957f9496c2e77eeb)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:52.524856 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a390522-a87e-4593-8acc-6112d6c3520a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:52.584896 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2a390522-a87e-4593-8acc-6112d6c3520a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44fe8e1fc7824c4c957f9496c2e77eeb', 'request_id': 'req-2a390522-a87e-4593-8acc-6112d6c3520a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:52.592320 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2a390522-a87e-4593-8acc-6112d6c3520a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44fe8e1fc7824c4c957f9496c2e77eeb', 'request_id': 'req-2a390522-a87e-4593-8acc-6112d6c3520a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:52.602524 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2a390522-a87e-4593-8acc-6112d6c3520a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44fe8e1fc7824c4c957f9496c2e77eeb', 'request_id': 'req-2a390522-a87e-4593-8acc-6112d6c3520a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:52.618690 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2a390522-a87e-4593-8acc-6112d6c3520a admin admin] The token cache is being invalidate because project 44fe8e1fc7824c4c957f9496c2e77eeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:52.619070 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2a390522-a87e-4593-8acc-6112d6c3520a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:52.619875 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2a390522-a87e-4593-8acc-6112d6c3520a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:52.621955 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1336/2648] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:52 2022] DELETE /identity/v3/projects/44fe8e1fc7824c4c957f9496c2e77eeb => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:52.627207 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443824f-99f5-406f-ac72-f78c5b0532c2 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:52.628809 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e443824f-99f5-406f-ac72-f78c5b0532c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:52.644968 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443824f-99f5-406f-ac72-f78c5b0532c2 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:52.728042 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf4e6c-9d76-4c9a-a800-48dde4098a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:52.729159 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf4e6c-9d76-4c9a-a800-48dde4098a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:52.729672 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf4e6c-9d76-4c9a-a800-48dde4098a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:52.730183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf4e6c-9d76-4c9a-a800-48dde4098a2d admin admin] PATH_INFO: `/v3/users/c9e127ef392f4bb0947f6e3a5837f1f3` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:52.732214 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf4e6c-9d76-4c9a-a800-48dde4098a2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9e127ef392f4bb0947f6e3a5837f1f3)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:52.736037 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf4e6c-9d76-4c9a-a800-48dde4098a2d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:52.801182 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-aedf4e6c-9d76-4c9a-a800-48dde4098a2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e127ef392f4bb0947f6e3a5837f1f3'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:52.817155 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-aedf4e6c-9d76-4c9a-a800-48dde4098a2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e127ef392f4bb0947f6e3a5837f1f3'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:52.818057 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-aedf4e6c-9d76-4c9a-a800-48dde4098a2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e127ef392f4bb0947f6e3a5837f1f3'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:52.818769 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-aedf4e6c-9d76-4c9a-a800-48dde4098a2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e127ef392f4bb0947f6e3a5837f1f3'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:52.828399 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-aedf4e6c-9d76-4c9a-a800-48dde4098a2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e127ef392f4bb0947f6e3a5837f1f3'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:52.845290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1313/2649] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:52 2022] DELETE /identity/v3/users/c9e127ef392f4bb0947f6e3a5837f1f3 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:53.127762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a390522-a87e-4593-8acc-6112d6c3520a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:53.129445 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2a390522-a87e-4593-8acc-6112d6c3520a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:53.144586 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a390522-a87e-4593-8acc-6112d6c3520a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:53.231677 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7288fd-d9ea-4370-82ab-afe918601c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:53.232841 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7288fd-d9ea-4370-82ab-afe918601c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:53.233170 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7288fd-d9ea-4370-82ab-afe918601c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:53.233545 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7288fd-d9ea-4370-82ab-afe918601c02 admin admin] PATH_INFO: `/v3/users/5e28974a80fd4901bbfe9f20d29f4420` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:53.235338 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7288fd-d9ea-4370-82ab-afe918601c02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e28974a80fd4901bbfe9f20d29f4420)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:53.238150 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7288fd-d9ea-4370-82ab-afe918601c02 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:53.249424 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf4e6c-9d76-4c9a-a800-48dde4098a2d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:53.252045 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-aedf4e6c-9d76-4c9a-a800-48dde4098a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:53.268895 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf4e6c-9d76-4c9a-a800-48dde4098a2d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:53.276266 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88809735-8e07-4aa4-92ee-800c654ae2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:53.277410 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88809735-8e07-4aa4-92ee-800c654ae2bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:53.277861 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88809735-8e07-4aa4-92ee-800c654ae2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:53.278299 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88809735-8e07-4aa4-92ee-800c654ae2bb admin admin] PATH_INFO: `/v3/projects/8364e1a812724082826171204a2652d2` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:53.280139 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88809735-8e07-4aa4-92ee-800c654ae2bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8364e1a812724082826171204a2652d2)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:53.285167 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88809735-8e07-4aa4-92ee-800c654ae2bb admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:53.336373 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5d7288fd-d9ea-4370-82ab-afe918601c02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e28974a80fd4901bbfe9f20d29f4420'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:53.355454 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5d7288fd-d9ea-4370-82ab-afe918601c02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e28974a80fd4901bbfe9f20d29f4420'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:53.356136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5d7288fd-d9ea-4370-82ab-afe918601c02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e28974a80fd4901bbfe9f20d29f4420'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:53.369055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5d7288fd-d9ea-4370-82ab-afe918601c02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e28974a80fd4901bbfe9f20d29f4420'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:53.377355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-88809735-8e07-4aa4-92ee-800c654ae2bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8364e1a812724082826171204a2652d2', 'request_id': 'req-88809735-8e07-4aa4-92ee-800c654ae2bb'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:53.380394 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:53.382205 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5d7288fd-d9ea-4370-82ab-afe918601c02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e28974a80fd4901bbfe9f20d29f4420'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:53.390070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-88809735-8e07-4aa4-92ee-800c654ae2bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8364e1a812724082826171204a2652d2', 'request_id': 'req-88809735-8e07-4aa4-92ee-800c654ae2bb'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:53.396721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1337/2650] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:53 2022] DELETE /identity/v3/users/5e28974a80fd4901bbfe9f20d29f4420 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:53.402567 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e914dc-04fb-48e0-9c45-3c271e6a954b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:53.403021 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e914dc-04fb-48e0-9c45-3c271e6a954b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:53.403449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e914dc-04fb-48e0-9c45-3c271e6a954b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:53.405642 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-88809735-8e07-4aa4-92ee-800c654ae2bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8364e1a812724082826171204a2652d2', 'request_id': 'req-88809735-8e07-4aa4-92ee-800c654ae2bb'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:53.417465 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:53.429158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-88809735-8e07-4aa4-92ee-800c654ae2bb admin admin] The token cache is being invalidate because project 8364e1a812724082826171204a2652d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:53.429719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-88809735-8e07-4aa4-92ee-800c654ae2bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:53.430538 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-88809735-8e07-4aa4-92ee-800c654ae2bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:53.432658 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1314/2651] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:53 2022] DELETE /identity/v3/projects/8364e1a812724082826171204a2652d2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:53.438873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88809735-8e07-4aa4-92ee-800c654ae2bb admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:53.439204 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-05e914dc-04fb-48e0-9c45-3c271e6a954b None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:53.441020 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-88809735-8e07-4aa4-92ee-800c654ae2bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:53.441670 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-05e914dc-04fb-48e0-9c45-3c271e6a954b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:53.556965 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1338/2652] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:53.558852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2e1f7-171d-41d6-a148-85ae1c428a3a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:53.559191 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2e1f7-171d-41d6-a148-85ae1c428a3a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:53.559476 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2e1f7-171d-41d6-a148-85ae1c428a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:53.568904 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88809735-8e07-4aa4-92ee-800c654ae2bb admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:53.587010 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-20c2e1f7-171d-41d6-a148-85ae1c428a3a None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:53.588258 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-20c2e1f7-171d-41d6-a148-85ae1c428a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:53.597599 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1339/2653] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:53.598730 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2e1f7-171d-41d6-a148-85ae1c428a3a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:53.678701 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db7302-f451-4454-bd18-43bf6e027172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:53.679601 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db7302-f451-4454-bd18-43bf6e027172 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:53.679784 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db7302-f451-4454-bd18-43bf6e027172 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:53.679964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db7302-f451-4454-bd18-43bf6e027172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:53.681973 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-44db7302-f451-4454-bd18-43bf6e027172 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:53.694590 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2e1f7-171d-41d6-a148-85ae1c428a3a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:53.701229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e089ce-b1e5-474d-987a-4f1d2795fe03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:53.702264 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e089ce-b1e5-474d-987a-4f1d2795fe03 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:53.702765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e089ce-b1e5-474d-987a-4f1d2795fe03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:53.703264 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e089ce-b1e5-474d-987a-4f1d2795fe03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:53.715919 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e089ce-b1e5-474d-987a-4f1d2795fe03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:53.717784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e089ce-b1e5-474d-987a-4f1d2795fe03 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:53.731840 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1340/2654] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:53.734066 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89ca59-3c2b-4f37-99d0-2f0d8c257036 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:53.734588 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89ca59-3c2b-4f37-99d0-2f0d8c257036 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:53.734877 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89ca59-3c2b-4f37-99d0-2f0d8c257036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:53.766230 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-dc89ca59-3c2b-4f37-99d0-2f0d8c257036 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:53.769028 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dc89ca59-3c2b-4f37-99d0-2f0d8c257036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:53.785583 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1341/2655] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:53.790610 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89ca59-3c2b-4f37-99d0-2f0d8c257036 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:53.792460 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db7302-f451-4454-bd18-43bf6e027172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:53.793996 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db7302-f451-4454-bd18-43bf6e027172 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:53.805039 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1315/2656] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:53.809988 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89ca59-3c2b-4f37-99d0-2f0d8c257036 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:53.818322 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fec5f-8bc6-49a2-85ae-e1545a37a46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:53.819428 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fec5f-8bc6-49a2-85ae-e1545a37a46f admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:53.819926 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fec5f-8bc6-49a2-85ae-e1545a37a46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:53.820413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fec5f-8bc6-49a2-85ae-e1545a37a46f admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:53.821684 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2fec5f-8bc6-49a2-85ae-e1545a37a46f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:42:53.822340 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2fec5f-8bc6-49a2-85ae-e1545a37a46f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:53.825866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2fec5f-8bc6-49a2-85ae-e1545a37a46f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:53.849670 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1342/2657] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:42:53.854391 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db7302-f451-4454-bd18-43bf6e027172 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:53.868469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db7302-f451-4454-bd18-43bf6e027172 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:53.874142 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fbd1bc-aae7-4f72-8144-a2a361e365d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:53.874893 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbd1bc-aae7-4f72-8144-a2a361e365d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:53.875260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbd1bc-aae7-4f72-8144-a2a361e365d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:53.875600 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbd1bc-aae7-4f72-8144-a2a361e365d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:53.876372 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fbd1bc-aae7-4f72-8144-a2a361e365d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:53.878834 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fbd1bc-aae7-4f72-8144-a2a361e365d8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:53.915766 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1316/2658] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:53 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:53.921178 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fec5f-8bc6-49a2-85ae-e1545a37a46f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:53.935941 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fec5f-8bc6-49a2-85ae-e1545a37a46f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:54.007579 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c14b94-f287-4aaa-9dc2-15dec275169d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:54.008300 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c14b94-f287-4aaa-9dc2-15dec275169d admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:54.008567 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c14b94-f287-4aaa-9dc2-15dec275169d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:54.008870 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c14b94-f287-4aaa-9dc2-15dec275169d admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:54.009524 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c14b94-f287-4aaa-9dc2-15dec275169d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:54.011653 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c14b94-f287-4aaa-9dc2-15dec275169d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:54.039542 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1343/2659] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:53 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:54.042990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fbd1bc-aae7-4f72-8144-a2a361e365d8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:54.054123 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fbd1bc-aae7-4f72-8144-a2a361e365d8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:54.061208 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4868d7-cbdc-45bb-ad0f-6e6b1eae85a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:54.061987 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4868d7-cbdc-45bb-ad0f-6e6b1eae85a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:54.062264 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4868d7-cbdc-45bb-ad0f-6e6b1eae85a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:54.062614 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4868d7-cbdc-45bb-ad0f-6e6b1eae85a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:54.063364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4868d7-cbdc-45bb-ad0f-6e6b1eae85a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:54.065529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4868d7-cbdc-45bb-ad0f-6e6b1eae85a1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:54.077741 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1317/2660] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:54.081995 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c14b94-f287-4aaa-9dc2-15dec275169d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:54.093474 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c14b94-f287-4aaa-9dc2-15dec275169d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:54.098449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76340086-8a93-488c-ba42-090f439d9479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:54.099141 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76340086-8a93-488c-ba42-090f439d9479 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:54.099416 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76340086-8a93-488c-ba42-090f439d9479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:54.099685 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76340086-8a93-488c-ba42-090f439d9479 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:54.100350 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76340086-8a93-488c-ba42-090f439d9479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:54.102092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76340086-8a93-488c-ba42-090f439d9479 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:54.109036 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:54.118622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1344/2661] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:42:54.124253 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4868d7-cbdc-45bb-ad0f-6e6b1eae85a1 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:54.137626 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4868d7-cbdc-45bb-ad0f-6e6b1eae85a1 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:54.143122 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722304d-e780-455b-93d7-0bf6e0496430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:54.143802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722304d-e780-455b-93d7-0bf6e0496430 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:54.144076 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722304d-e780-455b-93d7-0bf6e0496430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:54.144356 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722304d-e780-455b-93d7-0bf6e0496430 admin admin] PATH_INFO: `/v3/projects/9236057409684fcdba6ff21d95d9b280/users/346c7c12d460417f95809972cea0ecf6/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:54.165509 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722304d-e780-455b-93d7-0bf6e0496430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9236057409684fcdba6ff21d95d9b280, user_id=346c7c12d460417f95809972cea0ecf6, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:54.168387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722304d-e780-455b-93d7-0bf6e0496430 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:54.171173 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:54.188517 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1318/2662] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:54 2022] PUT /identity/v3/projects/9236057409684fcdba6ff21d95d9b280/users/346c7c12d460417f95809972cea0ecf6/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:54.199442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b13646-d965-4448-89a9-693d9b5af583 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:54.199766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b13646-d965-4448-89a9-693d9b5af583 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:54.199975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b13646-d965-4448-89a9-693d9b5af583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:54.233745 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-11b13646-d965-4448-89a9-693d9b5af583 None None] MFA Rules not processed for user `346c7c12d460417f95809972cea0ecf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:54.235063 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-11b13646-d965-4448-89a9-693d9b5af583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:54.346521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1345/2663] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:54.361123 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722304d-e780-455b-93d7-0bf6e0496430 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:54.363269 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6722304d-e780-455b-93d7-0bf6e0496430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:54.466894 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722304d-e780-455b-93d7-0bf6e0496430 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:54.473429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a2afc-c536-4d51-bfc5-9a1d014f1e8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:54.475021 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a2afc-c536-4d51-bfc5-9a1d014f1e8b service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:54.475513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a2afc-c536-4d51-bfc5-9a1d014f1e8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:54.475989 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a2afc-c536-4d51-bfc5-9a1d014f1e8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:54.493564 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a2afc-c536-4d51-bfc5-9a1d014f1e8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:54.496261 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a2afc-c536-4d51-bfc5-9a1d014f1e8b service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:54.517223 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1319/2664] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:42:54.525177 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b13646-d965-4448-89a9-693d9b5af583 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:54.527779 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-11b13646-d965-4448-89a9-693d9b5af583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:54.711940 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b13646-d965-4448-89a9-693d9b5af583 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:54.722225 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db996d39-f3e0-4613-91db-bffb1e66f82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:54.723060 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db996d39-f3e0-4613-91db-bffb1e66f82d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:54.723439 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db996d39-f3e0-4613-91db-bffb1e66f82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:54.724979 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db996d39-f3e0-4613-91db-bffb1e66f82d admin admin] PATH_INFO: `/v3/projects/027cfde8b2c743f7a986f5a516b6029f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:54.726046 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db996d39-f3e0-4613-91db-bffb1e66f82d admin admin] RBAC: Authorizing `identity:delete_project(project_id=027cfde8b2c743f7a986f5a516b6029f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:54.728502 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db996d39-f3e0-4613-91db-bffb1e66f82d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:54.821577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-db996d39-f3e0-4613-91db-bffb1e66f82d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '027cfde8b2c743f7a986f5a516b6029f', 'request_id': 'req-db996d39-f3e0-4613-91db-bffb1e66f82d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:54.845096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-db996d39-f3e0-4613-91db-bffb1e66f82d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '027cfde8b2c743f7a986f5a516b6029f', 'request_id': 'req-db996d39-f3e0-4613-91db-bffb1e66f82d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:54.861876 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-db996d39-f3e0-4613-91db-bffb1e66f82d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '027cfde8b2c743f7a986f5a516b6029f', 'request_id': 'req-db996d39-f3e0-4613-91db-bffb1e66f82d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:54.895971 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-db996d39-f3e0-4613-91db-bffb1e66f82d admin admin] The token cache is being invalidate because project 027cfde8b2c743f7a986f5a516b6029f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:54.896372 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-db996d39-f3e0-4613-91db-bffb1e66f82d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:54.898421 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-db996d39-f3e0-4613-91db-bffb1e66f82d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:54.900507 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1346/2665] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:54 2022] DELETE /identity/v3/projects/027cfde8b2c743f7a986f5a516b6029f => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:54.907206 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7c5ba-7763-4118-b310-0a760eeeee03 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:54.907982 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7c5ba-7763-4118-b310-0a760eeeee03 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:54.907982 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7c5ba-7763-4118-b310-0a760eeeee03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:54.947641 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-92f7c5ba-7763-4118-b310-0a760eeeee03 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:54.948841 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-92f7c5ba-7763-4118-b310-0a760eeeee03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:55.046646 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1320/2666] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:55.059499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4183ef8-cc1d-4867-8a3f-e2b41925545d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:55.059933 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4183ef8-cc1d-4867-8a3f-e2b41925545d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:55.060392 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4183ef8-cc1d-4867-8a3f-e2b41925545d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:55.104928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b4183ef8-cc1d-4867-8a3f-e2b41925545d None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:55.104928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b4183ef8-cc1d-4867-8a3f-e2b41925545d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:55.116051 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1347/2667] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:55.121580 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7c5ba-7763-4118-b310-0a760eeeee03 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:55.134599 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7c5ba-7763-4118-b310-0a760eeeee03 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:55.149349 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e74927-aa53-438e-a364-4f5aba2a33a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:55.149927 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e74927-aa53-438e-a364-4f5aba2a33a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:55.150190 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e74927-aa53-438e-a364-4f5aba2a33a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:55.152443 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e74927-aa53-438e-a364-4f5aba2a33a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:55.153042 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e74927-aa53-438e-a364-4f5aba2a33a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:42:55.153342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e74927-aa53-438e-a364-4f5aba2a33a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:55.155014 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e74927-aa53-438e-a364-4f5aba2a33a7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:55.199536 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1321/2668] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:42:55.206927 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4183ef8-cc1d-4867-8a3f-e2b41925545d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:55.249077 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4183ef8-cc1d-4867-8a3f-e2b41925545d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:55.264012 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bd8e1-3757-4f37-bee2-01c11faab532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:55.265475 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bd8e1-3757-4f37-bee2-01c11faab532 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:55.266315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bd8e1-3757-4f37-bee2-01c11faab532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:55.267224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bd8e1-3757-4f37-bee2-01c11faab532 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:55.268569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bd8e1-3757-4f37-bee2-01c11faab532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:55.273395 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bd8e1-3757-4f37-bee2-01c11faab532 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:55.297875 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:55.333984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1348/2669] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:55 2022] POST /identity/v3/projects => generated 389 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:42:55.335489 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e74927-aa53-438e-a364-4f5aba2a33a7 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:55.359255 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e74927-aa53-438e-a364-4f5aba2a33a7 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:55.524530 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af58d40-6044-4d64-b0d2-366c12a82d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:55.526193 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af58d40-6044-4d64-b0d2-366c12a82d69 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:55.526985 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af58d40-6044-4d64-b0d2-366c12a82d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:55.527550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af58d40-6044-4d64-b0d2-366c12a82d69 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:55.528868 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af58d40-6044-4d64-b0d2-366c12a82d69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:55.532753 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af58d40-6044-4d64-b0d2-366c12a82d69 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:55.580202 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1322/2670] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:55 2022] POST /identity/v3/users => generated 295 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:55.581315 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bd8e1-3757-4f37-bee2-01c11faab532 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:55.594779 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bd8e1-3757-4f37-bee2-01c11faab532 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:55.603265 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac3042-028b-414c-8c25-01c01fe7b7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:55.604518 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac3042-028b-414c-8c25-01c01fe7b7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:55.605484 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac3042-028b-414c-8c25-01c01fe7b7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:55.606026 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac3042-028b-414c-8c25-01c01fe7b7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:55.607006 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac3042-028b-414c-8c25-01c01fe7b7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:55.609636 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac3042-028b-414c-8c25-01c01fe7b7c1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:55.624233 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1349/2671] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:42:55.631254 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af58d40-6044-4d64-b0d2-366c12a82d69 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:55.654549 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af58d40-6044-4d64-b0d2-366c12a82d69 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:55.661719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037be82-0933-4f4a-beae-45090e3d4291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:55.662662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037be82-0933-4f4a-beae-45090e3d4291 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:55.663111 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037be82-0933-4f4a-beae-45090e3d4291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:55.663541 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037be82-0933-4f4a-beae-45090e3d4291 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:55.664434 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037be82-0933-4f4a-beae-45090e3d4291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:55.666781 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037be82-0933-4f4a-beae-45090e3d4291 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:55.681196 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1323/2672] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:55.686817 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac3042-028b-414c-8c25-01c01fe7b7c1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:55.703055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac3042-028b-414c-8c25-01c01fe7b7c1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:55.712049 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94b2f7-ee12-4faf-b225-faa9da21ad78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:55.712049 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94b2f7-ee12-4faf-b225-faa9da21ad78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:55.713338 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94b2f7-ee12-4faf-b225-faa9da21ad78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:55.713338 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94b2f7-ee12-4faf-b225-faa9da21ad78 admin admin] PATH_INFO: `/v3/projects/05b2d26c4e6e407fa8ea588ac160c7c5/users/f2da3d73d7da4831badcf1bcd733160d/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:55.735614 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94b2f7-ee12-4faf-b225-faa9da21ad78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05b2d26c4e6e407fa8ea588ac160c7c5, user_id=f2da3d73d7da4831badcf1bcd733160d, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:55.738322 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94b2f7-ee12-4faf-b225-faa9da21ad78 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:55.756790 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1350/2673] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:55 2022] PUT /identity/v3/projects/05b2d26c4e6e407fa8ea588ac160c7c5/users/f2da3d73d7da4831badcf1bcd733160d/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:55.770834 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf1440-6ceb-41f7-9f64-fb7e57efa76e None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:55.771734 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf1440-6ceb-41f7-9f64-fb7e57efa76e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:55.772112 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf1440-6ceb-41f7-9f64-fb7e57efa76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:55.780890 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:55.813397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ddaf1440-6ceb-41f7-9f64-fb7e57efa76e None None] MFA Rules not processed for user `f2da3d73d7da4831badcf1bcd733160d`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:55.814790 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ddaf1440-6ceb-41f7-9f64-fb7e57efa76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:55.922867 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1324/2674] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:42:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:55.936060 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94b2f7-ee12-4faf-b225-faa9da21ad78 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:55.938052 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cd94b2f7-ee12-4faf-b225-faa9da21ad78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:56.021243 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94b2f7-ee12-4faf-b225-faa9da21ad78 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:56.025915 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cacc0-b94c-4745-a3ff-41eee57069c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:56.026916 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cacc0-b94c-4745-a3ff-41eee57069c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:56.027404 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cacc0-b94c-4745-a3ff-41eee57069c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:56.027880 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cacc0-b94c-4745-a3ff-41eee57069c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:56.038785 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68cacc0-b94c-4745-a3ff-41eee57069c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:56.040706 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68cacc0-b94c-4745-a3ff-41eee57069c9 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:56.055226 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1351/2675] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:55 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:43:00.855943 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf1440-6ceb-41f7-9f64-fb7e57efa76e None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:00.858655 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ddaf1440-6ceb-41f7-9f64-fb7e57efa76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:00.965051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf1440-6ceb-41f7-9f64-fb7e57efa76e None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:00.975110 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee09ba0-d7b0-4a7a-80ee-b536b85d95fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:00.976100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee09ba0-d7b0-4a7a-80ee-b536b85d95fe service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:00.980223 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee09ba0-d7b0-4a7a-80ee-b536b85d95fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:00.981078 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee09ba0-d7b0-4a7a-80ee-b536b85d95fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:00.983743 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7ee09ba0-d7b0-4a7a-80ee-b536b85d95fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:01.114896 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee09ba0-d7b0-4a7a-80ee-b536b85d95fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:01.116610 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee09ba0-d7b0-4a7a-80ee-b536b85d95fe service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:01.135113 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1325/2676] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:43:05.930451 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cacc0-b94c-4745-a3ff-41eee57069c9 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:05.933142 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b68cacc0-b94c-4745-a3ff-41eee57069c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:05.974916 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cacc0-b94c-4745-a3ff-41eee57069c9 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:05.988125 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad422b-3f37-4ce3-86cd-dd48d684f217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:05.990711 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad422b-3f37-4ce3-86cd-dd48d684f217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:05.991316 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad422b-3f37-4ce3-86cd-dd48d684f217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:05.992196 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad422b-3f37-4ce3-86cd-dd48d684f217 admin admin] PATH_INFO: `/v3/users/a982359c8a8f4ba8a47c71f07de9b3dd` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:05.998304 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad422b-3f37-4ce3-86cd-dd48d684f217 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a982359c8a8f4ba8a47c71f07de9b3dd)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:06.022220 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad422b-3f37-4ce3-86cd-dd48d684f217 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:06.139649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-afad422b-3f37-4ce3-86cd-dd48d684f217 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a982359c8a8f4ba8a47c71f07de9b3dd'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:06.176809 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-afad422b-3f37-4ce3-86cd-dd48d684f217 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a982359c8a8f4ba8a47c71f07de9b3dd'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:06.179937 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-afad422b-3f37-4ce3-86cd-dd48d684f217 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a982359c8a8f4ba8a47c71f07de9b3dd'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:06.207159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-afad422b-3f37-4ce3-86cd-dd48d684f217 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a982359c8a8f4ba8a47c71f07de9b3dd'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:06.231976 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-afad422b-3f37-4ce3-86cd-dd48d684f217 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a982359c8a8f4ba8a47c71f07de9b3dd'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:06.248349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1352/2677] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:05 2022] DELETE /identity/v3/users/a982359c8a8f4ba8a47c71f07de9b3dd => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:06.253169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdd4fd-b98d-4231-b857-c12c9a9858f8 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:06.254373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdd4fd-b98d-4231-b857-c12c9a9858f8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:06.256217 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdd4fd-b98d-4231-b857-c12c9a9858f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:06.279619 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-04bdd4fd-b98d-4231-b857-c12c9a9858f8 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:06.281132 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-04bdd4fd-b98d-4231-b857-c12c9a9858f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:06.373966 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:06.428500 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1326/2678] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:06.442009 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad422b-3f37-4ce3-86cd-dd48d684f217 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:06.443610 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-afad422b-3f37-4ce3-86cd-dd48d684f217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:06.490756 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:06.533138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad422b-3f37-4ce3-86cd-dd48d684f217 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:06.542145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226a0ba-bd14-4689-8760-bea589f77ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:06.543428 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226a0ba-bd14-4689-8760-bea589f77ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:06.543998 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226a0ba-bd14-4689-8760-bea589f77ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:06.544479 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226a0ba-bd14-4689-8760-bea589f77ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:06.563468 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226a0ba-bd14-4689-8760-bea589f77ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:06.566450 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226a0ba-bd14-4689-8760-bea589f77ba8 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:06.589139 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1353/2679] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:43:07.198610 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bdd4fd-b98d-4231-b857-c12c9a9858f8 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:07.200977 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-04bdd4fd-b98d-4231-b857-c12c9a9858f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:07.224749 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bdd4fd-b98d-4231-b857-c12c9a9858f8 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:07.233259 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c580569-fcbf-47af-918d-4023bc3cedec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:07.234806 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c580569-fcbf-47af-918d-4023bc3cedec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:07.235303 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c580569-fcbf-47af-918d-4023bc3cedec admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:07.235767 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c580569-fcbf-47af-918d-4023bc3cedec admin admin] PATH_INFO: `/v3/projects/1a3b8ebe028e4433bd56f6240c292057` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:07.237993 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c580569-fcbf-47af-918d-4023bc3cedec admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a3b8ebe028e4433bd56f6240c292057)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:07.242280 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c580569-fcbf-47af-918d-4023bc3cedec admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:07.329472 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7c580569-fcbf-47af-918d-4023bc3cedec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a3b8ebe028e4433bd56f6240c292057', 'request_id': 'req-7c580569-fcbf-47af-918d-4023bc3cedec'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:07.339505 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7c580569-fcbf-47af-918d-4023bc3cedec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a3b8ebe028e4433bd56f6240c292057', 'request_id': 'req-7c580569-fcbf-47af-918d-4023bc3cedec'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:07.352502 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7c580569-fcbf-47af-918d-4023bc3cedec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a3b8ebe028e4433bd56f6240c292057', 'request_id': 'req-7c580569-fcbf-47af-918d-4023bc3cedec'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:07.381765 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7c580569-fcbf-47af-918d-4023bc3cedec admin admin] The token cache is being invalidate because project 1a3b8ebe028e4433bd56f6240c292057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:07.381765 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7c580569-fcbf-47af-918d-4023bc3cedec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:07.382297 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7c580569-fcbf-47af-918d-4023bc3cedec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:07.384769 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1327/2680] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:07 2022] DELETE /identity/v3/projects/1a3b8ebe028e4433bd56f6240c292057 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:07.393569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226a0ba-bd14-4689-8760-bea589f77ba8 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:07.417783 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226a0ba-bd14-4689-8760-bea589f77ba8 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:07.465797 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c580569-fcbf-47af-918d-4023bc3cedec admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:07.468833 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7c580569-fcbf-47af-918d-4023bc3cedec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:07.554464 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab077b8b-4958-4b50-96de-984b643807a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:07.555926 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab077b8b-4958-4b50-96de-984b643807a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:07.556489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab077b8b-4958-4b50-96de-984b643807a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:07.557076 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab077b8b-4958-4b50-96de-984b643807a7 admin admin] PATH_INFO: `/v3/users/c68aeb86ebee437bae84b0e333f582df` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:07.560189 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab077b8b-4958-4b50-96de-984b643807a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c68aeb86ebee437bae84b0e333f582df)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:07.564396 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab077b8b-4958-4b50-96de-984b643807a7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:07.656449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c580569-fcbf-47af-918d-4023bc3cedec admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:07.665284 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d2175-c726-40c4-8b87-8dfa30e357f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:07.665942 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d2175-c726-40c4-8b87-8dfa30e357f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:07.666205 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d2175-c726-40c4-8b87-8dfa30e357f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:07.666374 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ab077b8b-4958-4b50-96de-984b643807a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c68aeb86ebee437bae84b0e333f582df'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:07.666533 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d2175-c726-40c4-8b87-8dfa30e357f8 admin admin] PATH_INFO: `/v3/users/346c7c12d460417f95809972cea0ecf6` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:07.667766 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d2175-c726-40c4-8b87-8dfa30e357f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=346c7c12d460417f95809972cea0ecf6)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:07.670546 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d2175-c726-40c4-8b87-8dfa30e357f8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:07.688344 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ab077b8b-4958-4b50-96de-984b643807a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c68aeb86ebee437bae84b0e333f582df'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:07.689245 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ab077b8b-4958-4b50-96de-984b643807a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c68aeb86ebee437bae84b0e333f582df'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:07.701429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ab077b8b-4958-4b50-96de-984b643807a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c68aeb86ebee437bae84b0e333f582df'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:07.716695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ab077b8b-4958-4b50-96de-984b643807a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c68aeb86ebee437bae84b0e333f582df'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:07.728172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1354/2681] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:07 2022] DELETE /identity/v3/users/c68aeb86ebee437bae84b0e333f582df => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:07.746763 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-625d2175-c726-40c4-8b87-8dfa30e357f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '346c7c12d460417f95809972cea0ecf6'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:07.775092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-625d2175-c726-40c4-8b87-8dfa30e357f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '346c7c12d460417f95809972cea0ecf6'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:07.776278 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-625d2175-c726-40c4-8b87-8dfa30e357f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '346c7c12d460417f95809972cea0ecf6'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:07.777441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-625d2175-c726-40c4-8b87-8dfa30e357f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '346c7c12d460417f95809972cea0ecf6'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:07.782704 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:07.796680 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-625d2175-c726-40c4-8b87-8dfa30e357f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '346c7c12d460417f95809972cea0ecf6'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:07.825975 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1328/2682] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:07 2022] DELETE /identity/v3/users/346c7c12d460417f95809972cea0ecf6 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:07.829294 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bc3c3-1076-4f66-8c2f-a8fc5f05db61 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:07.829294 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bc3c3-1076-4f66-8c2f-a8fc5f05db61 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:07.829848 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bc3c3-1076-4f66-8c2f-a8fc5f05db61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:07.871195 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-fd3bc3c3-1076-4f66-8c2f-a8fc5f05db61 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:07.873778 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fd3bc3c3-1076-4f66-8c2f-a8fc5f05db61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:07.983765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:08.021988 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1355/2683] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:08.039773 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d2175-c726-40c4-8b87-8dfa30e357f8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:08.041673 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-625d2175-c726-40c4-8b87-8dfa30e357f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:08.079887 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bc3c3-1076-4f66-8c2f-a8fc5f05db61 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:08.082073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fd3bc3c3-1076-4f66-8c2f-a8fc5f05db61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:08.105185 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bc3c3-1076-4f66-8c2f-a8fc5f05db61 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:08.126804 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc622ac4-b951-4e6d-95d9-4248fa0268cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:08.128124 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc622ac4-b951-4e6d-95d9-4248fa0268cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:08.128851 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc622ac4-b951-4e6d-95d9-4248fa0268cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:08.132974 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc622ac4-b951-4e6d-95d9-4248fa0268cf admin admin] PATH_INFO: `/v3/users/f2da3d73d7da4831badcf1bcd733160d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:08.137431 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc622ac4-b951-4e6d-95d9-4248fa0268cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2da3d73d7da4831badcf1bcd733160d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:08.142500 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc622ac4-b951-4e6d-95d9-4248fa0268cf admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:08.224016 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d2175-c726-40c4-8b87-8dfa30e357f8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:08.234482 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8bdc0-16a3-47a8-91f9-20f981d0da36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:08.235583 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8bdc0-16a3-47a8-91f9-20f981d0da36 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:08.236156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8bdc0-16a3-47a8-91f9-20f981d0da36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:08.236750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8bdc0-16a3-47a8-91f9-20f981d0da36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:08.257824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8bdc0-16a3-47a8-91f9-20f981d0da36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:08.261008 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8bdc0-16a3-47a8-91f9-20f981d0da36 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:08.265339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-dc622ac4-b951-4e6d-95d9-4248fa0268cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2da3d73d7da4831badcf1bcd733160d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:08.287222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1329/2684] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:08.307822 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-dc622ac4-b951-4e6d-95d9-4248fa0268cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2da3d73d7da4831badcf1bcd733160d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:08.309919 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-dc622ac4-b951-4e6d-95d9-4248fa0268cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2da3d73d7da4831badcf1bcd733160d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:08.326470 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-dc622ac4-b951-4e6d-95d9-4248fa0268cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2da3d73d7da4831badcf1bcd733160d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:08.346720 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-dc622ac4-b951-4e6d-95d9-4248fa0268cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2da3d73d7da4831badcf1bcd733160d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:08.347314 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8bdc0-16a3-47a8-91f9-20f981d0da36 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:08.355476 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c6b8bdc0-16a3-47a8-91f9-20f981d0da36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:08.360272 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1356/2685] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:08 2022] DELETE /identity/v3/users/f2da3d73d7da4831badcf1bcd733160d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:08.369143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1d3dd-fbe5-4190-819c-4a1cc096f7b3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:08.370273 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1d3dd-fbe5-4190-819c-4a1cc096f7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:08.370972 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1d3dd-fbe5-4190-819c-4a1cc096f7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:08.372586 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8bdc0-16a3-47a8-91f9-20f981d0da36 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:08.420425 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2ac1d3dd-fbe5-4190-819c-4a1cc096f7b3 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:08.425177 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2ac1d3dd-fbe5-4190-819c-4a1cc096f7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:08.529321 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c768c3-8502-48ef-bd6f-d0aa3aefce35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:08.531944 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c768c3-8502-48ef-bd6f-d0aa3aefce35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:08.532888 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c768c3-8502-48ef-bd6f-d0aa3aefce35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:08.533836 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c768c3-8502-48ef-bd6f-d0aa3aefce35 admin admin] PATH_INFO: `/v3/projects/a595fa308887469592fd84675cba57d2` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:08.537093 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c768c3-8502-48ef-bd6f-d0aa3aefce35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a595fa308887469592fd84675cba57d2)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:08.542900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c768c3-8502-48ef-bd6f-d0aa3aefce35 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:08.561189 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1357/2686] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:08.577811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1d3dd-fbe5-4190-819c-4a1cc096f7b3 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:08.579927 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2ac1d3dd-fbe5-4190-819c-4a1cc096f7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:08.700035 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1d3dd-fbe5-4190-819c-4a1cc096f7b3 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:08.713960 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-13c768c3-8502-48ef-bd6f-d0aa3aefce35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a595fa308887469592fd84675cba57d2', 'request_id': 'req-13c768c3-8502-48ef-bd6f-d0aa3aefce35'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:08.742374 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-13c768c3-8502-48ef-bd6f-d0aa3aefce35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a595fa308887469592fd84675cba57d2', 'request_id': 'req-13c768c3-8502-48ef-bd6f-d0aa3aefce35'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:08.765252 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:08.774440 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-13c768c3-8502-48ef-bd6f-d0aa3aefce35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a595fa308887469592fd84675cba57d2', 'request_id': 'req-13c768c3-8502-48ef-bd6f-d0aa3aefce35'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:08.822590 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-13c768c3-8502-48ef-bd6f-d0aa3aefce35 admin admin] The token cache is being invalidate because project a595fa308887469592fd84675cba57d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:08.823174 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-13c768c3-8502-48ef-bd6f-d0aa3aefce35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:08.824320 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-13c768c3-8502-48ef-bd6f-d0aa3aefce35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:08.827480 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1330/2687] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:08 2022] DELETE /identity/v3/projects/a595fa308887469592fd84675cba57d2 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:08.833674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcd6d6-b04b-474a-8d25-5d8da115c087 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:08.834324 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcd6d6-b04b-474a-8d25-5d8da115c087 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:08.834717 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcd6d6-b04b-474a-8d25-5d8da115c087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:08.854349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c69944-de41-4e49-8398-497119c194db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:08.855109 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c69944-de41-4e49-8398-497119c194db service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:08.855411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c69944-de41-4e49-8398-497119c194db service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:08.855734 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c69944-de41-4e49-8398-497119c194db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:08.861683 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d2c69944-de41-4e49-8398-497119c194db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:08.883652 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ccfcd6d6-b04b-474a-8d25-5d8da115c087 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:08.888733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ccfcd6d6-b04b-474a-8d25-5d8da115c087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:08.911542 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:08.988423 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c69944-de41-4e49-8398-497119c194db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:08.990872 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c69944-de41-4e49-8398-497119c194db service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:09.005708 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1358/2688] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:09.032867 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1331/2689] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:09.044839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328aca38-16cb-4232-b210-47ebc027dce8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:09.045708 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328aca38-16cb-4232-b210-47ebc027dce8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:09.053484 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328aca38-16cb-4232-b210-47ebc027dce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:09.107279 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-328aca38-16cb-4232-b210-47ebc027dce8 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:09.109530 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-328aca38-16cb-4232-b210-47ebc027dce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:09.132128 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1359/2690] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:09.134645 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfcd6d6-b04b-474a-8d25-5d8da115c087 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:09.149162 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfcd6d6-b04b-474a-8d25-5d8da115c087 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:09.155689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bcdfe-757b-4a11-ac2b-d4d52ce97056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:09.158381 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bcdfe-757b-4a11-ac2b-d4d52ce97056 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:09.158948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bcdfe-757b-4a11-ac2b-d4d52ce97056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:09.159540 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bcdfe-757b-4a11-ac2b-d4d52ce97056 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:09.160576 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285bcdfe-757b-4a11-ac2b-d4d52ce97056 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:09.161192 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285bcdfe-757b-4a11-ac2b-d4d52ce97056 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:09.163571 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285bcdfe-757b-4a11-ac2b-d4d52ce97056 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:09.193324 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1332/2691] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:43:09.193685 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328aca38-16cb-4232-b210-47ebc027dce8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:09.208227 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328aca38-16cb-4232-b210-47ebc027dce8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:09.218653 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7a199-377c-493e-8864-674ea67f4b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:09.219650 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7a199-377c-493e-8864-674ea67f4b45 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:09.220047 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7a199-377c-493e-8864-674ea67f4b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:09.220504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7a199-377c-493e-8864-674ea67f4b45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:09.221505 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7a199-377c-493e-8864-674ea67f4b45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:09.224163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7a199-377c-493e-8864-674ea67f4b45 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:09.295880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bcdfe-757b-4a11-ac2b-d4d52ce97056 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:09.298280 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1360/2692] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:09 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:09.318622 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bcdfe-757b-4a11-ac2b-d4d52ce97056 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:09.361164 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7a199-377c-493e-8864-674ea67f4b45 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:09.363484 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4cb7a199-377c-493e-8864-674ea67f4b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:09.528648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a54a4b-9761-421b-bddc-080256102234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:09.528648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a54a4b-9761-421b-bddc-080256102234 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:09.529685 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a54a4b-9761-421b-bddc-080256102234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:09.529685 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a54a4b-9761-421b-bddc-080256102234 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:09.531146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a54a4b-9761-421b-bddc-080256102234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:09.535913 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a54a4b-9761-421b-bddc-080256102234 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:09.629757 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1333/2693] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:09 2022] POST /identity/v3/users => generated 289 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:09.635068 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7a199-377c-493e-8864-674ea67f4b45 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:09.638266 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a54a4b-9761-421b-bddc-080256102234 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:09.650658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a70405-9e20-492b-8a6d-6758428e23a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:09.652137 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a70405-9e20-492b-8a6d-6758428e23a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:09.652831 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a70405-9e20-492b-8a6d-6758428e23a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:09.653424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a70405-9e20-492b-8a6d-6758428e23a8 admin admin] PATH_INFO: `/v3/projects/9236057409684fcdba6ff21d95d9b280` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:09.657180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a70405-9e20-492b-8a6d-6758428e23a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9236057409684fcdba6ff21d95d9b280)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:09.661971 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a70405-9e20-492b-8a6d-6758428e23a8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:09.673665 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a54a4b-9761-421b-bddc-080256102234 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:09.687437 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62480725-f048-4fc8-9e6c-5eb01449b383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:09.689611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62480725-f048-4fc8-9e6c-5eb01449b383 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:09.690643 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62480725-f048-4fc8-9e6c-5eb01449b383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:09.691526 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62480725-f048-4fc8-9e6c-5eb01449b383 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:09.696385 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62480725-f048-4fc8-9e6c-5eb01449b383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:09.702183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62480725-f048-4fc8-9e6c-5eb01449b383 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:09.733513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1334/2694] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:09.739485 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62480725-f048-4fc8-9e6c-5eb01449b383 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:09.759529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62480725-f048-4fc8-9e6c-5eb01449b383 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:09.794024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:09.802446 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a4a70405-9e20-492b-8a6d-6758428e23a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9236057409684fcdba6ff21d95d9b280', 'request_id': 'req-a4a70405-9e20-492b-8a6d-6758428e23a8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:09.815172 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a4a70405-9e20-492b-8a6d-6758428e23a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9236057409684fcdba6ff21d95d9b280', 'request_id': 'req-a4a70405-9e20-492b-8a6d-6758428e23a8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:09.836972 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a4a70405-9e20-492b-8a6d-6758428e23a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9236057409684fcdba6ff21d95d9b280', 'request_id': 'req-a4a70405-9e20-492b-8a6d-6758428e23a8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:09.855999 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a4a70405-9e20-492b-8a6d-6758428e23a8 admin admin] The token cache is being invalidate because project 9236057409684fcdba6ff21d95d9b280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:09.856361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a4a70405-9e20-492b-8a6d-6758428e23a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:09.861298 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a4a70405-9e20-492b-8a6d-6758428e23a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:09.863384 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1361/2695] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:09 2022] DELETE /identity/v3/projects/9236057409684fcdba6ff21d95d9b280 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:09.868898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c48e2-d6a4-4863-bbc2-b4f81d22f1de None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:09.869229 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c48e2-d6a4-4863-bbc2-b4f81d22f1de None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:09.869450 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c48e2-d6a4-4863-bbc2-b4f81d22f1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:09.908533 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-034c48e2-d6a4-4863-bbc2-b4f81d22f1de None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:09.909921 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-034c48e2-d6a4-4863-bbc2-b4f81d22f1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:09.989954 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae184633-b282-42a5-a479-ddd47a8a3fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:09.990608 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae184633-b282-42a5-a479-ddd47a8a3fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:09.990881 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae184633-b282-42a5-a479-ddd47a8a3fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:09.991156 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae184633-b282-42a5-a479-ddd47a8a3fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:09.991975 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae184633-b282-42a5-a479-ddd47a8a3fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:09.994019 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae184633-b282-42a5-a479-ddd47a8a3fd6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:10.011471 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1335/2696] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:10.022801 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae184633-b282-42a5-a479-ddd47a8a3fd6 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:10.025830 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ae184633-b282-42a5-a479-ddd47a8a3fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:10.070774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1362/2697] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:10.070774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c48e2-d6a4-4863-bbc2-b4f81d22f1de None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:10.070774 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-034c48e2-d6a4-4863-bbc2-b4f81d22f1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:10.090995 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae184633-b282-42a5-a479-ddd47a8a3fd6 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:10.091206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c48e2-d6a4-4863-bbc2-b4f81d22f1de None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:10.105259 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb33bf-fc80-4809-9ab9-4203e93fe1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:10.107418 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb33bf-fc80-4809-9ab9-4203e93fe1d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:10.107845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb33bf-fc80-4809-9ab9-4203e93fe1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:10.108690 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3bc65-5fe4-4c3d-a202-e0faf7c3928f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:10.109257 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb33bf-fc80-4809-9ab9-4203e93fe1d9 admin admin] PATH_INFO: `/v3/projects/05b2d26c4e6e407fa8ea588ac160c7c5` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:10.112133 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3bc65-5fe4-4c3d-a202-e0faf7c3928f admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:10.113904 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb33bf-fc80-4809-9ab9-4203e93fe1d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05b2d26c4e6e407fa8ea588ac160c7c5)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:10.114291 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3bc65-5fe4-4c3d-a202-e0faf7c3928f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:10.114733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3bc65-5fe4-4c3d-a202-e0faf7c3928f admin admin] PATH_INFO: `/v3/projects/fbedd79ef72240bd85381e97b818489d/users/817214f367d548609f9e2130f4a82774/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:10.117372 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb33bf-fc80-4809-9ab9-4203e93fe1d9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:10.193794 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3bc65-5fe4-4c3d-a202-e0faf7c3928f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbedd79ef72240bd85381e97b818489d, user_id=817214f367d548609f9e2130f4a82774, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:10.200026 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3bc65-5fe4-4c3d-a202-e0faf7c3928f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:10.208902 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:10.211343 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bcfb33bf-fc80-4809-9ab9-4203e93fe1d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05b2d26c4e6e407fa8ea588ac160c7c5', 'request_id': 'req-bcfb33bf-fc80-4809-9ab9-4203e93fe1d9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:10.227496 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bcfb33bf-fc80-4809-9ab9-4203e93fe1d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05b2d26c4e6e407fa8ea588ac160c7c5', 'request_id': 'req-bcfb33bf-fc80-4809-9ab9-4203e93fe1d9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:10.253761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1336/2698] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:10 2022] PUT /identity/v3/projects/fbedd79ef72240bd85381e97b818489d/users/817214f367d548609f9e2130f4a82774/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:10.259668 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bcfb33bf-fc80-4809-9ab9-4203e93fe1d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05b2d26c4e6e407fa8ea588ac160c7c5', 'request_id': 'req-bcfb33bf-fc80-4809-9ab9-4203e93fe1d9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:10.261239 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe44ea3-fc3d-4043-976e-14f4b8eaf636 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:10.261692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe44ea3-fc3d-4043-976e-14f4b8eaf636 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:10.262125 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe44ea3-fc3d-4043-976e-14f4b8eaf636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:10.289958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bcfb33bf-fc80-4809-9ab9-4203e93fe1d9 admin admin] The token cache is being invalidate because project 05b2d26c4e6e407fa8ea588ac160c7c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:10.289958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bcfb33bf-fc80-4809-9ab9-4203e93fe1d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:10.291957 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bcfb33bf-fc80-4809-9ab9-4203e93fe1d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:10.297644 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1363/2699] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:10 2022] DELETE /identity/v3/projects/05b2d26c4e6e407fa8ea588ac160c7c5 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:10.311255 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f645121-476f-4c19-aa58-4536eb205aa3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:10.311714 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f645121-476f-4c19-aa58-4536eb205aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:10.312160 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f645121-476f-4c19-aa58-4536eb205aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:10.315578 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-abe44ea3-fc3d-4043-976e-14f4b8eaf636 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:10.319036 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-abe44ea3-fc3d-4043-976e-14f4b8eaf636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:10.457336 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4f645121-476f-4c19-aa58-4536eb205aa3 None None] MFA Rules not processed for user `817214f367d548609f9e2130f4a82774`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:10.462156 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4f645121-476f-4c19-aa58-4536eb205aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:10.615970 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:10.629018 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1337/2700] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:10.630730 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe44ea3-fc3d-4043-976e-14f4b8eaf636 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:10.640433 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-abe44ea3-fc3d-4043-976e-14f4b8eaf636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:10.674913 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1364/2701] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:10.676038 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f645121-476f-4c19-aa58-4536eb205aa3 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:10.703551 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f645121-476f-4c19-aa58-4536eb205aa3 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:10.717632 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566dba9-3336-40f5-8d05-31491c330525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:10.719206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566dba9-3336-40f5-8d05-31491c330525 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:10.719886 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566dba9-3336-40f5-8d05-31491c330525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:10.720399 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566dba9-3336-40f5-8d05-31491c330525 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:10.721331 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566dba9-3336-40f5-8d05-31491c330525 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:10.721929 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566dba9-3336-40f5-8d05-31491c330525 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:10.724804 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566dba9-3336-40f5-8d05-31491c330525 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:10.748286 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1365/2702] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:43:10.748286 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566dba9-3336-40f5-8d05-31491c330525 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:10.758602 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a566dba9-3336-40f5-8d05-31491c330525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:10.789642 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566dba9-3336-40f5-8d05-31491c330525 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:10.800412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42b314-0518-42b2-940f-3596744acc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:10.805000 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42b314-0518-42b2-940f-3596744acc05 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:10.806339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42b314-0518-42b2-940f-3596744acc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:10.807620 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42b314-0518-42b2-940f-3596744acc05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:10.809148 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42b314-0518-42b2-940f-3596744acc05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:10.813380 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42b314-0518-42b2-940f-3596744acc05 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:10.832782 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe44ea3-fc3d-4043-976e-14f4b8eaf636 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:10.840391 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf4267-97b4-481b-ab1f-87141d07bbaa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64fc190fac540259444a531cdbb8d53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:10.841067 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf4267-97b4-481b-ab1f-87141d07bbaa service placement] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:10.841343 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf4267-97b4-481b-ab1f-87141d07bbaa service placement] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:10.841618 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf4267-97b4-481b-ab1f-87141d07bbaa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:10.843606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5fcf4267-97b4-481b-ab1f-87141d07bbaa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:10.860143 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf4267-97b4-481b-ab1f-87141d07bbaa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:10.862494 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf4267-97b4-481b-ab1f-87141d07bbaa service placement] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:10.876004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1338/2703] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:10.877100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf4267-97b4-481b-ab1f-87141d07bbaa service placement] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:10.912201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf4267-97b4-481b-ab1f-87141d07bbaa service placement] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:10.918281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be1fa1-99b3-4d5c-bd4e-590ca8875cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:10.918886 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be1fa1-99b3-4d5c-bd4e-590ca8875cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:10.919203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be1fa1-99b3-4d5c-bd4e-590ca8875cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:10.919644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be1fa1-99b3-4d5c-bd4e-590ca8875cb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:10.920351 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be1fa1-99b3-4d5c-bd4e-590ca8875cb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:10.922697 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be1fa1-99b3-4d5c-bd4e-590ca8875cb1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:10.947959 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1366/2704] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:10 2022] POST /identity/v3/projects => generated 379 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:10.949731 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42b314-0518-42b2-940f-3596744acc05 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:10.961308 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1339/2705] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:10 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:10.968253 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be1fa1-99b3-4d5c-bd4e-590ca8875cb1 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:11.085609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:11.127039 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be1fa1-99b3-4d5c-bd4e-590ca8875cb1 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:11.142034 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42b314-0518-42b2-940f-3596744acc05 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:11.148277 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4a082-66b2-4761-a4c2-342ce325fa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:11.149169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4a082-66b2-4761-a4c2-342ce325fa0a admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:11.149477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4a082-66b2-4761-a4c2-342ce325fa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:11.149776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4a082-66b2-4761-a4c2-342ce325fa0a admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:11.150724 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4a082-66b2-4761-a4c2-342ce325fa0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:11.158952 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4a082-66b2-4761-a4c2-342ce325fa0a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:11.160389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e5ef0-f164-4aa1-b4de-77fa250e56db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:11.161992 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e5ef0-f164-4aa1-b4de-77fa250e56db admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:11.162395 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e5ef0-f164-4aa1-b4de-77fa250e56db admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:11.162677 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e5ef0-f164-4aa1-b4de-77fa250e56db admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:11.164242 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e5ef0-f164-4aa1-b4de-77fa250e56db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:11.170322 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e5ef0-f164-4aa1-b4de-77fa250e56db admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:11.229842 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1367/2706] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:10 2022] POST /identity/v3/users => generated 296 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:11.230920 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e5ef0-f164-4aa1-b4de-77fa250e56db admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:11.241367 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1340/2707] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:10 2022] POST /identity/v3/users => generated 287 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:11.250434 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4a082-66b2-4761-a4c2-342ce325fa0a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:11.257619 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e5ef0-f164-4aa1-b4de-77fa250e56db admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:11.270823 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c5acc-754b-466d-9d4a-2e1cf51634a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:11.271480 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c5acc-754b-466d-9d4a-2e1cf51634a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:11.271839 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c5acc-754b-466d-9d4a-2e1cf51634a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:11.275400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c5acc-754b-466d-9d4a-2e1cf51634a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:11.275697 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c5acc-754b-466d-9d4a-2e1cf51634a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:11.279678 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c5acc-754b-466d-9d4a-2e1cf51634a0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:11.284914 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4a082-66b2-4761-a4c2-342ce325fa0a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:11.296668 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1368/2708] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:11.303909 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c5acc-754b-466d-9d4a-2e1cf51634a0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:11.309032 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfd234-79ad-4341-8a5c-85e3ebe90b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:11.310132 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfd234-79ad-4341-8a5c-85e3ebe90b25 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:11.311052 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfd234-79ad-4341-8a5c-85e3ebe90b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:11.311918 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfd234-79ad-4341-8a5c-85e3ebe90b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:11.314374 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfd234-79ad-4341-8a5c-85e3ebe90b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:11.318430 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfd234-79ad-4341-8a5c-85e3ebe90b25 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:11.328141 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c5acc-754b-466d-9d4a-2e1cf51634a0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:11.339970 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed51f95-1128-47db-91e5-b6b3213cddf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:11.341574 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed51f95-1128-47db-91e5-b6b3213cddf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:11.342217 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed51f95-1128-47db-91e5-b6b3213cddf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:11.342852 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed51f95-1128-47db-91e5-b6b3213cddf7 admin admin] PATH_INFO: `/v3/projects/85e5b1dc9cef421aba5f3edaa3531000/users/5879643dd16c40c2a0965a0fcd97afec/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:11.345705 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1341/2709] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:11.351443 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfd234-79ad-4341-8a5c-85e3ebe90b25 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:11.376589 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfd234-79ad-4341-8a5c-85e3ebe90b25 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:11.389613 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed51f95-1128-47db-91e5-b6b3213cddf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85e5b1dc9cef421aba5f3edaa3531000, user_id=5879643dd16c40c2a0965a0fcd97afec, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:11.391834 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84cd1c-03da-426e-b75d-d1dd490b7360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:11.392737 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84cd1c-03da-426e-b75d-d1dd490b7360 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:11.398179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84cd1c-03da-426e-b75d-d1dd490b7360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:11.398179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84cd1c-03da-426e-b75d-d1dd490b7360 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:11.398980 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84cd1c-03da-426e-b75d-d1dd490b7360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:11.401939 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed51f95-1128-47db-91e5-b6b3213cddf7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:11.402440 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84cd1c-03da-426e-b75d-d1dd490b7360 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:11.432142 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1342/2710] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:11.433876 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84cd1c-03da-426e-b75d-d1dd490b7360 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:11.441847 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1369/2711] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:11 2022] PUT /identity/v3/projects/85e5b1dc9cef421aba5f3edaa3531000/users/5879643dd16c40c2a0965a0fcd97afec/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:11.444822 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed51f95-1128-47db-91e5-b6b3213cddf7 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:11.461189 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84cd1c-03da-426e-b75d-d1dd490b7360 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:11.585625 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed51f95-1128-47db-91e5-b6b3213cddf7 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:11.595206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20aaa9-17a8-4d5f-8c27-7db26827f76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:11.596414 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20aaa9-17a8-4d5f-8c27-7db26827f76c admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:11.597050 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20aaa9-17a8-4d5f-8c27-7db26827f76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:11.597829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20aaa9-17a8-4d5f-8c27-7db26827f76c admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:11.600255 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20aaa9-17a8-4d5f-8c27-7db26827f76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:11.604519 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20aaa9-17a8-4d5f-8c27-7db26827f76c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:11.614264 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67185fb9-4715-453f-bc1e-b4fde71c6701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:11.615070 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67185fb9-4715-453f-bc1e-b4fde71c6701 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:11.615609 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67185fb9-4715-453f-bc1e-b4fde71c6701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:11.615771 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67185fb9-4715-453f-bc1e-b4fde71c6701 admin admin] PATH_INFO: `/v3/projects/91ef557bb8fa4bf68686d6a348dee382/users/cd31849c210e4dc6b9d8e33fdcaba55b/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:11.632941 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1370/2712] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:11.634723 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20aaa9-17a8-4d5f-8c27-7db26827f76c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:11.645869 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:11.655721 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67185fb9-4715-453f-bc1e-b4fde71c6701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91ef557bb8fa4bf68686d6a348dee382, user_id=cd31849c210e4dc6b9d8e33fdcaba55b, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:11.657566 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20aaa9-17a8-4d5f-8c27-7db26827f76c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:11.659091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67185fb9-4715-453f-bc1e-b4fde71c6701 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:11.669810 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1482e-7558-4c54-bc97-c83fffbb242a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:11.674050 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1482e-7558-4c54-bc97-c83fffbb242a admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:11.674858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1482e-7558-4c54-bc97-c83fffbb242a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:11.675525 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1482e-7558-4c54-bc97-c83fffbb242a admin admin] PATH_INFO: `/v3/projects/85e5b1dc9cef421aba5f3edaa3531000/users/5879643dd16c40c2a0965a0fcd97afec/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:11.680687 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1482e-7558-4c54-bc97-c83fffbb242a admin admin] RBAC: Authorizing `identity:create_grant(project_id=85e5b1dc9cef421aba5f3edaa3531000, user_id=5879643dd16c40c2a0965a0fcd97afec, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:11.685927 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1482e-7558-4c54-bc97-c83fffbb242a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:11.692614 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1343/2713] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:11 2022] PUT /identity/v3/projects/91ef557bb8fa4bf68686d6a348dee382/users/cd31849c210e4dc6b9d8e33fdcaba55b/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:11.704367 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c9728-8fb5-4876-ad14-33a9438767d9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:11.704677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c9728-8fb5-4876-ad14-33a9438767d9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:11.704952 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c9728-8fb5-4876-ad14-33a9438767d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:11.719053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1371/2714] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:11 2022] PUT /identity/v3/projects/85e5b1dc9cef421aba5f3edaa3531000/users/5879643dd16c40c2a0965a0fcd97afec/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:11.722456 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7aefc-d971-4db4-9f0d-29c6d1b4c9fe None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:11.722672 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7aefc-d971-4db4-9f0d-29c6d1b4c9fe None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:11.723635 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7aefc-d971-4db4-9f0d-29c6d1b4c9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:11.763314 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-593c9728-8fb5-4876-ad14-33a9438767d9 None None] MFA Rules not processed for user `cd31849c210e4dc6b9d8e33fdcaba55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:11.765183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-593c9728-8fb5-4876-ad14-33a9438767d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:11.822325 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-28b7aefc-d971-4db4-9f0d-29c6d1b4c9fe None None] MFA Rules not processed for user `5879643dd16c40c2a0965a0fcd97afec`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:11.833141 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-28b7aefc-d971-4db4-9f0d-29c6d1b4c9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:11.871618 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1344/2715] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:11.887236 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c9728-8fb5-4876-ad14-33a9438767d9 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:11.889029 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-593c9728-8fb5-4876-ad14-33a9438767d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:11.987140 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:12.064249 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c9728-8fb5-4876-ad14-33a9438767d9 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:12.069017 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3e01c-67cf-4ec1-8421-e92c91b9a2cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:12.069821 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3e01c-67cf-4ec1-8421-e92c91b9a2cb service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:12.070171 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3e01c-67cf-4ec1-8421-e92c91b9a2cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:12.071363 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3e01c-67cf-4ec1-8421-e92c91b9a2cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:12.084659 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3e01c-67cf-4ec1-8421-e92c91b9a2cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:12.086471 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3e01c-67cf-4ec1-8421-e92c91b9a2cb service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:12.101898 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1345/2716] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:12.133146 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1372/2717] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:12.142554 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3e01c-67cf-4ec1-8421-e92c91b9a2cb service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:12.144427 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b9a3e01c-67cf-4ec1-8421-e92c91b9a2cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:12.160279 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3e01c-67cf-4ec1-8421-e92c91b9a2cb service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:12.172306 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc81d37-65d4-46a6-9383-cefd4045a2a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:12.173166 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc81d37-65d4-46a6-9383-cefd4045a2a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:12.173531 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc81d37-65d4-46a6-9383-cefd4045a2a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:12.173878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc81d37-65d4-46a6-9383-cefd4045a2a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:12.266253 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc81d37-65d4-46a6-9383-cefd4045a2a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:12.268484 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc81d37-65d4-46a6-9383-cefd4045a2a9 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:12.290543 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1346/2718] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:13.581073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7aefc-d971-4db4-9f0d-29c6d1b4c9fe None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:13.582970 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-28b7aefc-d971-4db4-9f0d-29c6d1b4c9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:13.675495 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7aefc-d971-4db4-9f0d-29c6d1b4c9fe None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:13.681605 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec402937-9f16-4c7c-840e-b00dd8622541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:13.682300 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec402937-9f16-4c7c-840e-b00dd8622541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:13.682542 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec402937-9f16-4c7c-840e-b00dd8622541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:13.682811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec402937-9f16-4c7c-840e-b00dd8622541 admin admin] PATH_INFO: `/v3/users/068c4abbe8db4aceab62bbc6bbf10f7b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:13.684445 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec402937-9f16-4c7c-840e-b00dd8622541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=068c4abbe8db4aceab62bbc6bbf10f7b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:13.686294 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec402937-9f16-4c7c-840e-b00dd8622541 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:13.773338 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ec402937-9f16-4c7c-840e-b00dd8622541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '068c4abbe8db4aceab62bbc6bbf10f7b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:13.805019 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ec402937-9f16-4c7c-840e-b00dd8622541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '068c4abbe8db4aceab62bbc6bbf10f7b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:13.805019 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ec402937-9f16-4c7c-840e-b00dd8622541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '068c4abbe8db4aceab62bbc6bbf10f7b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:13.815289 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ec402937-9f16-4c7c-840e-b00dd8622541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '068c4abbe8db4aceab62bbc6bbf10f7b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:13.819686 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:13.831167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ec402937-9f16-4c7c-840e-b00dd8622541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '068c4abbe8db4aceab62bbc6bbf10f7b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:13.845203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82df35-1deb-4f4c-86f4-9a02461fe0da None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:13.846106 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82df35-1deb-4f4c-86f4-9a02461fe0da None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:13.846466 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82df35-1deb-4f4c-86f4-9a02461fe0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:13.852689 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1373/2719] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:13 2022] DELETE /identity/v3/users/068c4abbe8db4aceab62bbc6bbf10f7b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:13.890950 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4e82df35-1deb-4f4c-86f4-9a02461fe0da None None] MFA Rules not processed for user `cd31849c210e4dc6b9d8e33fdcaba55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:13.893783 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4e82df35-1deb-4f4c-86f4-9a02461fe0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:14.061911 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec402937-9f16-4c7c-840e-b00dd8622541 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:14.066416 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ec402937-9f16-4c7c-840e-b00dd8622541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:14.092383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1347/2720] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:14.193719 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82df35-1deb-4f4c-86f4-9a02461fe0da None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:14.195693 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4e82df35-1deb-4f4c-86f4-9a02461fe0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:14.264929 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec402937-9f16-4c7c-840e-b00dd8622541 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:14.273451 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e74dd8-b228-4a99-ad19-f316daa57714 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:14.275008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e74dd8-b228-4a99-ad19-f316daa57714 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:14.275791 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e74dd8-b228-4a99-ad19-f316daa57714 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:14.276366 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e74dd8-b228-4a99-ad19-f316daa57714 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:14.280059 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-36e74dd8-b228-4a99-ad19-f316daa57714 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:14.374697 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82df35-1deb-4f4c-86f4-9a02461fe0da None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:14.385945 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b31352-b0b3-47d2-a91c-77d5019784f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:14.387463 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b31352-b0b3-47d2-a91c-77d5019784f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:14.388333 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b31352-b0b3-47d2-a91c-77d5019784f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:14.388879 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b31352-b0b3-47d2-a91c-77d5019784f2 admin admin] PATH_INFO: `/v3/projects/36fcfac4eac3419b83a7ddd28d6880f5` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:14.392194 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e74dd8-b228-4a99-ad19-f316daa57714 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:14.393201 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b31352-b0b3-47d2-a91c-77d5019784f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36fcfac4eac3419b83a7ddd28d6880f5)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:14.394140 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e74dd8-b228-4a99-ad19-f316daa57714 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:14.398611 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b31352-b0b3-47d2-a91c-77d5019784f2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:14.407969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1374/2721] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:14.429553 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:14.531441 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c4b31352-b0b3-47d2-a91c-77d5019784f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36fcfac4eac3419b83a7ddd28d6880f5', 'request_id': 'req-c4b31352-b0b3-47d2-a91c-77d5019784f2'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:14.544780 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c4b31352-b0b3-47d2-a91c-77d5019784f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36fcfac4eac3419b83a7ddd28d6880f5', 'request_id': 'req-c4b31352-b0b3-47d2-a91c-77d5019784f2'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:14.562184 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c4b31352-b0b3-47d2-a91c-77d5019784f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36fcfac4eac3419b83a7ddd28d6880f5', 'request_id': 'req-c4b31352-b0b3-47d2-a91c-77d5019784f2'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:14.599245 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c4b31352-b0b3-47d2-a91c-77d5019784f2 admin admin] The token cache is being invalidate because project 36fcfac4eac3419b83a7ddd28d6880f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:14.599847 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c4b31352-b0b3-47d2-a91c-77d5019784f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:14.606499 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c4b31352-b0b3-47d2-a91c-77d5019784f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:14.609684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1348/2722] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:14 2022] DELETE /identity/v3/projects/36fcfac4eac3419b83a7ddd28d6880f5 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:14.615589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e74dd8-b228-4a99-ad19-f316daa57714 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:14.639323 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e74dd8-b228-4a99-ad19-f316daa57714 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:14.796532 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874d07a-d1cf-41b9-b93f-83a7654b737e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:14.797685 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874d07a-d1cf-41b9-b93f-83a7654b737e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:14.798087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874d07a-d1cf-41b9-b93f-83a7654b737e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:14.798804 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874d07a-d1cf-41b9-b93f-83a7654b737e admin admin] PATH_INFO: `/v3/users/31edcd7d57e64ab69b21f8e9628f7663` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:14.803111 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874d07a-d1cf-41b9-b93f-83a7654b737e admin admin] RBAC: Authorizing `identity:delete_user(user_id=31edcd7d57e64ab69b21f8e9628f7663)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:14.806578 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874d07a-d1cf-41b9-b93f-83a7654b737e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:14.911467 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=8,keystone:SELECT=92 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:14.919110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e874d07a-d1cf-41b9-b93f-83a7654b737e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31edcd7d57e64ab69b21f8e9628f7663'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:14.938534 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e874d07a-d1cf-41b9-b93f-83a7654b737e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31edcd7d57e64ab69b21f8e9628f7663'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:14.940090 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e874d07a-d1cf-41b9-b93f-83a7654b737e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31edcd7d57e64ab69b21f8e9628f7663'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:14.952096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e874d07a-d1cf-41b9-b93f-83a7654b737e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31edcd7d57e64ab69b21f8e9628f7663'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:14.964218 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e874d07a-d1cf-41b9-b93f-83a7654b737e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31edcd7d57e64ab69b21f8e9628f7663'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:14.972237 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1375/2723] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:14 2022] DELETE /identity/v3/users/31edcd7d57e64ab69b21f8e9628f7663 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:15.243154 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b31352-b0b3-47d2-a91c-77d5019784f2 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:15.245029 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c4b31352-b0b3-47d2-a91c-77d5019784f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:15.265890 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b31352-b0b3-47d2-a91c-77d5019784f2 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:15.378724 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1eb9b-3c58-45fa-822a-147bf6009dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:15.379358 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1eb9b-3c58-45fa-822a-147bf6009dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:15.379634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1eb9b-3c58-45fa-822a-147bf6009dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:15.379911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1eb9b-3c58-45fa-822a-147bf6009dcf admin admin] PATH_INFO: `/v3/projects/c3721df054404b3d96635ee84277a4be` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:15.381229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1eb9b-3c58-45fa-822a-147bf6009dcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3721df054404b3d96635ee84277a4be)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:15.383222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1eb9b-3c58-45fa-822a-147bf6009dcf admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:15.449467 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0ec1eb9b-3c58-45fa-822a-147bf6009dcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3721df054404b3d96635ee84277a4be', 'request_id': 'req-0ec1eb9b-3c58-45fa-822a-147bf6009dcf'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:15.459791 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0ec1eb9b-3c58-45fa-822a-147bf6009dcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3721df054404b3d96635ee84277a4be', 'request_id': 'req-0ec1eb9b-3c58-45fa-822a-147bf6009dcf'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:15.474460 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0ec1eb9b-3c58-45fa-822a-147bf6009dcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3721df054404b3d96635ee84277a4be', 'request_id': 'req-0ec1eb9b-3c58-45fa-822a-147bf6009dcf'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:15.493322 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0ec1eb9b-3c58-45fa-822a-147bf6009dcf admin admin] The token cache is being invalidate because project c3721df054404b3d96635ee84277a4be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:15.493575 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0ec1eb9b-3c58-45fa-822a-147bf6009dcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:15.494177 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0ec1eb9b-3c58-45fa-822a-147bf6009dcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:15.495833 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1349/2724] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:15 2022] DELETE /identity/v3/projects/c3721df054404b3d96635ee84277a4be => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:17.366063 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874d07a-d1cf-41b9-b93f-83a7654b737e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:17.368899 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e874d07a-d1cf-41b9-b93f-83a7654b737e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:17.474075 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874d07a-d1cf-41b9-b93f-83a7654b737e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:17.577102 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83a825-1fad-448b-97c4-4ca5b7bf715b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:17.578086 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83a825-1fad-448b-97c4-4ca5b7bf715b service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:17.578717 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83a825-1fad-448b-97c4-4ca5b7bf715b service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:17.579618 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83a825-1fad-448b-97c4-4ca5b7bf715b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:17.581603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bc83a825-1fad-448b-97c4-4ca5b7bf715b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:17.708323 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc83a825-1fad-448b-97c4-4ca5b7bf715b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:17.711227 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc83a825-1fad-448b-97c4-4ca5b7bf715b service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:17.731901 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1376/2725] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:18.751953 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1eb9b-3c58-45fa-822a-147bf6009dcf admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:18.753781 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0ec1eb9b-3c58-45fa-822a-147bf6009dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:18.768132 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1eb9b-3c58-45fa-822a-147bf6009dcf admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:18.774406 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00251e8-77e0-4d49-ae5c-79157f7e37ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:18.775240 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00251e8-77e0-4d49-ae5c-79157f7e37ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:18.775626 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00251e8-77e0-4d49-ae5c-79157f7e37ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:18.776009 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00251e8-77e0-4d49-ae5c-79157f7e37ba admin admin] PATH_INFO: `/v3/users/817214f367d548609f9e2130f4a82774` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:18.777412 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00251e8-77e0-4d49-ae5c-79157f7e37ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=817214f367d548609f9e2130f4a82774)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:18.779574 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00251e8-77e0-4d49-ae5c-79157f7e37ba admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:18.821048 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:18.853414 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a00251e8-77e0-4d49-ae5c-79157f7e37ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '817214f367d548609f9e2130f4a82774'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:18.880952 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a00251e8-77e0-4d49-ae5c-79157f7e37ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '817214f367d548609f9e2130f4a82774'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:18.883076 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a00251e8-77e0-4d49-ae5c-79157f7e37ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '817214f367d548609f9e2130f4a82774'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:18.883724 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a00251e8-77e0-4d49-ae5c-79157f7e37ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '817214f367d548609f9e2130f4a82774'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:18.900054 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a00251e8-77e0-4d49-ae5c-79157f7e37ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '817214f367d548609f9e2130f4a82774'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:18.935181 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1350/2726] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:18 2022] DELETE /identity/v3/users/817214f367d548609f9e2130f4a82774 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:18.939657 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb9145-43f0-4a10-b64c-40fc4312f694 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:18.940570 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb9145-43f0-4a10-b64c-40fc4312f694 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:18.940875 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb9145-43f0-4a10-b64c-40fc4312f694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:18.962661 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-71fb9145-43f0-4a10-b64c-40fc4312f694 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:18.963927 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-71fb9145-43f0-4a10-b64c-40fc4312f694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:18.997821 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:19.060811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1377/2727] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:19.076752 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00251e8-77e0-4d49-ae5c-79157f7e37ba admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:19.080244 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a00251e8-77e0-4d49-ae5c-79157f7e37ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:19.196459 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00251e8-77e0-4d49-ae5c-79157f7e37ba admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:19.201431 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee77df-6520-4e81-bb3a-bb12f04c85af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:19.202293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee77df-6520-4e81-bb3a-bb12f04c85af service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:19.202670 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee77df-6520-4e81-bb3a-bb12f04c85af service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:19.203038 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee77df-6520-4e81-bb3a-bb12f04c85af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:19.224057 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee77df-6520-4e81-bb3a-bb12f04c85af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:19.227002 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee77df-6520-4e81-bb3a-bb12f04c85af service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:19.248523 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1351/2728] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:19.952723 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb9145-43f0-4a10-b64c-40fc4312f694 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:19.955535 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-71fb9145-43f0-4a10-b64c-40fc4312f694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:19.999457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb9145-43f0-4a10-b64c-40fc4312f694 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:20.013524 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c8401-e92c-4add-bb78-31be8a0e0079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:20.014953 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c8401-e92c-4add-bb78-31be8a0e0079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:20.015920 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c8401-e92c-4add-bb78-31be8a0e0079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:20.016986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c8401-e92c-4add-bb78-31be8a0e0079 admin admin] PATH_INFO: `/v3/projects/fbedd79ef72240bd85381e97b818489d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:20.019259 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c8401-e92c-4add-bb78-31be8a0e0079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbedd79ef72240bd85381e97b818489d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:20.023547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c8401-e92c-4add-bb78-31be8a0e0079 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:20.158784 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-182c8401-e92c-4add-bb78-31be8a0e0079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbedd79ef72240bd85381e97b818489d', 'request_id': 'req-182c8401-e92c-4add-bb78-31be8a0e0079'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:20.169499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-182c8401-e92c-4add-bb78-31be8a0e0079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbedd79ef72240bd85381e97b818489d', 'request_id': 'req-182c8401-e92c-4add-bb78-31be8a0e0079'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:20.180269 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-182c8401-e92c-4add-bb78-31be8a0e0079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbedd79ef72240bd85381e97b818489d', 'request_id': 'req-182c8401-e92c-4add-bb78-31be8a0e0079'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:20.195700 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-182c8401-e92c-4add-bb78-31be8a0e0079 admin admin] The token cache is being invalidate because project fbedd79ef72240bd85381e97b818489d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:20.196168 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-182c8401-e92c-4add-bb78-31be8a0e0079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:20.197213 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-182c8401-e92c-4add-bb78-31be8a0e0079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:20.198940 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1378/2729] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:19 2022] DELETE /identity/v3/projects/fbedd79ef72240bd85381e97b818489d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:20.203823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee77df-6520-4e81-bb3a-bb12f04c85af service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:20.225637 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee77df-6520-4e81-bb3a-bb12f04c85af service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:20.314517 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8876a-fb95-4aa2-9f8b-63f2d70620e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:20.315178 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8876a-fb95-4aa2-9f8b-63f2d70620e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:20.315470 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8876a-fb95-4aa2-9f8b-63f2d70620e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:20.315720 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8876a-fb95-4aa2-9f8b-63f2d70620e6 admin admin] PATH_INFO: `/v3/users/5879643dd16c40c2a0965a0fcd97afec` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:20.317965 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8876a-fb95-4aa2-9f8b-63f2d70620e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5879643dd16c40c2a0965a0fcd97afec)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:20.320179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8876a-fb95-4aa2-9f8b-63f2d70620e6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:20.402569 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5ef8876a-fb95-4aa2-9f8b-63f2d70620e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5879643dd16c40c2a0965a0fcd97afec'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:20.404763 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:20.431112 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5ef8876a-fb95-4aa2-9f8b-63f2d70620e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5879643dd16c40c2a0965a0fcd97afec'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:20.432200 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5ef8876a-fb95-4aa2-9f8b-63f2d70620e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5879643dd16c40c2a0965a0fcd97afec'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:20.433190 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5ef8876a-fb95-4aa2-9f8b-63f2d70620e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5879643dd16c40c2a0965a0fcd97afec'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:20.445132 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5ef8876a-fb95-4aa2-9f8b-63f2d70620e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5879643dd16c40c2a0965a0fcd97afec'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:20.460915 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1352/2730] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:20 2022] DELETE /identity/v3/users/5879643dd16c40c2a0965a0fcd97afec => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:21.122042 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c8401-e92c-4add-bb78-31be8a0e0079 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:21.124693 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-182c8401-e92c-4add-bb78-31be8a0e0079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:21.166677 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c8401-e92c-4add-bb78-31be8a0e0079 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:21.249304 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00a699-ca19-4e6a-bbeb-2865959d956f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:21.250096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00a699-ca19-4e6a-bbeb-2865959d956f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:21.250388 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00a699-ca19-4e6a-bbeb-2865959d956f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:21.250676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00a699-ca19-4e6a-bbeb-2865959d956f admin admin] PATH_INFO: `/v3/projects/85e5b1dc9cef421aba5f3edaa3531000` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:21.251824 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00a699-ca19-4e6a-bbeb-2865959d956f admin admin] RBAC: Authorizing `identity:delete_project(project_id=85e5b1dc9cef421aba5f3edaa3531000)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:21.253974 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00a699-ca19-4e6a-bbeb-2865959d956f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:21.318030 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7e00a699-ca19-4e6a-bbeb-2865959d956f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85e5b1dc9cef421aba5f3edaa3531000', 'request_id': 'req-7e00a699-ca19-4e6a-bbeb-2865959d956f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:21.327567 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7e00a699-ca19-4e6a-bbeb-2865959d956f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85e5b1dc9cef421aba5f3edaa3531000', 'request_id': 'req-7e00a699-ca19-4e6a-bbeb-2865959d956f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:21.330505 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:21.345933 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7e00a699-ca19-4e6a-bbeb-2865959d956f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85e5b1dc9cef421aba5f3edaa3531000', 'request_id': 'req-7e00a699-ca19-4e6a-bbeb-2865959d956f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:21.379411 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7e00a699-ca19-4e6a-bbeb-2865959d956f admin admin] The token cache is being invalidate because project 85e5b1dc9cef421aba5f3edaa3531000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:21.379997 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7e00a699-ca19-4e6a-bbeb-2865959d956f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:21.381176 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7e00a699-ca19-4e6a-bbeb-2865959d956f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:21.391015 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1379/2731] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:21 2022] DELETE /identity/v3/projects/85e5b1dc9cef421aba5f3edaa3531000 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:21.393432 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587ce83-9dbd-4555-bb9d-58dca38236e7 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:21.394231 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587ce83-9dbd-4555-bb9d-58dca38236e7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:21.394601 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587ce83-9dbd-4555-bb9d-58dca38236e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:21.439767 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8587ce83-9dbd-4555-bb9d-58dca38236e7 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:21.442082 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8587ce83-9dbd-4555-bb9d-58dca38236e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:21.616403 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1353/2732] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:21.628561 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268450b-5496-4a66-80d0-62830139f872 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:21.629672 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268450b-5496-4a66-80d0-62830139f872 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:21.630274 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268450b-5496-4a66-80d0-62830139f872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:21.673022 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e268450b-5496-4a66-80d0-62830139f872 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:21.675224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e268450b-5496-4a66-80d0-62830139f872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:21.691973 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1380/2733] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:21.696782 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587ce83-9dbd-4555-bb9d-58dca38236e7 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:21.717988 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587ce83-9dbd-4555-bb9d-58dca38236e7 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:21.727601 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7a0bf-1385-4995-9b40-f96a3007a132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:21.729105 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7a0bf-1385-4995-9b40-f96a3007a132 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:21.729937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7a0bf-1385-4995-9b40-f96a3007a132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:21.730349 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7a0bf-1385-4995-9b40-f96a3007a132 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:21.731727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7a0bf-1385-4995-9b40-f96a3007a132 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:21.732353 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7a0bf-1385-4995-9b40-f96a3007a132 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:21.736176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7a0bf-1385-4995-9b40-f96a3007a132 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:21.764335 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1354/2734] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:43:21.769058 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268450b-5496-4a66-80d0-62830139f872 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:21.780547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268450b-5496-4a66-80d0-62830139f872 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:21.788072 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419364c1-47d8-4f7d-8d88-2f7706dd2814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:21.788950 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419364c1-47d8-4f7d-8d88-2f7706dd2814 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:21.789342 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419364c1-47d8-4f7d-8d88-2f7706dd2814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:21.789688 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419364c1-47d8-4f7d-8d88-2f7706dd2814 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:21.790439 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419364c1-47d8-4f7d-8d88-2f7706dd2814 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:21.792959 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419364c1-47d8-4f7d-8d88-2f7706dd2814 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:21.853750 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1381/2735] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:21 2022] POST /identity/v3/projects => generated 407 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:21.858423 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7a0bf-1385-4995-9b40-f96a3007a132 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:21.870102 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7a0bf-1385-4995-9b40-f96a3007a132 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:21.943707 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a918f97-2de7-4e50-90d3-2beecbcab810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:21.944952 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a918f97-2de7-4e50-90d3-2beecbcab810 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:21.945521 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a918f97-2de7-4e50-90d3-2beecbcab810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:21.946077 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a918f97-2de7-4e50-90d3-2beecbcab810 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:21.947436 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a918f97-2de7-4e50-90d3-2beecbcab810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:21.951471 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a918f97-2de7-4e50-90d3-2beecbcab810 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:21.999839 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1355/2736] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:21 2022] POST /identity/v3/users => generated 304 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:22.007400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419364c1-47d8-4f7d-8d88-2f7706dd2814 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:22.020405 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419364c1-47d8-4f7d-8d88-2f7706dd2814 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:22.025980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52eb086-8df8-4728-bfcc-9076c27a032f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:22.026752 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52eb086-8df8-4728-bfcc-9076c27a032f admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:22.027233 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52eb086-8df8-4728-bfcc-9076c27a032f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:22.027603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52eb086-8df8-4728-bfcc-9076c27a032f admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:22.028403 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52eb086-8df8-4728-bfcc-9076c27a032f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:22.030200 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52eb086-8df8-4728-bfcc-9076c27a032f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:22.042551 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1382/2737] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:22.046870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a918f97-2de7-4e50-90d3-2beecbcab810 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:22.059546 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a918f97-2de7-4e50-90d3-2beecbcab810 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:22.064508 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cbe30-fc13-418a-9fbb-eb77beef7b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:22.065217 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cbe30-fc13-418a-9fbb-eb77beef7b7e admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:22.065621 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cbe30-fc13-418a-9fbb-eb77beef7b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:22.065808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cbe30-fc13-418a-9fbb-eb77beef7b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:22.067108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3cbe30-fc13-418a-9fbb-eb77beef7b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:22.068827 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3cbe30-fc13-418a-9fbb-eb77beef7b7e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:22.087015 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1356/2738] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:22.092232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52eb086-8df8-4728-bfcc-9076c27a032f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:22.104769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52eb086-8df8-4728-bfcc-9076c27a032f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:22.109841 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b3f93-a16b-4ab4-8925-7e024785a308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:22.110689 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b3f93-a16b-4ab4-8925-7e024785a308 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:22.110967 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b3f93-a16b-4ab4-8925-7e024785a308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:22.111246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b3f93-a16b-4ab4-8925-7e024785a308 admin admin] PATH_INFO: `/v3/projects/fc9b409c76f846dda2cb0a0b31f8c631/users/9e18d231e30349faafbfc7c9c9f7b076/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:22.154517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b3f93-a16b-4ab4-8925-7e024785a308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc9b409c76f846dda2cb0a0b31f8c631, user_id=9e18d231e30349faafbfc7c9c9f7b076, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:22.157986 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b3f93-a16b-4ab4-8925-7e024785a308 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:22.181884 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1383/2739] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:22 2022] PUT /identity/v3/projects/fc9b409c76f846dda2cb0a0b31f8c631/users/9e18d231e30349faafbfc7c9c9f7b076/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:22.197738 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914300f-50b3-43b1-9ded-c60dfb73859d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:22.198299 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914300f-50b3-43b1-9ded-c60dfb73859d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:22.198809 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914300f-50b3-43b1-9ded-c60dfb73859d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:22.276056 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b914300f-50b3-43b1-9ded-c60dfb73859d None None] MFA Rules not processed for user `9e18d231e30349faafbfc7c9c9f7b076`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:22.279026 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b914300f-50b3-43b1-9ded-c60dfb73859d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:22.341984 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:22.405658 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1357/2740] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:22 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:22.412962 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b3f93-a16b-4ab4-8925-7e024785a308 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:22.522320 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b3f93-a16b-4ab4-8925-7e024785a308 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:22.527361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7404502-3446-4a64-ad12-5405fe7dbf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:22.527995 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7404502-3446-4a64-ad12-5405fe7dbf0b admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:22.528439 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7404502-3446-4a64-ad12-5405fe7dbf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:22.528767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7404502-3446-4a64-ad12-5405fe7dbf0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:22.529388 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7404502-3446-4a64-ad12-5405fe7dbf0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:22.531347 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7404502-3446-4a64-ad12-5405fe7dbf0b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:22.566108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1384/2741] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:22 2022] POST /identity/v3/projects => generated 407 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:22.571108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914300f-50b3-43b1-9ded-c60dfb73859d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:22.585961 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914300f-50b3-43b1-9ded-c60dfb73859d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:22.677268 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06114dcb-e510-4a57-96be-3ce6ab215001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:22.678251 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06114dcb-e510-4a57-96be-3ce6ab215001 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:22.678713 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06114dcb-e510-4a57-96be-3ce6ab215001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:22.679174 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06114dcb-e510-4a57-96be-3ce6ab215001 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:22.680163 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06114dcb-e510-4a57-96be-3ce6ab215001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:22.686050 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06114dcb-e510-4a57-96be-3ce6ab215001 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:22.734187 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1358/2742] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:22 2022] POST /identity/v3/users => generated 310 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:22.740569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7404502-3446-4a64-ad12-5405fe7dbf0b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:22.762568 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7404502-3446-4a64-ad12-5405fe7dbf0b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:22.770781 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58017a89-3818-4999-9406-0edffe953357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:22.771649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58017a89-3818-4999-9406-0edffe953357 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:22.772279 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58017a89-3818-4999-9406-0edffe953357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:22.772718 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58017a89-3818-4999-9406-0edffe953357 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:22.774586 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58017a89-3818-4999-9406-0edffe953357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:22.777462 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58017a89-3818-4999-9406-0edffe953357 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:22.804011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1385/2743] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:22.805716 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06114dcb-e510-4a57-96be-3ce6ab215001 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:22.820379 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06114dcb-e510-4a57-96be-3ce6ab215001 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:22.826998 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f80b94-f2ea-4b70-bab2-b83f9e6430cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:22.827756 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f80b94-f2ea-4b70-bab2-b83f9e6430cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:22.828068 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f80b94-f2ea-4b70-bab2-b83f9e6430cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:22.828419 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f80b94-f2ea-4b70-bab2-b83f9e6430cd admin admin] PATH_INFO: `/v3/projects/b651c7aebfe040fd8cb4ade5c76217b6/users/e637cd53f36c40b585b7b9a13291b9c9/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:22.850536 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f80b94-f2ea-4b70-bab2-b83f9e6430cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b651c7aebfe040fd8cb4ade5c76217b6, user_id=e637cd53f36c40b585b7b9a13291b9c9, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:22.854718 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f80b94-f2ea-4b70-bab2-b83f9e6430cd admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:22.883416 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1359/2744] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:22 2022] PUT /identity/v3/projects/b651c7aebfe040fd8cb4ade5c76217b6/users/e637cd53f36c40b585b7b9a13291b9c9/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:22.890048 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58017a89-3818-4999-9406-0edffe953357 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:22.906096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58017a89-3818-4999-9406-0edffe953357 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:23.021072 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:23.055358 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1c338-1e17-4c5f-b724-ad572be2d04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:23.056142 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1c338-1e17-4c5f-b724-ad572be2d04c admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:23.056930 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1c338-1e17-4c5f-b724-ad572be2d04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:23.057412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1c338-1e17-4c5f-b724-ad572be2d04c admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:23.058655 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1c338-1e17-4c5f-b724-ad572be2d04c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:23.063484 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1c338-1e17-4c5f-b724-ad572be2d04c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:23.109850 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1386/2745] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:23.114254 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f80b94-f2ea-4b70-bab2-b83f9e6430cd admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:23.165113 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f80b94-f2ea-4b70-bab2-b83f9e6430cd admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:23.165113 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38266e22-e58f-4dc0-9c6e-6a95cfed9c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:23.165649 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38266e22-e58f-4dc0-9c6e-6a95cfed9c7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:23.166027 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38266e22-e58f-4dc0-9c6e-6a95cfed9c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:23.166378 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38266e22-e58f-4dc0-9c6e-6a95cfed9c7c admin admin] PATH_INFO: `/v3/projects/b651c7aebfe040fd8cb4ade5c76217b6/users/e637cd53f36c40b585b7b9a13291b9c9/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:23.168695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38266e22-e58f-4dc0-9c6e-6a95cfed9c7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b651c7aebfe040fd8cb4ade5c76217b6, user_id=e637cd53f36c40b585b7b9a13291b9c9, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:23.172736 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38266e22-e58f-4dc0-9c6e-6a95cfed9c7c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:23.193707 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1360/2746] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:23 2022] PUT /identity/v3/projects/b651c7aebfe040fd8cb4ade5c76217b6/users/e637cd53f36c40b585b7b9a13291b9c9/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:23.212755 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fd155-1a57-4fb9-94f9-d35ef6436a5d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:23.213526 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fd155-1a57-4fb9-94f9-d35ef6436a5d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:23.213526 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fd155-1a57-4fb9-94f9-d35ef6436a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:23.272320 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-833fd155-1a57-4fb9-94f9-d35ef6436a5d None None] MFA Rules not processed for user `e637cd53f36c40b585b7b9a13291b9c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:23.275249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-833fd155-1a57-4fb9-94f9-d35ef6436a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:23.425785 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1387/2747] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:23 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:23.443658 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38266e22-e58f-4dc0-9c6e-6a95cfed9c7c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:23.447063 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-38266e22-e58f-4dc0-9c6e-6a95cfed9c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:23.574636 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38266e22-e58f-4dc0-9c6e-6a95cfed9c7c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:23.581264 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe43df3-0d2f-4cf1-8482-0875d1f60b6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:23.582740 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe43df3-0d2f-4cf1-8482-0875d1f60b6d service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:23.583140 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe43df3-0d2f-4cf1-8482-0875d1f60b6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:23.583533 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe43df3-0d2f-4cf1-8482-0875d1f60b6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:23.603484 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe43df3-0d2f-4cf1-8482-0875d1f60b6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:23.606556 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe43df3-0d2f-4cf1-8482-0875d1f60b6d service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:23.632317 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1361/2748] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:23 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:23.871442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fd155-1a57-4fb9-94f9-d35ef6436a5d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:23.897518 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fd155-1a57-4fb9-94f9-d35ef6436a5d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:23.906046 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe43df3-0d2f-4cf1-8482-0875d1f60b6d service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:23.909256 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-afe43df3-0d2f-4cf1-8482-0875d1f60b6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:23.915631 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71e354-4e66-4f75-8de4-282504fc9835 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:23.917492 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71e354-4e66-4f75-8de4-282504fc9835 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:23.918097 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71e354-4e66-4f75-8de4-282504fc9835 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:23.918600 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71e354-4e66-4f75-8de4-282504fc9835 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:23.953397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:24.040405 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71e354-4e66-4f75-8de4-282504fc9835 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:24.042596 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71e354-4e66-4f75-8de4-282504fc9835 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:24.058564 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1388/2749] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:23 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:24.062055 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe43df3-0d2f-4cf1-8482-0875d1f60b6d service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:24.070873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4b303-817d-46f8-a860-d9cfb22b5778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:24.072320 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4b303-817d-46f8-a860-d9cfb22b5778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:24.073933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4b303-817d-46f8-a860-d9cfb22b5778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:24.074355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4b303-817d-46f8-a860-d9cfb22b5778 admin admin] PATH_INFO: `/v3/users/e08b6d367dc542f882cb821abd11cc34` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:24.076425 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4b303-817d-46f8-a860-d9cfb22b5778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e08b6d367dc542f882cb821abd11cc34)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:24.084528 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4b303-817d-46f8-a860-d9cfb22b5778 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:24.180535 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-44e4b303-817d-46f8-a860-d9cfb22b5778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e08b6d367dc542f882cb821abd11cc34'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:24.211238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-44e4b303-817d-46f8-a860-d9cfb22b5778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e08b6d367dc542f882cb821abd11cc34'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:24.212592 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-44e4b303-817d-46f8-a860-d9cfb22b5778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e08b6d367dc542f882cb821abd11cc34'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:24.213658 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-44e4b303-817d-46f8-a860-d9cfb22b5778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e08b6d367dc542f882cb821abd11cc34'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:24.232380 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-44e4b303-817d-46f8-a860-d9cfb22b5778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e08b6d367dc542f882cb821abd11cc34'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:24.266634 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1362/2750] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:23 2022] DELETE /identity/v3/users/e08b6d367dc542f882cb821abd11cc34 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:24.710688 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71e354-4e66-4f75-8de4-282504fc9835 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:24.745243 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71e354-4e66-4f75-8de4-282504fc9835 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:24.851637 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224887a-80a8-4451-b7d5-1c4ee6915563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:24.852368 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224887a-80a8-4451-b7d5-1c4ee6915563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:24.853087 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224887a-80a8-4451-b7d5-1c4ee6915563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:24.853412 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224887a-80a8-4451-b7d5-1c4ee6915563 admin admin] PATH_INFO: `/v3/projects/bf3125e6cbeb4630a46b29d03b780714` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:24.854703 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224887a-80a8-4451-b7d5-1c4ee6915563 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf3125e6cbeb4630a46b29d03b780714)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:24.856873 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224887a-80a8-4451-b7d5-1c4ee6915563 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:24.876971 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:24.918542 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3224887a-80a8-4451-b7d5-1c4ee6915563 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf3125e6cbeb4630a46b29d03b780714', 'request_id': 'req-3224887a-80a8-4451-b7d5-1c4ee6915563'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:24.927013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3224887a-80a8-4451-b7d5-1c4ee6915563 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf3125e6cbeb4630a46b29d03b780714', 'request_id': 'req-3224887a-80a8-4451-b7d5-1c4ee6915563'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:24.936329 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3224887a-80a8-4451-b7d5-1c4ee6915563 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf3125e6cbeb4630a46b29d03b780714', 'request_id': 'req-3224887a-80a8-4451-b7d5-1c4ee6915563'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:24.955216 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3224887a-80a8-4451-b7d5-1c4ee6915563 admin admin] The token cache is being invalidate because project bf3125e6cbeb4630a46b29d03b780714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:24.955776 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3224887a-80a8-4451-b7d5-1c4ee6915563 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:24.957480 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3224887a-80a8-4451-b7d5-1c4ee6915563 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:24.960464 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1389/2751] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:24 2022] DELETE /identity/v3/projects/bf3125e6cbeb4630a46b29d03b780714 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:24.967690 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bc9e2-d90b-41f9-99ec-c1f0c1c1daad None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:24.968426 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bc9e2-d90b-41f9-99ec-c1f0c1c1daad None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:24.968426 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bc9e2-d90b-41f9-99ec-c1f0c1c1daad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:24.990490 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-075bc9e2-d90b-41f9-99ec-c1f0c1c1daad None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:24.991670 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-075bc9e2-d90b-41f9-99ec-c1f0c1c1daad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:25.084529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1363/2752] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:25.093695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8cbe8-1922-4763-8491-8aec08c68fe2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:25.094041 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8cbe8-1922-4763-8491-8aec08c68fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:25.094231 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8cbe8-1922-4763-8491-8aec08c68fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:25.118537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-73e8cbe8-1922-4763-8491-8aec08c68fe2 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:25.120329 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-73e8cbe8-1922-4763-8491-8aec08c68fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:25.133200 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1390/2753] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:25.138126 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bc9e2-d90b-41f9-99ec-c1f0c1c1daad None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:25.149513 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bc9e2-d90b-41f9-99ec-c1f0c1c1daad None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:25.155381 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbea071-d3b9-4834-9a41-ae2a258e2c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:25.156174 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbea071-d3b9-4834-9a41-ae2a258e2c4c admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:25.156455 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbea071-d3b9-4834-9a41-ae2a258e2c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:25.156762 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbea071-d3b9-4834-9a41-ae2a258e2c4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:25.157450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbea071-d3b9-4834-9a41-ae2a258e2c4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:25.157745 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbea071-d3b9-4834-9a41-ae2a258e2c4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:25.159697 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbea071-d3b9-4834-9a41-ae2a258e2c4c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:25.178081 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1364/2754] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:43:25.182089 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8cbe8-1922-4763-8491-8aec08c68fe2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:25.192457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8cbe8-1922-4763-8491-8aec08c68fe2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:25.197877 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96067e-d475-4f67-a3eb-4d16452d05b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:25.198654 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96067e-d475-4f67-a3eb-4d16452d05b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:25.199008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96067e-d475-4f67-a3eb-4d16452d05b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:25.199352 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96067e-d475-4f67-a3eb-4d16452d05b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:25.200074 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96067e-d475-4f67-a3eb-4d16452d05b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:25.202216 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96067e-d475-4f67-a3eb-4d16452d05b2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:25.241898 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1391/2755] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:25 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:25.246317 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbea071-d3b9-4834-9a41-ae2a258e2c4c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:25.258364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbea071-d3b9-4834-9a41-ae2a258e2c4c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:25.282691 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:25.332074 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1d537-04d1-49d9-ba3c-a24c2404a607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:25.332863 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1d537-04d1-49d9-ba3c-a24c2404a607 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:25.333188 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1d537-04d1-49d9-ba3c-a24c2404a607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:25.333502 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1d537-04d1-49d9-ba3c-a24c2404a607 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:25.334211 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac1d537-04d1-49d9-ba3c-a24c2404a607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:25.336298 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac1d537-04d1-49d9-ba3c-a24c2404a607 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:25.365510 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1365/2756] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:25 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:25.370379 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96067e-d475-4f67-a3eb-4d16452d05b2 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:25.382837 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96067e-d475-4f67-a3eb-4d16452d05b2 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:25.388435 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00c21c-0d11-41ec-b324-09e18b0a04e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:25.389151 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00c21c-0d11-41ec-b324-09e18b0a04e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:25.389497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00c21c-0d11-41ec-b324-09e18b0a04e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:25.389942 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00c21c-0d11-41ec-b324-09e18b0a04e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:25.390956 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00c21c-0d11-41ec-b324-09e18b0a04e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:25.393618 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00c21c-0d11-41ec-b324-09e18b0a04e6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:25.406885 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1392/2757] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:25.412005 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1d537-04d1-49d9-ba3c-a24c2404a607 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:25.423255 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1d537-04d1-49d9-ba3c-a24c2404a607 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:25.429099 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee9af3-a79d-482d-a77f-3dd3eb4b4723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:25.429724 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee9af3-a79d-482d-a77f-3dd3eb4b4723 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:25.429995 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee9af3-a79d-482d-a77f-3dd3eb4b4723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:25.430269 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee9af3-a79d-482d-a77f-3dd3eb4b4723 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:25.430929 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee9af3-a79d-482d-a77f-3dd3eb4b4723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:25.432604 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee9af3-a79d-482d-a77f-3dd3eb4b4723 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:25.445383 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1366/2758] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:25.450136 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00c21c-0d11-41ec-b324-09e18b0a04e6 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:25.463553 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00c21c-0d11-41ec-b324-09e18b0a04e6 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:25.468673 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c0a56-1926-457d-9123-384ff049de95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:25.469367 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c0a56-1926-457d-9123-384ff049de95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:25.469649 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c0a56-1926-457d-9123-384ff049de95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:25.469927 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c0a56-1926-457d-9123-384ff049de95 admin admin] PATH_INFO: `/v3/projects/ffd2bf741088431bbeee00e26aef28fa/users/c211b7946ace4fd99668b625aaf23211/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:25.488610 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c0a56-1926-457d-9123-384ff049de95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd2bf741088431bbeee00e26aef28fa, user_id=c211b7946ace4fd99668b625aaf23211, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:25.491485 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c0a56-1926-457d-9123-384ff049de95 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:25.507274 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1393/2759] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:25 2022] PUT /identity/v3/projects/ffd2bf741088431bbeee00e26aef28fa/users/c211b7946ace4fd99668b625aaf23211/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:25.520957 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cebd85-b476-451c-b387-d2328e0c5145 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:25.521449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cebd85-b476-451c-b387-d2328e0c5145 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:25.521857 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cebd85-b476-451c-b387-d2328e0c5145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:25.562364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e1cebd85-b476-451c-b387-d2328e0c5145 None None] MFA Rules not processed for user `c211b7946ace4fd99668b625aaf23211`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:25.563633 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e1cebd85-b476-451c-b387-d2328e0c5145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:25.650823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1367/2760] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:25.656156 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c0a56-1926-457d-9123-384ff049de95 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:25.748967 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c0a56-1926-457d-9123-384ff049de95 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:25.763648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2faa7a9-0fca-4b3c-94f4-9d275bf55cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:25.767346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faa7a9-0fca-4b3c-94f4-9d275bf55cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:25.767346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faa7a9-0fca-4b3c-94f4-9d275bf55cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:25.767346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faa7a9-0fca-4b3c-94f4-9d275bf55cb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:25.767346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2faa7a9-0fca-4b3c-94f4-9d275bf55cb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:25.771577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2faa7a9-0fca-4b3c-94f4-9d275bf55cb7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:25.833451 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1394/2761] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:25 2022] POST /identity/v3/projects => generated 387 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:25.835065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cebd85-b476-451c-b387-d2328e0c5145 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:25.855362 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cebd85-b476-451c-b387-d2328e0c5145 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:25.998923 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6719b-9ffe-4010-869b-703adbe6e6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:26.000025 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6719b-9ffe-4010-869b-703adbe6e6cb admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:26.000025 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6719b-9ffe-4010-869b-703adbe6e6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:26.001077 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6719b-9ffe-4010-869b-703adbe6e6cb admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:26.001787 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6719b-9ffe-4010-869b-703adbe6e6cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:26.004412 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6719b-9ffe-4010-869b-703adbe6e6cb admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:26.044931 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1368/2762] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:25 2022] POST /identity/v3/users => generated 300 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:26.051828 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2faa7a9-0fca-4b3c-94f4-9d275bf55cb7 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:26.087167 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2faa7a9-0fca-4b3c-94f4-9d275bf55cb7 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:26.109873 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825bb4d-62c7-47a5-ba7e-a767a3108a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:26.110612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825bb4d-62c7-47a5-ba7e-a767a3108a64 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:26.110978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825bb4d-62c7-47a5-ba7e-a767a3108a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:26.111325 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825bb4d-62c7-47a5-ba7e-a767a3108a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:26.112077 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825bb4d-62c7-47a5-ba7e-a767a3108a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:26.114436 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825bb4d-62c7-47a5-ba7e-a767a3108a64 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:26.142424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1395/2763] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:26.147437 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6719b-9ffe-4010-869b-703adbe6e6cb admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:26.164506 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6719b-9ffe-4010-869b-703adbe6e6cb admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:26.170550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395b865-dce6-4e6c-9204-f67f9fbf39ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:26.171320 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395b865-dce6-4e6c-9204-f67f9fbf39ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:26.171880 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395b865-dce6-4e6c-9204-f67f9fbf39ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:26.172262 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395b865-dce6-4e6c-9204-f67f9fbf39ea admin admin] PATH_INFO: `/v3/projects/9808514ad56d420197944fbe0966f3ba/users/e5699cf01a66481d9abd8d4898801ca8/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:26.199312 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395b865-dce6-4e6c-9204-f67f9fbf39ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=9808514ad56d420197944fbe0966f3ba, user_id=e5699cf01a66481d9abd8d4898801ca8, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:26.203181 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395b865-dce6-4e6c-9204-f67f9fbf39ea admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:26.212418 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:26.228911 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1369/2764] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:26 2022] PUT /identity/v3/projects/9808514ad56d420197944fbe0966f3ba/users/e5699cf01a66481d9abd8d4898801ca8/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:26.235036 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825bb4d-62c7-47a5-ba7e-a767a3108a64 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:26.255662 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825bb4d-62c7-47a5-ba7e-a767a3108a64 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:26.274918 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:26.369282 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b179d-bd43-4a3a-ba91-af52cd9b665d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:26.370109 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b179d-bd43-4a3a-ba91-af52cd9b665d admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:26.370547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b179d-bd43-4a3a-ba91-af52cd9b665d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:26.370963 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b179d-bd43-4a3a-ba91-af52cd9b665d admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:26.371772 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b179d-bd43-4a3a-ba91-af52cd9b665d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:26.374919 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b179d-bd43-4a3a-ba91-af52cd9b665d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:26.394530 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1396/2765] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:26.401508 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395b865-dce6-4e6c-9204-f67f9fbf39ea admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:26.418197 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395b865-dce6-4e6c-9204-f67f9fbf39ea admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:26.427306 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a352b63-5a2f-490f-ad72-b031ea3b0a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:26.428527 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a352b63-5a2f-490f-ad72-b031ea3b0a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:26.429303 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a352b63-5a2f-490f-ad72-b031ea3b0a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:26.430037 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a352b63-5a2f-490f-ad72-b031ea3b0a7a admin admin] PATH_INFO: `/v3/projects/9808514ad56d420197944fbe0966f3ba/users/e5699cf01a66481d9abd8d4898801ca8/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:26.434040 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a352b63-5a2f-490f-ad72-b031ea3b0a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9808514ad56d420197944fbe0966f3ba, user_id=e5699cf01a66481d9abd8d4898801ca8, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:26.437824 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a352b63-5a2f-490f-ad72-b031ea3b0a7a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:26.455088 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1370/2766] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:26 2022] PUT /identity/v3/projects/9808514ad56d420197944fbe0966f3ba/users/e5699cf01a66481d9abd8d4898801ca8/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:26.470885 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b703e3-400f-498d-842e-3dca8ef26c43 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:26.471249 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b703e3-400f-498d-842e-3dca8ef26c43 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:26.471530 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b703e3-400f-498d-842e-3dca8ef26c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:26.510187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-27b703e3-400f-498d-842e-3dca8ef26c43 None None] MFA Rules not processed for user `e5699cf01a66481d9abd8d4898801ca8`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:26.511501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-27b703e3-400f-498d-842e-3dca8ef26c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:26.638757 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1397/2767] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:26.652048 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a352b63-5a2f-490f-ad72-b031ea3b0a7a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:26.654232 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1a352b63-5a2f-490f-ad72-b031ea3b0a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:26.747951 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a352b63-5a2f-490f-ad72-b031ea3b0a7a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:26.752833 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538c48c-46ab-4a13-9793-5d42d38c175b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:26.754015 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538c48c-46ab-4a13-9793-5d42d38c175b service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:26.754299 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538c48c-46ab-4a13-9793-5d42d38c175b service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:26.754596 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538c48c-46ab-4a13-9793-5d42d38c175b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:26.764952 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538c48c-46ab-4a13-9793-5d42d38c175b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:26.766706 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538c48c-46ab-4a13-9793-5d42d38c175b service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:26.779420 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1371/2768] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:43:26.811339 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b703e3-400f-498d-842e-3dca8ef26c43 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:26.884737 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b703e3-400f-498d-842e-3dca8ef26c43 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:26.889717 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222036a-633f-4ca1-863a-49298681b512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:26.890296 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222036a-633f-4ca1-863a-49298681b512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:26.890582 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222036a-633f-4ca1-863a-49298681b512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:26.890871 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222036a-633f-4ca1-863a-49298681b512 admin admin] PATH_INFO: `/v3/users/c211b7946ace4fd99668b625aaf23211` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:26.892381 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222036a-633f-4ca1-863a-49298681b512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c211b7946ace4fd99668b625aaf23211)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:26.895002 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222036a-633f-4ca1-863a-49298681b512 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:26.945217 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:26.960439 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5222036a-633f-4ca1-863a-49298681b512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c211b7946ace4fd99668b625aaf23211'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.980547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5222036a-633f-4ca1-863a-49298681b512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c211b7946ace4fd99668b625aaf23211'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.981424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5222036a-633f-4ca1-863a-49298681b512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c211b7946ace4fd99668b625aaf23211'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.990272 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5222036a-633f-4ca1-863a-49298681b512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c211b7946ace4fd99668b625aaf23211'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:27.001430 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5222036a-633f-4ca1-863a-49298681b512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c211b7946ace4fd99668b625aaf23211'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:27.009292 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1398/2769] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:26 2022] DELETE /identity/v3/users/c211b7946ace4fd99668b625aaf23211 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:27.014551 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57c1c0-28d4-48a1-9104-8ea49b24096b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:27.015270 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57c1c0-28d4-48a1-9104-8ea49b24096b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:27.015270 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57c1c0-28d4-48a1-9104-8ea49b24096b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:27.038973 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9a57c1c0-28d4-48a1-9104-8ea49b24096b None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:27.040533 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9a57c1c0-28d4-48a1-9104-8ea49b24096b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:27.171459 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1372/2770] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:27.183538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222036a-633f-4ca1-863a-49298681b512 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:27.186361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5222036a-633f-4ca1-863a-49298681b512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:27.287309 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222036a-633f-4ca1-863a-49298681b512 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:27.292532 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a9ea5-4987-41d8-b356-7418e6200b88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:27.293272 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a9ea5-4987-41d8-b356-7418e6200b88 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:27.293695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a9ea5-4987-41d8-b356-7418e6200b88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:27.294078 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a9ea5-4987-41d8-b356-7418e6200b88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:27.311676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a9ea5-4987-41d8-b356-7418e6200b88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:27.314622 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a9ea5-4987-41d8-b356-7418e6200b88 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:27.336897 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1399/2771] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:27.794744 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57c1c0-28d4-48a1-9104-8ea49b24096b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:27.797639 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9a57c1c0-28d4-48a1-9104-8ea49b24096b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:27.825073 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57c1c0-28d4-48a1-9104-8ea49b24096b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:27.834681 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e01c4b-8538-4ed0-8e5f-5f298fa6ef88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:27.835754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e01c4b-8538-4ed0-8e5f-5f298fa6ef88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:27.836258 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e01c4b-8538-4ed0-8e5f-5f298fa6ef88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:27.836796 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e01c4b-8538-4ed0-8e5f-5f298fa6ef88 admin admin] PATH_INFO: `/v3/projects/ffd2bf741088431bbeee00e26aef28fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:27.839056 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e01c4b-8538-4ed0-8e5f-5f298fa6ef88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffd2bf741088431bbeee00e26aef28fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:27.842114 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e01c4b-8538-4ed0-8e5f-5f298fa6ef88 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:27.916546 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f9e01c4b-8538-4ed0-8e5f-5f298fa6ef88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffd2bf741088431bbeee00e26aef28fa', 'request_id': 'req-f9e01c4b-8538-4ed0-8e5f-5f298fa6ef88'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:27.923826 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f9e01c4b-8538-4ed0-8e5f-5f298fa6ef88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffd2bf741088431bbeee00e26aef28fa', 'request_id': 'req-f9e01c4b-8538-4ed0-8e5f-5f298fa6ef88'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:27.931767 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f9e01c4b-8538-4ed0-8e5f-5f298fa6ef88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffd2bf741088431bbeee00e26aef28fa', 'request_id': 'req-f9e01c4b-8538-4ed0-8e5f-5f298fa6ef88'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:27.948435 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f9e01c4b-8538-4ed0-8e5f-5f298fa6ef88 admin admin] The token cache is being invalidate because project ffd2bf741088431bbeee00e26aef28fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:27.948830 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f9e01c4b-8538-4ed0-8e5f-5f298fa6ef88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:27.949624 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f9e01c4b-8538-4ed0-8e5f-5f298fa6ef88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:27.951562 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1373/2772] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:27 2022] DELETE /identity/v3/projects/ffd2bf741088431bbeee00e26aef28fa => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:27.956531 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a9ea5-4987-41d8-b356-7418e6200b88 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:27.968018 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a9ea5-4987-41d8-b356-7418e6200b88 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:28.082842 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d16f2f-c82e-4b22-a094-32ca97454c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:28.083892 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d16f2f-c82e-4b22-a094-32ca97454c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:28.084389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d16f2f-c82e-4b22-a094-32ca97454c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:28.084928 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d16f2f-c82e-4b22-a094-32ca97454c5c admin admin] PATH_INFO: `/v3/users/e5699cf01a66481d9abd8d4898801ca8` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:28.086941 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d16f2f-c82e-4b22-a094-32ca97454c5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5699cf01a66481d9abd8d4898801ca8)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:28.090248 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d16f2f-c82e-4b22-a094-32ca97454c5c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:28.166912 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-80d16f2f-c82e-4b22-a094-32ca97454c5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5699cf01a66481d9abd8d4898801ca8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:28.179441 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:28.187559 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-80d16f2f-c82e-4b22-a094-32ca97454c5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5699cf01a66481d9abd8d4898801ca8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:28.189551 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-80d16f2f-c82e-4b22-a094-32ca97454c5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5699cf01a66481d9abd8d4898801ca8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:28.204572 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-80d16f2f-c82e-4b22-a094-32ca97454c5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5699cf01a66481d9abd8d4898801ca8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:28.218655 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-80d16f2f-c82e-4b22-a094-32ca97454c5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5699cf01a66481d9abd8d4898801ca8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:28.230038 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1400/2773] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:27 2022] DELETE /identity/v3/users/e5699cf01a66481d9abd8d4898801ca8 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:28.676598 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e01c4b-8538-4ed0-8e5f-5f298fa6ef88 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:28.679730 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f9e01c4b-8538-4ed0-8e5f-5f298fa6ef88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:28.704401 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e01c4b-8538-4ed0-8e5f-5f298fa6ef88 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:28.714000 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:28.838436 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6f7a2-d296-4aa8-ad89-e0a282ce74c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:28.839838 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6f7a2-d296-4aa8-ad89-e0a282ce74c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:28.840348 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6f7a2-d296-4aa8-ad89-e0a282ce74c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:28.841064 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6f7a2-d296-4aa8-ad89-e0a282ce74c9 admin admin] PATH_INFO: `/v3/projects/9808514ad56d420197944fbe0966f3ba` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:28.843315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6f7a2-d296-4aa8-ad89-e0a282ce74c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9808514ad56d420197944fbe0966f3ba)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:28.846871 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6f7a2-d296-4aa8-ad89-e0a282ce74c9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:28.928602 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-50e6f7a2-d296-4aa8-ad89-e0a282ce74c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9808514ad56d420197944fbe0966f3ba', 'request_id': 'req-50e6f7a2-d296-4aa8-ad89-e0a282ce74c9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:28.936681 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-50e6f7a2-d296-4aa8-ad89-e0a282ce74c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9808514ad56d420197944fbe0966f3ba', 'request_id': 'req-50e6f7a2-d296-4aa8-ad89-e0a282ce74c9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:28.945260 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-50e6f7a2-d296-4aa8-ad89-e0a282ce74c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9808514ad56d420197944fbe0966f3ba', 'request_id': 'req-50e6f7a2-d296-4aa8-ad89-e0a282ce74c9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:28.966278 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-50e6f7a2-d296-4aa8-ad89-e0a282ce74c9 admin admin] The token cache is being invalidate because project 9808514ad56d420197944fbe0966f3ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:28.966747 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-50e6f7a2-d296-4aa8-ad89-e0a282ce74c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:28.967780 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-50e6f7a2-d296-4aa8-ad89-e0a282ce74c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:28.971680 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1374/2774] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:28 2022] DELETE /identity/v3/projects/9808514ad56d420197944fbe0966f3ba => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:28.978153 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e05e27-5f67-4944-87b7-9a104736a542 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:28.978868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e05e27-5f67-4944-87b7-9a104736a542 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:28.979257 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e05e27-5f67-4944-87b7-9a104736a542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:29.014716 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-00e05e27-5f67-4944-87b7-9a104736a542 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:29.017045 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-00e05e27-5f67-4944-87b7-9a104736a542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:29.114501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1401/2775] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:29.124571 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526f51a-255d-4ad3-b420-4d520785bd9d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:29.125031 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526f51a-255d-4ad3-b420-4d520785bd9d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:29.125490 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526f51a-255d-4ad3-b420-4d520785bd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:29.154397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3526f51a-255d-4ad3-b420-4d520785bd9d None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:29.157788 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3526f51a-255d-4ad3-b420-4d520785bd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:29.165572 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1375/2776] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:29.172288 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e05e27-5f67-4944-87b7-9a104736a542 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:29.185621 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e05e27-5f67-4944-87b7-9a104736a542 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:29.190789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a2241-f87a-4a6b-bb8c-2fceba288a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:29.191452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a2241-f87a-4a6b-bb8c-2fceba288a0a admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:29.191727 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a2241-f87a-4a6b-bb8c-2fceba288a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:29.191999 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a2241-f87a-4a6b-bb8c-2fceba288a0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:29.192710 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a2241-f87a-4a6b-bb8c-2fceba288a0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:29.193073 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a2241-f87a-4a6b-bb8c-2fceba288a0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:29.194745 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a2241-f87a-4a6b-bb8c-2fceba288a0a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:29.210534 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1402/2777] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:43:29.215850 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526f51a-255d-4ad3-b420-4d520785bd9d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:29.229173 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526f51a-255d-4ad3-b420-4d520785bd9d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:29.235847 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7789c6-47c2-4db9-841b-6e64e88d91b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:29.236761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7789c6-47c2-4db9-841b-6e64e88d91b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:29.237282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7789c6-47c2-4db9-841b-6e64e88d91b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:29.237602 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7789c6-47c2-4db9-841b-6e64e88d91b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:29.239108 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7789c6-47c2-4db9-841b-6e64e88d91b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:29.241762 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7789c6-47c2-4db9-841b-6e64e88d91b7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:29.274988 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1376/2778] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:29 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:29.279830 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a2241-f87a-4a6b-bb8c-2fceba288a0a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:29.291492 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a2241-f87a-4a6b-bb8c-2fceba288a0a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:29.366900 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea1b8a-3dbd-460f-90a0-5bcc7b4b02ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:29.367532 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea1b8a-3dbd-460f-90a0-5bcc7b4b02ed admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:29.367815 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea1b8a-3dbd-460f-90a0-5bcc7b4b02ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:29.368092 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea1b8a-3dbd-460f-90a0-5bcc7b4b02ed admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:29.368816 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea1b8a-3dbd-460f-90a0-5bcc7b4b02ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:29.370821 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea1b8a-3dbd-460f-90a0-5bcc7b4b02ed admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:29.401855 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1403/2779] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:29 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:29.403573 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7789c6-47c2-4db9-841b-6e64e88d91b7 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:29.415588 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7789c6-47c2-4db9-841b-6e64e88d91b7 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:29.420817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15b681-f990-41d3-ad10-1efcc432e37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:29.421449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15b681-f990-41d3-ad10-1efcc432e37c admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:29.421730 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15b681-f990-41d3-ad10-1efcc432e37c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:29.422001 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15b681-f990-41d3-ad10-1efcc432e37c admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:29.422675 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15b681-f990-41d3-ad10-1efcc432e37c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:29.424361 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15b681-f990-41d3-ad10-1efcc432e37c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:29.437577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1377/2780] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:29.442551 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea1b8a-3dbd-460f-90a0-5bcc7b4b02ed admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:29.454199 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea1b8a-3dbd-460f-90a0-5bcc7b4b02ed admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:29.460149 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a155e53-aa55-4a8b-802c-90cef867698d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:29.460885 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a155e53-aa55-4a8b-802c-90cef867698d admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:29.461112 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a155e53-aa55-4a8b-802c-90cef867698d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:29.461390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a155e53-aa55-4a8b-802c-90cef867698d admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:29.462062 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a155e53-aa55-4a8b-802c-90cef867698d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:29.463829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a155e53-aa55-4a8b-802c-90cef867698d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:29.476261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1404/2781] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:29.480917 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15b681-f990-41d3-ad10-1efcc432e37c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:29.491644 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15b681-f990-41d3-ad10-1efcc432e37c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:29.496795 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c1df9-b80c-40ec-8f5c-ea4d4af23b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:29.497493 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c1df9-b80c-40ec-8f5c-ea4d4af23b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:29.497776 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c1df9-b80c-40ec-8f5c-ea4d4af23b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:29.498051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c1df9-b80c-40ec-8f5c-ea4d4af23b13 admin admin] PATH_INFO: `/v3/projects/8d11591bd54043bbbf756c3fa2eb8f43/users/48fe5eaa01a4416b9aa76472359343fb/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:29.516968 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c1df9-b80c-40ec-8f5c-ea4d4af23b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d11591bd54043bbbf756c3fa2eb8f43, user_id=48fe5eaa01a4416b9aa76472359343fb, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:29.520409 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c1df9-b80c-40ec-8f5c-ea4d4af23b13 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:29.538590 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1378/2782] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:29 2022] PUT /identity/v3/projects/8d11591bd54043bbbf756c3fa2eb8f43/users/48fe5eaa01a4416b9aa76472359343fb/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:29.550767 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d7048-9857-4ee4-affe-11e50c1a4760 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:29.551234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d7048-9857-4ee4-affe-11e50c1a4760 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:29.551694 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d7048-9857-4ee4-affe-11e50c1a4760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:29.589773 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4a2d7048-9857-4ee4-affe-11e50c1a4760 None None] MFA Rules not processed for user `48fe5eaa01a4416b9aa76472359343fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:29.591027 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4a2d7048-9857-4ee4-affe-11e50c1a4760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:29.627474 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:29.671877 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1405/2783] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:29.677667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c1df9-b80c-40ec-8f5c-ea4d4af23b13 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:29.759953 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:29.797491 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c1df9-b80c-40ec-8f5c-ea4d4af23b13 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:29.805193 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e84217-f23a-43a1-8be1-c086af53f2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:29.806248 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e84217-f23a-43a1-8be1-c086af53f2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:29.806721 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e84217-f23a-43a1-8be1-c086af53f2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:29.807555 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e84217-f23a-43a1-8be1-c086af53f2a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:29.808794 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e84217-f23a-43a1-8be1-c086af53f2a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:29.812514 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e84217-f23a-43a1-8be1-c086af53f2a9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:29.851974 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1379/2784] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:29 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:29.854224 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d7048-9857-4ee4-affe-11e50c1a4760 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:29.866899 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d7048-9857-4ee4-affe-11e50c1a4760 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:29.939300 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a638f-16c1-4139-b6b3-33abbcbab72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:29.939926 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a638f-16c1-4139-b6b3-33abbcbab72c admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:29.940204 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a638f-16c1-4139-b6b3-33abbcbab72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:29.940479 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a638f-16c1-4139-b6b3-33abbcbab72c admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:29.941720 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a638f-16c1-4139-b6b3-33abbcbab72c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:29.943783 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a638f-16c1-4139-b6b3-33abbcbab72c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:29.972692 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1406/2785] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:29 2022] POST /identity/v3/users => generated 298 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:29.975993 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e84217-f23a-43a1-8be1-c086af53f2a9 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:29.987714 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e84217-f23a-43a1-8be1-c086af53f2a9 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:29.993339 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c46184-d546-42b5-a2a6-47513e853763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:29.994016 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c46184-d546-42b5-a2a6-47513e853763 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:29.994337 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c46184-d546-42b5-a2a6-47513e853763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:29.994655 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c46184-d546-42b5-a2a6-47513e853763 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:29.995478 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c46184-d546-42b5-a2a6-47513e853763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:29.997439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c46184-d546-42b5-a2a6-47513e853763 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:30.011468 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1380/2786] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:30.016461 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a638f-16c1-4139-b6b3-33abbcbab72c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:30.030578 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a638f-16c1-4139-b6b3-33abbcbab72c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:30.037109 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe51d6-e85a-450f-8c7f-dae6caf34fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:30.037958 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe51d6-e85a-450f-8c7f-dae6caf34fce admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:30.038341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe51d6-e85a-450f-8c7f-dae6caf34fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:30.038931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe51d6-e85a-450f-8c7f-dae6caf34fce admin admin] PATH_INFO: `/v3/projects/831a616acdf7420082109f2899616214/users/a90e3dce8f584dfd9b024f71516973d3/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:30.070384 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe51d6-e85a-450f-8c7f-dae6caf34fce admin admin] RBAC: Authorizing `identity:create_grant(project_id=831a616acdf7420082109f2899616214, user_id=a90e3dce8f584dfd9b024f71516973d3, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:30.074440 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe51d6-e85a-450f-8c7f-dae6caf34fce admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:30.095007 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1407/2787] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:30 2022] PUT /identity/v3/projects/831a616acdf7420082109f2899616214/users/a90e3dce8f584dfd9b024f71516973d3/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:30.102465 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c46184-d546-42b5-a2a6-47513e853763 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:30.122360 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c46184-d546-42b5-a2a6-47513e853763 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:30.236158 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b699693-f4e6-475d-90c8-cafd9c57e15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:30.237390 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b699693-f4e6-475d-90c8-cafd9c57e15c admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:30.238048 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b699693-f4e6-475d-90c8-cafd9c57e15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:30.238511 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b699693-f4e6-475d-90c8-cafd9c57e15c admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:30.240266 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b699693-f4e6-475d-90c8-cafd9c57e15c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:30.242693 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b699693-f4e6-475d-90c8-cafd9c57e15c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:30.261343 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1381/2788] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:30.267883 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe51d6-e85a-450f-8c7f-dae6caf34fce admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:30.286733 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe51d6-e85a-450f-8c7f-dae6caf34fce admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:30.294562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d3c9a-6f46-4a17-a2e1-aba907bf471d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:30.295829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d3c9a-6f46-4a17-a2e1-aba907bf471d admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:30.296375 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d3c9a-6f46-4a17-a2e1-aba907bf471d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:30.296895 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d3c9a-6f46-4a17-a2e1-aba907bf471d admin admin] PATH_INFO: `/v3/projects/831a616acdf7420082109f2899616214/users/a90e3dce8f584dfd9b024f71516973d3/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:30.301245 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d3c9a-6f46-4a17-a2e1-aba907bf471d admin admin] RBAC: Authorizing `identity:create_grant(project_id=831a616acdf7420082109f2899616214, user_id=a90e3dce8f584dfd9b024f71516973d3, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:30.306991 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d3c9a-6f46-4a17-a2e1-aba907bf471d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:30.321969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1408/2789] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:30 2022] PUT /identity/v3/projects/831a616acdf7420082109f2899616214/users/a90e3dce8f584dfd9b024f71516973d3/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:30.336873 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ddbc2-47c6-4944-a9d7-e6688cae42ff None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:30.337311 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ddbc2-47c6-4944-a9d7-e6688cae42ff None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:30.337699 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ddbc2-47c6-4944-a9d7-e6688cae42ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:30.377205 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a06ddbc2-47c6-4944-a9d7-e6688cae42ff None None] MFA Rules not processed for user `a90e3dce8f584dfd9b024f71516973d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:30.381421 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a06ddbc2-47c6-4944-a9d7-e6688cae42ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:30.435870 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d3c9a-6f46-4a17-a2e1-aba907bf471d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:30.439209 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a84d3c9a-6f46-4a17-a2e1-aba907bf471d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:30.507642 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1382/2790] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:30.522215 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ddbc2-47c6-4944-a9d7-e6688cae42ff None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:30.524989 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a06ddbc2-47c6-4944-a9d7-e6688cae42ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:30.567353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d3c9a-6f46-4a17-a2e1-aba907bf471d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:30.575265 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffe9df-d494-4fca-8704-249c25725ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:30.576365 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffe9df-d494-4fca-8704-249c25725ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:30.576964 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffe9df-d494-4fca-8704-249c25725ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:30.577512 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffe9df-d494-4fca-8704-249c25725ef5 admin admin] PATH_INFO: `/v3/users/9e18d231e30349faafbfc7c9c9f7b076` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:30.579743 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffe9df-d494-4fca-8704-249c25725ef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e18d231e30349faafbfc7c9c9f7b076)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:30.584157 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffe9df-d494-4fca-8704-249c25725ef5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:30.599971 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:30.630595 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:30.642397 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ddbc2-47c6-4944-a9d7-e6688cae42ff None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:30.649912 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ea4f8-e659-48f8-8eb4-ba6e0c4412e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:30.650898 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ea4f8-e659-48f8-8eb4-ba6e0c4412e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:30.651355 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ea4f8-e659-48f8-8eb4-ba6e0c4412e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:30.651745 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ea4f8-e659-48f8-8eb4-ba6e0c4412e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:30.667372 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-eaffe9df-d494-4fca-8704-249c25725ef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e18d231e30349faafbfc7c9c9f7b076'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:30.667728 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ea4f8-e659-48f8-8eb4-ba6e0c4412e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:30.669243 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ea4f8-e659-48f8-8eb4-ba6e0c4412e3 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:30.680814 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1383/2791] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:30 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:43:30.688936 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-eaffe9df-d494-4fca-8704-249c25725ef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e18d231e30349faafbfc7c9c9f7b076'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:30.690390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-eaffe9df-d494-4fca-8704-249c25725ef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e18d231e30349faafbfc7c9c9f7b076'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:30.704421 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-eaffe9df-d494-4fca-8704-249c25725ef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e18d231e30349faafbfc7c9c9f7b076'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:30.718693 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-eaffe9df-d494-4fca-8704-249c25725ef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e18d231e30349faafbfc7c9c9f7b076'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:30.735214 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1409/2792] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:30 2022] DELETE /identity/v3/users/9e18d231e30349faafbfc7c9c9f7b076 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:30.746205 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6ed72-a491-46cd-9290-e65115be97df None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:30.747167 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6ed72-a491-46cd-9290-e65115be97df None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:30.747942 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6ed72-a491-46cd-9290-e65115be97df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:30.788785 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffe9df-d494-4fca-8704-249c25725ef5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:30.791133 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-eaffe9df-d494-4fca-8704-249c25725ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:30.791985 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c4e6ed72-a491-46cd-9290-e65115be97df None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:30.794264 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c4e6ed72-a491-46cd-9290-e65115be97df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:30.899294 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1384/2793] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:30.916171 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6ed72-a491-46cd-9290-e65115be97df None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:30.918058 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c4e6ed72-a491-46cd-9290-e65115be97df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:30.921199 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffe9df-d494-4fca-8704-249c25725ef5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:30.932413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53177b2b-a448-4230-8cd4-926d48bc50e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:30.933563 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53177b2b-a448-4230-8cd4-926d48bc50e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:30.934111 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53177b2b-a448-4230-8cd4-926d48bc50e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:30.934557 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53177b2b-a448-4230-8cd4-926d48bc50e5 admin admin] PATH_INFO: `/v3/users/48fe5eaa01a4416b9aa76472359343fb` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:30.936772 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53177b2b-a448-4230-8cd4-926d48bc50e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48fe5eaa01a4416b9aa76472359343fb)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:30.940389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53177b2b-a448-4230-8cd4-926d48bc50e5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:31.011365 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6ed72-a491-46cd-9290-e65115be97df None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:31.018004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8177014-2052-4ead-9fd5-0a7953a592fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:31.018816 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8177014-2052-4ead-9fd5-0a7953a592fc service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:31.019689 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8177014-2052-4ead-9fd5-0a7953a592fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:31.019931 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8177014-2052-4ead-9fd5-0a7953a592fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:31.030620 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8177014-2052-4ead-9fd5-0a7953a592fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:31.032105 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8177014-2052-4ead-9fd5-0a7953a592fc service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:31.035628 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-53177b2b-a448-4230-8cd4-926d48bc50e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48fe5eaa01a4416b9aa76472359343fb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:31.043943 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1385/2794] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:31.060967 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-53177b2b-a448-4230-8cd4-926d48bc50e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48fe5eaa01a4416b9aa76472359343fb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:31.062480 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-53177b2b-a448-4230-8cd4-926d48bc50e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48fe5eaa01a4416b9aa76472359343fb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:31.090427 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-53177b2b-a448-4230-8cd4-926d48bc50e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48fe5eaa01a4416b9aa76472359343fb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:31.118975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-53177b2b-a448-4230-8cd4-926d48bc50e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48fe5eaa01a4416b9aa76472359343fb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:31.132220 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1410/2795] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:30 2022] DELETE /identity/v3/users/48fe5eaa01a4416b9aa76472359343fb => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:31.137771 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1648be-1e02-4715-8628-d0d1446077a8 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:31.138059 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1648be-1e02-4715-8628-d0d1446077a8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:31.138342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1648be-1e02-4715-8628-d0d1446077a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:31.182286 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ed1648be-1e02-4715-8628-d0d1446077a8 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:31.184477 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ed1648be-1e02-4715-8628-d0d1446077a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:31.319793 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1386/2796] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:31.335514 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53177b2b-a448-4230-8cd4-926d48bc50e5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:31.338424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-53177b2b-a448-4230-8cd4-926d48bc50e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:31.445903 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:31.513715 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53177b2b-a448-4230-8cd4-926d48bc50e5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:31.521314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4177c-2aaf-48b3-9636-d5ac6a1b7091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:31.522382 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4177c-2aaf-48b3-9636-d5ac6a1b7091 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:31.522891 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4177c-2aaf-48b3-9636-d5ac6a1b7091 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:31.523400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4177c-2aaf-48b3-9636-d5ac6a1b7091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:31.543859 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4177c-2aaf-48b3-9636-d5ac6a1b7091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:31.546818 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4177c-2aaf-48b3-9636-d5ac6a1b7091 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:31.568875 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1411/2797] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:31.578949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1648be-1e02-4715-8628-d0d1446077a8 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:31.583678 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ed1648be-1e02-4715-8628-d0d1446077a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:31.609817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1648be-1e02-4715-8628-d0d1446077a8 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:31.618603 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13119528-8be6-42b2-b0f1-a8715ba9e9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:31.619684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13119528-8be6-42b2-b0f1-a8715ba9e9e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:31.620170 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13119528-8be6-42b2-b0f1-a8715ba9e9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:31.620682 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13119528-8be6-42b2-b0f1-a8715ba9e9e5 admin admin] PATH_INFO: `/v3/projects/fc9b409c76f846dda2cb0a0b31f8c631` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:31.622834 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13119528-8be6-42b2-b0f1-a8715ba9e9e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc9b409c76f846dda2cb0a0b31f8c631)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:31.629028 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13119528-8be6-42b2-b0f1-a8715ba9e9e5 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:31.653179 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:31.714913 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-13119528-8be6-42b2-b0f1-a8715ba9e9e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc9b409c76f846dda2cb0a0b31f8c631', 'request_id': 'req-13119528-8be6-42b2-b0f1-a8715ba9e9e5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:31.723870 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-13119528-8be6-42b2-b0f1-a8715ba9e9e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc9b409c76f846dda2cb0a0b31f8c631', 'request_id': 'req-13119528-8be6-42b2-b0f1-a8715ba9e9e5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:31.731815 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-13119528-8be6-42b2-b0f1-a8715ba9e9e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc9b409c76f846dda2cb0a0b31f8c631', 'request_id': 'req-13119528-8be6-42b2-b0f1-a8715ba9e9e5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:31.750750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-13119528-8be6-42b2-b0f1-a8715ba9e9e5 admin admin] The token cache is being invalidate because project fc9b409c76f846dda2cb0a0b31f8c631 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:31.751270 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-13119528-8be6-42b2-b0f1-a8715ba9e9e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:31.752273 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-13119528-8be6-42b2-b0f1-a8715ba9e9e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:31.762664 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1387/2798] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:31 2022] DELETE /identity/v3/projects/fc9b409c76f846dda2cb0a0b31f8c631 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:31.765241 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4177c-2aaf-48b3-9636-d5ac6a1b7091 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:31.806105 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4177c-2aaf-48b3-9636-d5ac6a1b7091 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:31.949738 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d0b3f-36d6-41b5-95ba-443df6d645d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:31.951045 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d0b3f-36d6-41b5-95ba-443df6d645d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:31.951657 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d0b3f-36d6-41b5-95ba-443df6d645d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:31.952318 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d0b3f-36d6-41b5-95ba-443df6d645d4 admin admin] PATH_INFO: `/v3/users/e637cd53f36c40b585b7b9a13291b9c9` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:31.954161 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d0b3f-36d6-41b5-95ba-443df6d645d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e637cd53f36c40b585b7b9a13291b9c9)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:31.958169 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d0b3f-36d6-41b5-95ba-443df6d645d4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:32.032143 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13119528-8be6-42b2-b0f1-a8715ba9e9e5 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:32.036311 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-13119528-8be6-42b2-b0f1-a8715ba9e9e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:32.055284 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e66d0b3f-36d6-41b5-95ba-443df6d645d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e637cd53f36c40b585b7b9a13291b9c9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:32.094253 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13119528-8be6-42b2-b0f1-a8715ba9e9e5 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:32.111058 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e66d0b3f-36d6-41b5-95ba-443df6d645d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e637cd53f36c40b585b7b9a13291b9c9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:32.113099 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e66d0b3f-36d6-41b5-95ba-443df6d645d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e637cd53f36c40b585b7b9a13291b9c9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:32.117733 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a45b8-d3e1-4b7f-b9a4-01289d122a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:32.118894 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a45b8-d3e1-4b7f-b9a4-01289d122a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:32.120528 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a45b8-d3e1-4b7f-b9a4-01289d122a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:32.121086 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a45b8-d3e1-4b7f-b9a4-01289d122a10 admin admin] PATH_INFO: `/v3/projects/8d11591bd54043bbbf756c3fa2eb8f43` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:32.124440 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a45b8-d3e1-4b7f-b9a4-01289d122a10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d11591bd54043bbbf756c3fa2eb8f43)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:32.126452 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e66d0b3f-36d6-41b5-95ba-443df6d645d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e637cd53f36c40b585b7b9a13291b9c9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:32.129364 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a45b8-d3e1-4b7f-b9a4-01289d122a10 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:32.143360 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e66d0b3f-36d6-41b5-95ba-443df6d645d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e637cd53f36c40b585b7b9a13291b9c9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:32.153543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1412/2799] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:31 2022] DELETE /identity/v3/users/e637cd53f36c40b585b7b9a13291b9c9 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:32.225998 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a26a45b8-d3e1-4b7f-b9a4-01289d122a10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d11591bd54043bbbf756c3fa2eb8f43', 'request_id': 'req-a26a45b8-d3e1-4b7f-b9a4-01289d122a10'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:32.235287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a26a45b8-d3e1-4b7f-b9a4-01289d122a10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d11591bd54043bbbf756c3fa2eb8f43', 'request_id': 'req-a26a45b8-d3e1-4b7f-b9a4-01289d122a10'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:32.244822 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a26a45b8-d3e1-4b7f-b9a4-01289d122a10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d11591bd54043bbbf756c3fa2eb8f43', 'request_id': 'req-a26a45b8-d3e1-4b7f-b9a4-01289d122a10'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:32.263339 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a26a45b8-d3e1-4b7f-b9a4-01289d122a10 admin admin] The token cache is being invalidate because project 8d11591bd54043bbbf756c3fa2eb8f43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:32.263808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a26a45b8-d3e1-4b7f-b9a4-01289d122a10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:32.264835 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a26a45b8-d3e1-4b7f-b9a4-01289d122a10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:32.267129 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1388/2800] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:32 2022] DELETE /identity/v3/projects/8d11591bd54043bbbf756c3fa2eb8f43 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:32.272053 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d0b3f-36d6-41b5-95ba-443df6d645d4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:32.273731 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e66d0b3f-36d6-41b5-95ba-443df6d645d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:32.341835 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:32.370731 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d0b3f-36d6-41b5-95ba-443df6d645d4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:32.479721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905312f-5a0e-497e-a043-681593d4a644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:32.480858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905312f-5a0e-497e-a043-681593d4a644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:32.481341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905312f-5a0e-497e-a043-681593d4a644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:32.481822 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905312f-5a0e-497e-a043-681593d4a644 admin admin] PATH_INFO: `/v3/users/a90e3dce8f584dfd9b024f71516973d3` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:32.483756 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905312f-5a0e-497e-a043-681593d4a644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a90e3dce8f584dfd9b024f71516973d3)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:32.487504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905312f-5a0e-497e-a043-681593d4a644 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:32.603670 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f905312f-5a0e-497e-a043-681593d4a644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a90e3dce8f584dfd9b024f71516973d3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:32.622946 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a45b8-d3e1-4b7f-b9a4-01289d122a10 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:32.625325 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a26a45b8-d3e1-4b7f-b9a4-01289d122a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:32.655204 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f905312f-5a0e-497e-a043-681593d4a644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a90e3dce8f584dfd9b024f71516973d3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:32.656829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f905312f-5a0e-497e-a043-681593d4a644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a90e3dce8f584dfd9b024f71516973d3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:32.676567 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a45b8-d3e1-4b7f-b9a4-01289d122a10 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:32.676979 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f905312f-5a0e-497e-a043-681593d4a644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a90e3dce8f584dfd9b024f71516973d3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:32.690052 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f905312f-5a0e-497e-a043-681593d4a644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a90e3dce8f584dfd9b024f71516973d3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:32.692234 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7452b-a5e9-472d-b171-f18253d82a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:32.693181 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7452b-a5e9-472d-b171-f18253d82a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:32.693906 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7452b-a5e9-472d-b171-f18253d82a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:32.694684 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7452b-a5e9-472d-b171-f18253d82a91 admin admin] PATH_INFO: `/v3/projects/b651c7aebfe040fd8cb4ade5c76217b6` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:32.696912 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7452b-a5e9-472d-b171-f18253d82a91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b651c7aebfe040fd8cb4ade5c76217b6)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:32.701113 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7452b-a5e9-472d-b171-f18253d82a91 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:32.704762 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1413/2801] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:32 2022] DELETE /identity/v3/users/a90e3dce8f584dfd9b024f71516973d3 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:32.775347 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662e690-5885-4e68-839d-5aed1306f192 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:32.775347 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662e690-5885-4e68-839d-5aed1306f192 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:32.775874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662e690-5885-4e68-839d-5aed1306f192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:32.785505 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-85b7452b-a5e9-472d-b171-f18253d82a91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b651c7aebfe040fd8cb4ade5c76217b6', 'request_id': 'req-85b7452b-a5e9-472d-b171-f18253d82a91'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:32.798429 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-85b7452b-a5e9-472d-b171-f18253d82a91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b651c7aebfe040fd8cb4ade5c76217b6', 'request_id': 'req-85b7452b-a5e9-472d-b171-f18253d82a91'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:32.808815 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b662e690-5885-4e68-839d-5aed1306f192 None None] MFA Rules not processed for user `3c001a902faf4b3c8d8f23f2e017c706`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:32.811876 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b662e690-5885-4e68-839d-5aed1306f192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:32.812812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-85b7452b-a5e9-472d-b171-f18253d82a91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b651c7aebfe040fd8cb4ade5c76217b6', 'request_id': 'req-85b7452b-a5e9-472d-b171-f18253d82a91'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:32.837635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-85b7452b-a5e9-472d-b171-f18253d82a91 admin admin] The token cache is being invalidate because project b651c7aebfe040fd8cb4ade5c76217b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:32.838823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-85b7452b-a5e9-472d-b171-f18253d82a91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:32.840068 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-85b7452b-a5e9-472d-b171-f18253d82a91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:32.845351 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1389/2802] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:32 2022] DELETE /identity/v3/projects/b651c7aebfe040fd8cb4ade5c76217b6 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:32.852243 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93789d0b-89e9-4c77-8e97-51a97037d17d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:32.852789 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93789d0b-89e9-4c77-8e97-51a97037d17d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:32.853281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93789d0b-89e9-4c77-8e97-51a97037d17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:32.884098 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=76,keystone:DELETE=21,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:32.894635 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-93789d0b-89e9-4c77-8e97-51a97037d17d None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:32.896751 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-93789d0b-89e9-4c77-8e97-51a97037d17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:32.934799 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1414/2803] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 1 16:43:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:33.002852 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1390/2804] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:33.055639 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662e690-5885-4e68-839d-5aed1306f192 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:33.066820 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b662e690-5885-4e68-839d-5aed1306f192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:33.073558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb453f04-7775-40b7-b36d-18499c0fcad5 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:33.073853 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb453f04-7775-40b7-b36d-18499c0fcad5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:33.074111 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb453f04-7775-40b7-b36d-18499c0fcad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:33.089108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:33.098268 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-cb453f04-7775-40b7-b36d-18499c0fcad5 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:33.101784 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cb453f04-7775-40b7-b36d-18499c0fcad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:33.120405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1391/2805] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:33.122905 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb453f04-7775-40b7-b36d-18499c0fcad5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:33.143246 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb453f04-7775-40b7-b36d-18499c0fcad5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:33.151954 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43283c7a-9eb9-4278-a7a4-4a0d05b8de20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:33.153051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43283c7a-9eb9-4278-a7a4-4a0d05b8de20 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:33.153530 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43283c7a-9eb9-4278-a7a4-4a0d05b8de20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:33.154003 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43283c7a-9eb9-4278-a7a4-4a0d05b8de20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:33.155817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43283c7a-9eb9-4278-a7a4-4a0d05b8de20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:33.155817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43283c7a-9eb9-4278-a7a4-4a0d05b8de20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:33.159404 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43283c7a-9eb9-4278-a7a4-4a0d05b8de20 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:33.188692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1392/2806] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:43:33.192967 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43283c7a-9eb9-4278-a7a4-4a0d05b8de20 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:33.211111 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43283c7a-9eb9-4278-a7a4-4a0d05b8de20 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:33.218498 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d7fc7-c8b7-4604-a3ec-f552368e6478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:33.219595 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d7fc7-c8b7-4604-a3ec-f552368e6478 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:33.220118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d7fc7-c8b7-4604-a3ec-f552368e6478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:33.220702 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d7fc7-c8b7-4604-a3ec-f552368e6478 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:33.221898 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d7fc7-c8b7-4604-a3ec-f552368e6478 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:33.226064 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662e690-5885-4e68-839d-5aed1306f192 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:33.226293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d7fc7-c8b7-4604-a3ec-f552368e6478 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:33.234691 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49635e01-d92d-41b0-824b-f09c7e2129d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748e35d9a1534920860b2234d45f6724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:33.235687 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49635e01-d92d-41b0-824b-f09c7e2129d3 service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:33.236041 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49635e01-d92d-41b0-824b-f09c7e2129d3 service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:33.236512 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49635e01-d92d-41b0-824b-f09c7e2129d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:33.253721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49635e01-d92d-41b0-824b-f09c7e2129d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:33.255112 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49635e01-d92d-41b0-824b-f09c7e2129d3 service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:33.275374 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1393/2808] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:33 2022] POST /identity/v3/projects => generated 365 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:33.277183 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d7fc7-c8b7-4604-a3ec-f552368e6478 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:33.280700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2c6d7fc7-c8b7-4604-a3ec-f552368e6478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:33.284310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1415/2808] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 1 16:43:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:43:33.286766 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49635e01-d92d-41b0-824b-f09c7e2129d3 service swift] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:33.318449 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49635e01-d92d-41b0-824b-f09c7e2129d3 service swift] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:33.402136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d7fc7-c8b7-4604-a3ec-f552368e6478 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:33.409217 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f5141-2557-4681-9c2b-e7b180100147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:33.410483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f5141-2557-4681-9c2b-e7b180100147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:33.410833 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f5141-2557-4681-9c2b-e7b180100147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:33.411098 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f5141-2557-4681-9c2b-e7b180100147 admin admin] PATH_INFO: `/v3/projects/831a616acdf7420082109f2899616214` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:33.412728 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f5141-2557-4681-9c2b-e7b180100147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=831a616acdf7420082109f2899616214)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:33.415035 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f5141-2557-4681-9c2b-e7b180100147 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:33.423097 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1874a0d-dde7-4fcf-a412-a77cf0fa6f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:33.424254 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1874a0d-dde7-4fcf-a412-a77cf0fa6f6a admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:33.424865 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1874a0d-dde7-4fcf-a412-a77cf0fa6f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:33.425926 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1874a0d-dde7-4fcf-a412-a77cf0fa6f6a admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:33.426792 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1874a0d-dde7-4fcf-a412-a77cf0fa6f6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:33.429916 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1874a0d-dde7-4fcf-a412-a77cf0fa6f6a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:33.460798 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1416/2809] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:33 2022] POST /identity/v3/users => generated 283 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:33.473055 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1874a0d-dde7-4fcf-a412-a77cf0fa6f6a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:33.488941 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1874a0d-dde7-4fcf-a412-a77cf0fa6f6a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:33.501362 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fb0f5141-2557-4681-9c2b-e7b180100147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '831a616acdf7420082109f2899616214', 'request_id': 'req-fb0f5141-2557-4681-9c2b-e7b180100147'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:33.518422 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fb0f5141-2557-4681-9c2b-e7b180100147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '831a616acdf7420082109f2899616214', 'request_id': 'req-fb0f5141-2557-4681-9c2b-e7b180100147'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:33.534994 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fb0f5141-2557-4681-9c2b-e7b180100147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '831a616acdf7420082109f2899616214', 'request_id': 'req-fb0f5141-2557-4681-9c2b-e7b180100147'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:33.544672 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:33.565974 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fb0f5141-2557-4681-9c2b-e7b180100147 admin admin] The token cache is being invalidate because project 831a616acdf7420082109f2899616214 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:33.566585 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fb0f5141-2557-4681-9c2b-e7b180100147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:33.568554 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fb0f5141-2557-4681-9c2b-e7b180100147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:33.571614 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1394/2810] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:33 2022] DELETE /identity/v3/projects/831a616acdf7420082109f2899616214 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:33.580820 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8805c4a-a1e1-48c2-b8fc-84d48523ccf3 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:33.581449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8805c4a-a1e1-48c2-b8fc-84d48523ccf3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:33.581803 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8805c4a-a1e1-48c2-b8fc-84d48523ccf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:33.600177 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0e302-872e-4507-b616-6c46a9955a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:33.601724 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0e302-872e-4507-b616-6c46a9955a85 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:33.602403 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0e302-872e-4507-b616-6c46a9955a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:33.602893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0e302-872e-4507-b616-6c46a9955a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:33.604042 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0e302-872e-4507-b616-6c46a9955a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:33.607088 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0e302-872e-4507-b616-6c46a9955a85 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:33.619202 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-d8805c4a-a1e1-48c2-b8fc-84d48523ccf3 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:33.621674 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d8805c4a-a1e1-48c2-b8fc-84d48523ccf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:33.628914 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1417/2811] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:33.630656 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0e302-872e-4507-b616-6c46a9955a85 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:33.633236 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-78e0e302-872e-4507-b616-6c46a9955a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:33.637669 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1395/2812] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:33.647806 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fb755-cf11-4e74-957a-94a0b61ea212 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:33.648287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fb755-cf11-4e74-957a-94a0b61ea212 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:33.648712 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fb755-cf11-4e74-957a-94a0b61ea212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:33.649589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0e302-872e-4507-b616-6c46a9955a85 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:33.655205 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea5d19-4f0d-4289-bd9b-d3e0c0c80ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:33.655980 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea5d19-4f0d-4289-bd9b-d3e0c0c80ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:33.656319 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea5d19-4f0d-4289-bd9b-d3e0c0c80ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:33.656555 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea5d19-4f0d-4289-bd9b-d3e0c0c80ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:33.657328 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea5d19-4f0d-4289-bd9b-d3e0c0c80ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:33.658948 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea5d19-4f0d-4289-bd9b-d3e0c0c80ba6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:33.677596 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1418/2813] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:33.678462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ee4fb755-cf11-4e74-957a-94a0b61ea212 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:33.680092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ee4fb755-cf11-4e74-957a-94a0b61ea212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:33.681857 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea5d19-4f0d-4289-bd9b-d3e0c0c80ba6 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:33.692281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1396/2814] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:33.694811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea5d19-4f0d-4289-bd9b-d3e0c0c80ba6 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:33.699430 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4fb755-cf11-4e74-957a-94a0b61ea212 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:33.700145 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b40e30-e954-410c-a208-06922855cffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:33.700877 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b40e30-e954-410c-a208-06922855cffb admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:33.701281 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b40e30-e954-410c-a208-06922855cffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:33.701456 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b40e30-e954-410c-a208-06922855cffb admin admin] PATH_INFO: `/v3/projects/e9749f8d8e874c5b8fa52f1729192dff/users/a5903f692c0e4008a7bcbd0b0a570649/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:33.714247 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4fb755-cf11-4e74-957a-94a0b61ea212 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:33.721770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:33.723188 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b5eac-e20c-48c2-bbee-4ace6a05d21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:33.724300 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b5eac-e20c-48c2-bbee-4ace6a05d21c admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:33.724853 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b5eac-e20c-48c2-bbee-4ace6a05d21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:33.725282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b5eac-e20c-48c2-bbee-4ace6a05d21c admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:33.726501 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b5eac-e20c-48c2-bbee-4ace6a05d21c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:33.726985 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b5eac-e20c-48c2-bbee-4ace6a05d21c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:33.729976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b5eac-e20c-48c2-bbee-4ace6a05d21c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:33.731602 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b40e30-e954-410c-a208-06922855cffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9749f8d8e874c5b8fa52f1729192dff, user_id=a5903f692c0e4008a7bcbd0b0a570649, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:33.739521 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b40e30-e954-410c-a208-06922855cffb admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:33.751782 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1397/2815] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:43:33.758524 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b5eac-e20c-48c2-bbee-4ace6a05d21c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:33.764586 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1419/2816] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:33 2022] PUT /identity/v3/projects/e9749f8d8e874c5b8fa52f1729192dff/users/a5903f692c0e4008a7bcbd0b0a570649/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:33.778112 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b5eac-e20c-48c2-bbee-4ace6a05d21c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:33.779068 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486002ef-bcc4-4d4f-8987-a3b42b9c7bea None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:33.779757 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486002ef-bcc4-4d4f-8987-a3b42b9c7bea None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:33.780250 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486002ef-bcc4-4d4f-8987-a3b42b9c7bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:33.830552 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-486002ef-bcc4-4d4f-8987-a3b42b9c7bea None None] MFA Rules not processed for user `a5903f692c0e4008a7bcbd0b0a570649`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:33.832657 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-486002ef-bcc4-4d4f-8987-a3b42b9c7bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:33.917011 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e404a-d5eb-4662-b546-a8df4d8aff33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:33.919426 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e404a-d5eb-4662-b546-a8df4d8aff33 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:33.920176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e404a-d5eb-4662-b546-a8df4d8aff33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:33.920940 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e404a-d5eb-4662-b546-a8df4d8aff33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:33.922750 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e404a-d5eb-4662-b546-a8df4d8aff33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:33.926666 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e404a-d5eb-4662-b546-a8df4d8aff33 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:33.952994 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1420/2817] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:33.971800 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1398/2818] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:33 2022] POST /identity/v3/projects => generated 387 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:33.972133 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486002ef-bcc4-4d4f-8987-a3b42b9c7bea None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:33.973091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e404a-d5eb-4662-b546-a8df4d8aff33 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:33.973264 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-486002ef-bcc4-4d4f-8987-a3b42b9c7bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:34.087857 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486002ef-bcc4-4d4f-8987-a3b42b9c7bea None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:34.092794 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e404a-d5eb-4662-b546-a8df4d8aff33 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:34.101490 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58b560-0947-4c9f-819e-c4d86484f2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:34.102854 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58b560-0947-4c9f-819e-c4d86484f2ba admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:34.103315 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58b560-0947-4c9f-819e-c4d86484f2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:34.103779 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58b560-0947-4c9f-819e-c4d86484f2ba admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:34.105586 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58b560-0947-4c9f-819e-c4d86484f2ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:34.109731 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58b560-0947-4c9f-819e-c4d86484f2ba admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:34.149866 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1399/2819] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:33 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:34.151645 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6337022-3564-4468-bba5-ba3084fbe082 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:34.151980 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6337022-3564-4468-bba5-ba3084fbe082 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:34.152347 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6337022-3564-4468-bba5-ba3084fbe082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:34.160858 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c000c-dfd2-4b8c-bdb6-200f84baa838 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2feb3132ad9497aaae8720ed170ef3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:34.161543 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c000c-dfd2-4b8c-bdb6-200f84baa838 service glance] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:34.161831 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c000c-dfd2-4b8c-bdb6-200f84baa838 service glance] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:34.162109 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c000c-dfd2-4b8c-bdb6-200f84baa838 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:34.177250 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f6337022-3564-4468-bba5-ba3084fbe082 None None] MFA Rules not processed for user `3c001a902faf4b3c8d8f23f2e017c706`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:34.178558 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f6337022-3564-4468-bba5-ba3084fbe082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:34.229305 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:34.232776 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:34.248159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c000c-dfd2-4b8c-bdb6-200f84baa838 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:34.250163 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c000c-dfd2-4b8c-bdb6-200f84baa838 service glance] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:34.252297 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1400/2820] 10.222.0.52 () {58 vars in 967 bytes} [Thu Sep 1 16:43:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:34.257620 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6337022-3564-4468-bba5-ba3084fbe082 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:34.265792 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1421/2821] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:43:34.270909 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6337022-3564-4468-bba5-ba3084fbe082 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:34.272386 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c000c-dfd2-4b8c-bdb6-200f84baa838 service glance] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:34.274451 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-467c000c-dfd2-4b8c-bdb6-200f84baa838 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:34.276789 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9721e1-e68a-46e1-9685-ca8bab8aac79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:34.277423 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9721e1-e68a-46e1-9685-ca8bab8aac79 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:34.277692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9721e1-e68a-46e1-9685-ca8bab8aac79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:34.278127 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9721e1-e68a-46e1-9685-ca8bab8aac79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:34.278812 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9721e1-e68a-46e1-9685-ca8bab8aac79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:34.280509 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9721e1-e68a-46e1-9685-ca8bab8aac79 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:34.299730 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1401/2822] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:34.305732 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9721e1-e68a-46e1-9685-ca8bab8aac79 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:34.319006 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9721e1-e68a-46e1-9685-ca8bab8aac79 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:34.327636 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d16857-e8dd-4927-9ad9-d5ccdfc44d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:34.328959 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d16857-e8dd-4927-9ad9-d5ccdfc44d2d admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:34.329553 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d16857-e8dd-4927-9ad9-d5ccdfc44d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:34.330279 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d16857-e8dd-4927-9ad9-d5ccdfc44d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:34.331673 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d16857-e8dd-4927-9ad9-d5ccdfc44d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:34.334766 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d16857-e8dd-4927-9ad9-d5ccdfc44d2d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:34.352967 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1402/2823] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:34.358666 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d16857-e8dd-4927-9ad9-d5ccdfc44d2d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:34.371334 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d16857-e8dd-4927-9ad9-d5ccdfc44d2d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:34.377309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19a205-0a6c-4b6b-b1e6-e01e49fbc967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:34.377931 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19a205-0a6c-4b6b-b1e6-e01e49fbc967 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:34.378802 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19a205-0a6c-4b6b-b1e6-e01e49fbc967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:34.379103 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19a205-0a6c-4b6b-b1e6-e01e49fbc967 admin admin] PATH_INFO: `/v3/projects/f752205ccf054dd4988bae80987565d8/users/90d607c08482498e91747466fca45ca8/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:34.392585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c000c-dfd2-4b8c-bdb6-200f84baa838 service glance] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:34.399489 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88f75e-f9af-4cf7-be8c-7cc0e53dfe79 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748e35d9a1534920860b2234d45f6724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:34.400106 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88f75e-f9af-4cf7-be8c-7cc0e53dfe79 service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:34.400389 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88f75e-f9af-4cf7-be8c-7cc0e53dfe79 service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:34.400696 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88f75e-f9af-4cf7-be8c-7cc0e53dfe79 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:34.402770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19a205-0a6c-4b6b-b1e6-e01e49fbc967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f752205ccf054dd4988bae80987565d8, user_id=90d607c08482498e91747466fca45ca8, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:34.407235 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19a205-0a6c-4b6b-b1e6-e01e49fbc967 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:34.412057 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88f75e-f9af-4cf7-be8c-7cc0e53dfe79 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:34.416214 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88f75e-f9af-4cf7-be8c-7cc0e53dfe79 service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:34.430942 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1403/2824] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:34 2022] PUT /identity/v3/projects/f752205ccf054dd4988bae80987565d8/users/90d607c08482498e91747466fca45ca8/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:34.442710 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0a94c-8f9d-4c91-bbc0-4d4e129397a4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:34.443154 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0a94c-8f9d-4c91-bbc0-4d4e129397a4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:34.443556 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0a94c-8f9d-4c91-bbc0-4d4e129397a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:34.445304 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1422/2825] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 1 16:43:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 16:43:34.492265 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8cf0a94c-8f9d-4c91-bbc0-4d4e129397a4 None None] MFA Rules not processed for user `90d607c08482498e91747466fca45ca8`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:34.493890 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8cf0a94c-8f9d-4c91-bbc0-4d4e129397a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:34.586745 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1404/2826] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:34.593351 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88f75e-f9af-4cf7-be8c-7cc0e53dfe79 service swift] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:34.609059 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88f75e-f9af-4cf7-be8c-7cc0e53dfe79 service swift] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:34.719638 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b01d3-cd0f-4627-bb01-7cc146d920b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:34.721948 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b01d3-cd0f-4627-bb01-7cc146d920b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:34.722991 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b01d3-cd0f-4627-bb01-7cc146d920b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:34.723436 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b01d3-cd0f-4627-bb01-7cc146d920b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:34.725049 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b01d3-cd0f-4627-bb01-7cc146d920b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:34.727829 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b01d3-cd0f-4627-bb01-7cc146d920b9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:34.765313 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249dcde-e78c-474b-9c52-7ad47a8d0f25 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:34.766408 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249dcde-e78c-474b-9c52-7ad47a8d0f25 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:34.766778 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249dcde-e78c-474b-9c52-7ad47a8d0f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:34.767262 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1423/2827] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:34 2022] POST /identity/v3/projects => generated 387 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:34.773082 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b01d3-cd0f-4627-bb01-7cc146d920b9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:34.793139 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-7249dcde-e78c-474b-9c52-7ad47a8d0f25 None None] MFA Rules not processed for user `3c001a902faf4b3c8d8f23f2e017c706`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:34.794655 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7249dcde-e78c-474b-9c52-7ad47a8d0f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:34.875495 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b01d3-cd0f-4627-bb01-7cc146d920b9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:34.884239 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5e6e9-6e64-4d3c-8d7e-f66acc38a822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:34.885378 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5e6e9-6e64-4d3c-8d7e-f66acc38a822 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:34.885855 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5e6e9-6e64-4d3c-8d7e-f66acc38a822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:34.886326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5e6e9-6e64-4d3c-8d7e-f66acc38a822 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:34.887326 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5e6e9-6e64-4d3c-8d7e-f66acc38a822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:34.890833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5e6e9-6e64-4d3c-8d7e-f66acc38a822 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:34.897678 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1405/2828] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 1 16:43:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:34.908324 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:34.920121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249dcde-e78c-474b-9c52-7ad47a8d0f25 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:34.930659 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1424/2829] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:34 2022] POST /identity/v3/users => generated 300 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:34.933138 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5e6e9-6e64-4d3c-8d7e-f66acc38a822 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:34.958947 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5e6e9-6e64-4d3c-8d7e-f66acc38a822 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:34.983997 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4c7e7-adaf-4101-be9a-6c69a55074d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:34.984926 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4c7e7-adaf-4101-be9a-6c69a55074d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:34.985377 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4c7e7-adaf-4101-be9a-6c69a55074d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:34.985821 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4c7e7-adaf-4101-be9a-6c69a55074d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:34.986724 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4c7e7-adaf-4101-be9a-6c69a55074d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:34.990476 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4c7e7-adaf-4101-be9a-6c69a55074d8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:35.008872 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1425/2830] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:35.013823 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:35.014528 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4c7e7-adaf-4101-be9a-6c69a55074d8 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:35.030527 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4c7e7-adaf-4101-be9a-6c69a55074d8 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:35.037972 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7aca87-0d7a-49b3-9cef-7839864b84f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:35.038472 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7aca87-0d7a-49b3-9cef-7839864b84f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:35.038764 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7aca87-0d7a-49b3-9cef-7839864b84f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:35.039262 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7aca87-0d7a-49b3-9cef-7839864b84f0 admin admin] PATH_INFO: `/v3/projects/6a5bc95c3dac45d48fa2a925c66436ce/users/b07f27e950ef4cd991cf0e94d0bd4a4d/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:35.060170 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7aca87-0d7a-49b3-9cef-7839864b84f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a5bc95c3dac45d48fa2a925c66436ce, user_id=b07f27e950ef4cd991cf0e94d0bd4a4d, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:35.063634 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7aca87-0d7a-49b3-9cef-7839864b84f0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:35.075643 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249dcde-e78c-474b-9c52-7ad47a8d0f25 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:35.085477 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1426/2831] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:35 2022] PUT /identity/v3/projects/6a5bc95c3dac45d48fa2a925c66436ce/users/b07f27e950ef4cd991cf0e94d0bd4a4d/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:35.090727 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7aca87-0d7a-49b3-9cef-7839864b84f0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:35.198476 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2490e-c0cc-4a51-8b9c-078548a8ac98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748e35d9a1534920860b2234d45f6724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:35.199369 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2490e-c0cc-4a51-8b9c-078548a8ac98 service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:35.199729 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2490e-c0cc-4a51-8b9c-078548a8ac98 service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:35.200068 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2490e-c0cc-4a51-8b9c-078548a8ac98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:35.210285 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7aca87-0d7a-49b3-9cef-7839864b84f0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:35.217234 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcede9-b129-4156-9c82-03d3da335525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:35.218013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcede9-b129-4156-9c82-03d3da335525 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:35.218371 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcede9-b129-4156-9c82-03d3da335525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:35.218710 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcede9-b129-4156-9c82-03d3da335525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:35.219528 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdcede9-b129-4156-9c82-03d3da335525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:35.221833 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdcede9-b129-4156-9c82-03d3da335525 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:35.240416 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1427/2832] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:35.245636 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcede9-b129-4156-9c82-03d3da335525 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:35.259239 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcede9-b129-4156-9c82-03d3da335525 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:35.265728 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103be167-1a2c-466e-85a6-8c220992095c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:35.266831 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103be167-1a2c-466e-85a6-8c220992095c admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:35.267259 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103be167-1a2c-466e-85a6-8c220992095c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:35.267694 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103be167-1a2c-466e-85a6-8c220992095c admin admin] PATH_INFO: `/v3/projects/6a5bc95c3dac45d48fa2a925c66436ce/users/b07f27e950ef4cd991cf0e94d0bd4a4d/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:35.270676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103be167-1a2c-466e-85a6-8c220992095c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a5bc95c3dac45d48fa2a925c66436ce, user_id=b07f27e950ef4cd991cf0e94d0bd4a4d, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:35.274018 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103be167-1a2c-466e-85a6-8c220992095c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:35.287506 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1428/2833] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:35 2022] PUT /identity/v3/projects/6a5bc95c3dac45d48fa2a925c66436ce/users/b07f27e950ef4cd991cf0e94d0bd4a4d/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:35.288980 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2490e-c0cc-4a51-8b9c-078548a8ac98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:35.291047 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2490e-c0cc-4a51-8b9c-078548a8ac98 service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:35.302369 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88c073-c7a1-4f30-8b5f-187425b143f6 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:35.302821 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88c073-c7a1-4f30-8b5f-187425b143f6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:35.303281 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88c073-c7a1-4f30-8b5f-187425b143f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:35.304320 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1406/2834] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 1 16:43:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 16:43:35.359987 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ca88c073-c7a1-4f30-8b5f-187425b143f6 None None] MFA Rules not processed for user `b07f27e950ef4cd991cf0e94d0bd4a4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:35.361517 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ca88c073-c7a1-4f30-8b5f-187425b143f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:35.491471 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1429/2835] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:35.509808 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2490e-c0cc-4a51-8b9c-078548a8ac98 service swift] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:35.512118 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0ba2490e-c0cc-4a51-8b9c-078548a8ac98 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:35.617562 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2490e-c0cc-4a51-8b9c-078548a8ac98 service swift] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:35.691258 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:35.726215 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59cbb7-1e85-4e72-8a86-ab624bd94ad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:35.726898 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59cbb7-1e85-4e72-8a86-ab624bd94ad0 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:35.727222 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59cbb7-1e85-4e72-8a86-ab624bd94ad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:35.727541 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59cbb7-1e85-4e72-8a86-ab624bd94ad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:35.743532 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59cbb7-1e85-4e72-8a86-ab624bd94ad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:35.746015 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59cbb7-1e85-4e72-8a86-ab624bd94ad0 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:35.764715 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1407/2836] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:35 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:35.864361 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acb7d6-3ee6-43ac-93d0-a577666f0e36 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:35.864765 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acb7d6-3ee6-43ac-93d0-a577666f0e36 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:35.865006 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acb7d6-3ee6-43ac-93d0-a577666f0e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:35.898336 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b2acb7d6-3ee6-43ac-93d0-a577666f0e36 None None] MFA Rules not processed for user `3c001a902faf4b3c8d8f23f2e017c706`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:35.899651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b2acb7d6-3ee6-43ac-93d0-a577666f0e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:35.936032 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:35.957025 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59cbb7-1e85-4e72-8a86-ab624bd94ad0 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:35.999110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1430/2837] 10.222.0.52 () {58 vars in 967 bytes} [Thu Sep 1 16:43:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:36.018194 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acb7d6-3ee6-43ac-93d0-a577666f0e36 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:36.096790 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59cbb7-1e85-4e72-8a86-ab624bd94ad0 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:36.106745 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e85b63-3ab6-4b74-a752-4cbab891967e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:36.108068 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e85b63-3ab6-4b74-a752-4cbab891967e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:36.108769 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e85b63-3ab6-4b74-a752-4cbab891967e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:36.109109 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e85b63-3ab6-4b74-a752-4cbab891967e admin admin] PATH_INFO: `/v3/users/90d607c08482498e91747466fca45ca8` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:36.111667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e85b63-3ab6-4b74-a752-4cbab891967e admin admin] RBAC: Authorizing `identity:delete_user(user_id=90d607c08482498e91747466fca45ca8)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:36.115452 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e85b63-3ab6-4b74-a752-4cbab891967e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:36.145534 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acb7d6-3ee6-43ac-93d0-a577666f0e36 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:36.152099 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387cbdd8-ea78-4b29-80c8-4f2628c331b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748e35d9a1534920860b2234d45f6724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:36.153002 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cbdd8-ea78-4b29-80c8-4f2628c331b0 service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:36.153589 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cbdd8-ea78-4b29-80c8-4f2628c331b0 service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:36.153943 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cbdd8-ea78-4b29-80c8-4f2628c331b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:36.166656 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387cbdd8-ea78-4b29-80c8-4f2628c331b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:36.168714 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387cbdd8-ea78-4b29-80c8-4f2628c331b0 service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:36.181899 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1431/2838] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 1 16:43:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 16:43:36.223822 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-85e85b63-3ab6-4b74-a752-4cbab891967e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90d607c08482498e91747466fca45ca8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:36.245688 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-85e85b63-3ab6-4b74-a752-4cbab891967e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90d607c08482498e91747466fca45ca8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:36.246937 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-85e85b63-3ab6-4b74-a752-4cbab891967e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90d607c08482498e91747466fca45ca8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:36.247949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-85e85b63-3ab6-4b74-a752-4cbab891967e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90d607c08482498e91747466fca45ca8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:36.263052 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-85e85b63-3ab6-4b74-a752-4cbab891967e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90d607c08482498e91747466fca45ca8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:36.284738 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1408/2839] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:35 2022] DELETE /identity/v3/users/90d607c08482498e91747466fca45ca8 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:36.291660 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5f619-f58b-4296-8b71-5e12ec110a09 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:36.292096 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5f619-f58b-4296-8b71-5e12ec110a09 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:36.292482 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5f619-f58b-4296-8b71-5e12ec110a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:36.329388 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a0d5f619-f58b-4296-8b71-5e12ec110a09 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:36.332107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a0d5f619-f58b-4296-8b71-5e12ec110a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:36.431194 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1432/2840] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:36.446042 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e85b63-3ab6-4b74-a752-4cbab891967e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:36.447779 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-85e85b63-3ab6-4b74-a752-4cbab891967e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:36.561041 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e85b63-3ab6-4b74-a752-4cbab891967e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:36.576269 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c15d1-9bef-407b-84f9-6ec640937bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:36.576967 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c15d1-9bef-407b-84f9-6ec640937bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:36.577251 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c15d1-9bef-407b-84f9-6ec640937bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:36.577525 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c15d1-9bef-407b-84f9-6ec640937bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:36.594255 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c15d1-9bef-407b-84f9-6ec640937bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:36.598406 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c15d1-9bef-407b-84f9-6ec640937bc4 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:36.619415 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1409/2841] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:37.493506 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5f619-f58b-4296-8b71-5e12ec110a09 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:37.496683 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a0d5f619-f58b-4296-8b71-5e12ec110a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:37.511728 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5f619-f58b-4296-8b71-5e12ec110a09 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:37.518483 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674367a-6df3-43e5-827d-f6df14d4478c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:37.519601 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674367a-6df3-43e5-827d-f6df14d4478c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:37.519886 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674367a-6df3-43e5-827d-f6df14d4478c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:37.520191 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674367a-6df3-43e5-827d-f6df14d4478c admin admin] PATH_INFO: `/v3/projects/f752205ccf054dd4988bae80987565d8` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:37.521568 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674367a-6df3-43e5-827d-f6df14d4478c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f752205ccf054dd4988bae80987565d8)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:37.524039 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674367a-6df3-43e5-827d-f6df14d4478c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:37.629969 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2674367a-6df3-43e5-827d-f6df14d4478c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f752205ccf054dd4988bae80987565d8', 'request_id': 'req-2674367a-6df3-43e5-827d-f6df14d4478c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:37.642041 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2674367a-6df3-43e5-827d-f6df14d4478c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f752205ccf054dd4988bae80987565d8', 'request_id': 'req-2674367a-6df3-43e5-827d-f6df14d4478c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:37.646265 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:37.657470 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2674367a-6df3-43e5-827d-f6df14d4478c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f752205ccf054dd4988bae80987565d8', 'request_id': 'req-2674367a-6df3-43e5-827d-f6df14d4478c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:37.682363 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2674367a-6df3-43e5-827d-f6df14d4478c admin admin] The token cache is being invalidate because project f752205ccf054dd4988bae80987565d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:37.682886 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2674367a-6df3-43e5-827d-f6df14d4478c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:37.684005 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2674367a-6df3-43e5-827d-f6df14d4478c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:37.686758 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1433/2842] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:37 2022] DELETE /identity/v3/projects/f752205ccf054dd4988bae80987565d8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:37.693932 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c15d1-9bef-407b-84f9-6ec640937bc4 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:37.707617 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:37.719193 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c15d1-9bef-407b-84f9-6ec640937bc4 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:37.835932 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39718eaa-b7ff-418c-9a0c-438588abe449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:37.836998 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39718eaa-b7ff-418c-9a0c-438588abe449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:37.837471 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39718eaa-b7ff-418c-9a0c-438588abe449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:37.837893 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39718eaa-b7ff-418c-9a0c-438588abe449 admin admin] PATH_INFO: `/v3/users/b07f27e950ef4cd991cf0e94d0bd4a4d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:37.839758 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39718eaa-b7ff-418c-9a0c-438588abe449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b07f27e950ef4cd991cf0e94d0bd4a4d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:37.843636 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39718eaa-b7ff-418c-9a0c-438588abe449 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:37.943334 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-39718eaa-b7ff-418c-9a0c-438588abe449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b07f27e950ef4cd991cf0e94d0bd4a4d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:37.971126 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-39718eaa-b7ff-418c-9a0c-438588abe449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b07f27e950ef4cd991cf0e94d0bd4a4d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:37.972593 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-39718eaa-b7ff-418c-9a0c-438588abe449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b07f27e950ef4cd991cf0e94d0bd4a4d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:37.974019 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-39718eaa-b7ff-418c-9a0c-438588abe449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b07f27e950ef4cd991cf0e94d0bd4a4d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:37.987010 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-39718eaa-b7ff-418c-9a0c-438588abe449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b07f27e950ef4cd991cf0e94d0bd4a4d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:38.011577 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1410/2843] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:37 2022] DELETE /identity/v3/users/b07f27e950ef4cd991cf0e94d0bd4a4d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:38.441475 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674367a-6df3-43e5-827d-f6df14d4478c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:38.443720 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2674367a-6df3-43e5-827d-f6df14d4478c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:38.464683 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674367a-6df3-43e5-827d-f6df14d4478c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:38.554695 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75c0c5-42c0-4db2-9478-251f0681fc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:38.555947 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75c0c5-42c0-4db2-9478-251f0681fc2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:38.556282 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75c0c5-42c0-4db2-9478-251f0681fc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:38.556614 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75c0c5-42c0-4db2-9478-251f0681fc2b admin admin] PATH_INFO: `/v3/projects/6a5bc95c3dac45d48fa2a925c66436ce` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:38.563047 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75c0c5-42c0-4db2-9478-251f0681fc2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a5bc95c3dac45d48fa2a925c66436ce)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:38.565982 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75c0c5-42c0-4db2-9478-251f0681fc2b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:38.641499 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7f75c0c5-42c0-4db2-9478-251f0681fc2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a5bc95c3dac45d48fa2a925c66436ce', 'request_id': 'req-7f75c0c5-42c0-4db2-9478-251f0681fc2b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:38.649905 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7f75c0c5-42c0-4db2-9478-251f0681fc2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a5bc95c3dac45d48fa2a925c66436ce', 'request_id': 'req-7f75c0c5-42c0-4db2-9478-251f0681fc2b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:38.659869 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7f75c0c5-42c0-4db2-9478-251f0681fc2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a5bc95c3dac45d48fa2a925c66436ce', 'request_id': 'req-7f75c0c5-42c0-4db2-9478-251f0681fc2b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:38.676004 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7f75c0c5-42c0-4db2-9478-251f0681fc2b admin admin] The token cache is being invalidate because project 6a5bc95c3dac45d48fa2a925c66436ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:38.676494 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7f75c0c5-42c0-4db2-9478-251f0681fc2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:38.677472 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7f75c0c5-42c0-4db2-9478-251f0681fc2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:38.679770 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1434/2844] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:38 2022] DELETE /identity/v3/projects/6a5bc95c3dac45d48fa2a925c66436ce => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:38.686884 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9408afe-4cd5-4b38-8bbb-be45f4ff271e None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:38.687460 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9408afe-4cd5-4b38-8bbb-be45f4ff271e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:38.687828 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9408afe-4cd5-4b38-8bbb-be45f4ff271e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:38.711715 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c9408afe-4cd5-4b38-8bbb-be45f4ff271e None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:38.713143 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c9408afe-4cd5-4b38-8bbb-be45f4ff271e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:38.791313 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1411/2845] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:38.799669 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954cffb-2e8a-4991-9406-ce70b8ff7795 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:38.800042 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954cffb-2e8a-4991-9406-ce70b8ff7795 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:38.800381 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954cffb-2e8a-4991-9406-ce70b8ff7795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:38.824956 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e954cffb-2e8a-4991-9406-ce70b8ff7795 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:38.826192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e954cffb-2e8a-4991-9406-ce70b8ff7795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:38.835602 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1435/2846] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:38.840203 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9408afe-4cd5-4b38-8bbb-be45f4ff271e None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:38.851306 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9408afe-4cd5-4b38-8bbb-be45f4ff271e None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:38.856276 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f61d8-7f85-48da-8f38-3649a5555d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:38.857090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f61d8-7f85-48da-8f38-3649a5555d02 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:38.857425 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f61d8-7f85-48da-8f38-3649a5555d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:38.857916 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f61d8-7f85-48da-8f38-3649a5555d02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:38.858650 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f61d8-7f85-48da-8f38-3649a5555d02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:38.858990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f61d8-7f85-48da-8f38-3649a5555d02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:38.861101 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f61d8-7f85-48da-8f38-3649a5555d02 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:38.880980 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1412/2847] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:43:38.886048 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954cffb-2e8a-4991-9406-ce70b8ff7795 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:38.897321 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954cffb-2e8a-4991-9406-ce70b8ff7795 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:38.903164 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2271e5-1ac0-450b-98c9-0afc0299569d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:38.903940 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2271e5-1ac0-450b-98c9-0afc0299569d admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:38.904262 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2271e5-1ac0-450b-98c9-0afc0299569d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:38.904576 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2271e5-1ac0-450b-98c9-0afc0299569d admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:38.905329 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2271e5-1ac0-450b-98c9-0afc0299569d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:38.907895 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2271e5-1ac0-450b-98c9-0afc0299569d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:38.950715 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1436/2848] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:38 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:38.956499 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f61d8-7f85-48da-8f38-3649a5555d02 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:38.968000 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f61d8-7f85-48da-8f38-3649a5555d02 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:38.974153 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:39.063246 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2271e5-1ac0-450b-98c9-0afc0299569d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:39.066874 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cc2271e5-1ac0-450b-98c9-0afc0299569d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:39.070785 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532b13a-7360-4b28-944a-5e126f1aef1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:39.071927 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532b13a-7360-4b28-944a-5e126f1aef1c admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:39.072426 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532b13a-7360-4b28-944a-5e126f1aef1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:39.072927 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532b13a-7360-4b28-944a-5e126f1aef1c admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:39.074225 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d532b13a-7360-4b28-944a-5e126f1aef1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:39.077632 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d532b13a-7360-4b28-944a-5e126f1aef1c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:39.091612 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2271e5-1ac0-450b-98c9-0afc0299569d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:39.097943 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c5161-d2ce-4050-b919-06b83c79be09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:39.098596 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c5161-d2ce-4050-b919-06b83c79be09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:39.099182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c5161-d2ce-4050-b919-06b83c79be09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:39.099464 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c5161-d2ce-4050-b919-06b83c79be09 admin admin] PATH_INFO: `/v3/users/cd31849c210e4dc6b9d8e33fdcaba55b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:39.101140 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c5161-d2ce-4050-b919-06b83c79be09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd31849c210e4dc6b9d8e33fdcaba55b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:39.104031 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c5161-d2ce-4050-b919-06b83c79be09 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:39.117555 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1413/2849] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:38 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:39.122252 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532b13a-7360-4b28-944a-5e126f1aef1c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:39.139372 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532b13a-7360-4b28-944a-5e126f1aef1c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:39.148512 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc40dc5-2bea-44df-babb-4a8610361c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:39.149645 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc40dc5-2bea-44df-babb-4a8610361c4e admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:39.150009 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc40dc5-2bea-44df-babb-4a8610361c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:39.157163 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc40dc5-2bea-44df-babb-4a8610361c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:39.158681 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc40dc5-2bea-44df-babb-4a8610361c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:39.162826 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc40dc5-2bea-44df-babb-4a8610361c4e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:39.177288 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1414/2850] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:39.180932 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:39.182204 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc40dc5-2bea-44df-babb-4a8610361c4e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:39.190223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-861c5161-d2ce-4050-b919-06b83c79be09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd31849c210e4dc6b9d8e33fdcaba55b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:39.197460 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc40dc5-2bea-44df-babb-4a8610361c4e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:39.205887 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d8e19-cb69-4814-8825-0fd53718a6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:39.207365 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d8e19-cb69-4814-8825-0fd53718a6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:39.207836 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d8e19-cb69-4814-8825-0fd53718a6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:39.208310 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d8e19-cb69-4814-8825-0fd53718a6d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:39.209470 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-861c5161-d2ce-4050-b919-06b83c79be09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd31849c210e4dc6b9d8e33fdcaba55b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:39.209606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d8e19-cb69-4814-8825-0fd53718a6d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:39.210309 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-861c5161-d2ce-4050-b919-06b83c79be09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd31849c210e4dc6b9d8e33fdcaba55b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:39.212486 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d8e19-cb69-4814-8825-0fd53718a6d7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:39.219562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-861c5161-d2ce-4050-b919-06b83c79be09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd31849c210e4dc6b9d8e33fdcaba55b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:39.231232 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-861c5161-d2ce-4050-b919-06b83c79be09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd31849c210e4dc6b9d8e33fdcaba55b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:39.232817 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1415/2851] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:39.237793 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d8e19-cb69-4814-8825-0fd53718a6d7 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:39.241119 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-761d8e19-cb69-4814-8825-0fd53718a6d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:39.243237 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1437/2852] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:39 2022] DELETE /identity/v3/users/cd31849c210e4dc6b9d8e33fdcaba55b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:39.249505 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebf1ac-ce9e-4da4-a20c-0fcabb8aedc1 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:39.250006 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebf1ac-ce9e-4da4-a20c-0fcabb8aedc1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:39.250500 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebf1ac-ce9e-4da4-a20c-0fcabb8aedc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:39.259789 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d8e19-cb69-4814-8825-0fd53718a6d7 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:39.277756 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8eebf1ac-ce9e-4da4-a20c-0fcabb8aedc1 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:39.279006 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8eebf1ac-ce9e-4da4-a20c-0fcabb8aedc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:39.355918 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1438/2853] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:39.358754 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851688c6-c688-41ea-9b46-9d28f200150a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:39.359554 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851688c6-c688-41ea-9b46-9d28f200150a admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:39.359895 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851688c6-c688-41ea-9b46-9d28f200150a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:39.360287 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851688c6-c688-41ea-9b46-9d28f200150a admin admin] PATH_INFO: `/v3/projects/d5d1684105ac43f7bd8a37919de871c9/users/4685d71a933747d99763f5d1ef3ff087/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:39.380189 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851688c6-c688-41ea-9b46-9d28f200150a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d1684105ac43f7bd8a37919de871c9, user_id=4685d71a933747d99763f5d1ef3ff087, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:39.383208 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851688c6-c688-41ea-9b46-9d28f200150a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:39.383463 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebf1ac-ce9e-4da4-a20c-0fcabb8aedc1 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:39.386307 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8eebf1ac-ce9e-4da4-a20c-0fcabb8aedc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:39.409631 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1416/2854] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:39 2022] PUT /identity/v3/projects/d5d1684105ac43f7bd8a37919de871c9/users/4685d71a933747d99763f5d1ef3ff087/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:39.422566 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc22e5d-a05e-448e-ba02-f63eacdd1f7a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:39.423091 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc22e5d-a05e-448e-ba02-f63eacdd1f7a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:39.423612 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc22e5d-a05e-448e-ba02-f63eacdd1f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:39.480302 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebf1ac-ce9e-4da4-a20c-0fcabb8aedc1 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:39.481065 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5fc22e5d-a05e-448e-ba02-f63eacdd1f7a None None] MFA Rules not processed for user `4685d71a933747d99763f5d1ef3ff087`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:39.482403 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5fc22e5d-a05e-448e-ba02-f63eacdd1f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:39.549828 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41492f5-5f81-465d-9132-f90e7653a145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:39.550886 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41492f5-5f81-465d-9132-f90e7653a145 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:39.551390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41492f5-5f81-465d-9132-f90e7653a145 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:39.551876 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41492f5-5f81-465d-9132-f90e7653a145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:39.562378 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:39.590925 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:39.595168 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1417/2855] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:39.615651 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc22e5d-a05e-448e-ba02-f63eacdd1f7a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:39.617947 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5fc22e5d-a05e-448e-ba02-f63eacdd1f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:39.631381 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41492f5-5f81-465d-9132-f90e7653a145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:39.633060 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41492f5-5f81-465d-9132-f90e7653a145 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:39.650539 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1439/2856] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:39.724058 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc22e5d-a05e-448e-ba02-f63eacdd1f7a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:39.732406 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb81eec-2913-4fc4-8ba1-17c3d61bd1a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:39.733668 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb81eec-2913-4fc4-8ba1-17c3d61bd1a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:39.734035 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb81eec-2913-4fc4-8ba1-17c3d61bd1a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:39.734727 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb81eec-2913-4fc4-8ba1-17c3d61bd1a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:39.751514 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb81eec-2913-4fc4-8ba1-17c3d61bd1a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:39.753446 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb81eec-2913-4fc4-8ba1-17c3d61bd1a6 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:39.766867 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1418/2857] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:43:39.798930 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41492f5-5f81-465d-9132-f90e7653a145 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:39.817486 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41492f5-5f81-465d-9132-f90e7653a145 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:39.825952 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b419bd-8e41-470d-a33d-4824215e0f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:39.826924 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b419bd-8e41-470d-a33d-4824215e0f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:39.827348 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b419bd-8e41-470d-a33d-4824215e0f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:39.827689 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b419bd-8e41-470d-a33d-4824215e0f40 admin admin] PATH_INFO: `/v3/users/4685d71a933747d99763f5d1ef3ff087` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:39.829682 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b419bd-8e41-470d-a33d-4824215e0f40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4685d71a933747d99763f5d1ef3ff087)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:39.833585 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b419bd-8e41-470d-a33d-4824215e0f40 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:39.942897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb81eec-2913-4fc4-8ba1-17c3d61bd1a6 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:39.952551 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3bb81eec-2913-4fc4-8ba1-17c3d61bd1a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:39.994452 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb81eec-2913-4fc4-8ba1-17c3d61bd1a6 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:40.000515 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790004c3-8773-4905-8a71-fb45375273f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:40.001474 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790004c3-8773-4905-8a71-fb45375273f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:40.001981 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790004c3-8773-4905-8a71-fb45375273f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:40.002561 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790004c3-8773-4905-8a71-fb45375273f6 admin admin] PATH_INFO: `/v3/projects/91ef557bb8fa4bf68686d6a348dee382` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:40.005025 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790004c3-8773-4905-8a71-fb45375273f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91ef557bb8fa4bf68686d6a348dee382)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:40.007504 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790004c3-8773-4905-8a71-fb45375273f6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:40.101310 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-13b419bd-8e41-470d-a33d-4824215e0f40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4685d71a933747d99763f5d1ef3ff087'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:40.103567 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-790004c3-8773-4905-8a71-fb45375273f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91ef557bb8fa4bf68686d6a348dee382', 'request_id': 'req-790004c3-8773-4905-8a71-fb45375273f6'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:40.115418 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-790004c3-8773-4905-8a71-fb45375273f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91ef557bb8fa4bf68686d6a348dee382', 'request_id': 'req-790004c3-8773-4905-8a71-fb45375273f6'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:40.124306 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-13b419bd-8e41-470d-a33d-4824215e0f40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4685d71a933747d99763f5d1ef3ff087'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:40.126357 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-13b419bd-8e41-470d-a33d-4824215e0f40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4685d71a933747d99763f5d1ef3ff087'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:40.131699 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-790004c3-8773-4905-8a71-fb45375273f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91ef557bb8fa4bf68686d6a348dee382', 'request_id': 'req-790004c3-8773-4905-8a71-fb45375273f6'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:40.147353 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-13b419bd-8e41-470d-a33d-4824215e0f40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4685d71a933747d99763f5d1ef3ff087'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:40.156205 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-790004c3-8773-4905-8a71-fb45375273f6 admin admin] The token cache is being invalidate because project 91ef557bb8fa4bf68686d6a348dee382 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:40.156786 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-790004c3-8773-4905-8a71-fb45375273f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:40.157940 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-790004c3-8773-4905-8a71-fb45375273f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:40.160671 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1419/2858] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:39 2022] DELETE /identity/v3/projects/91ef557bb8fa4bf68686d6a348dee382 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:40.166575 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-13b419bd-8e41-470d-a33d-4824215e0f40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4685d71a933747d99763f5d1ef3ff087'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:40.176019 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1440/2859] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:39 2022] DELETE /identity/v3/users/4685d71a933747d99763f5d1ef3ff087 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:40.185650 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3191769-dd4e-48a2-980e-27f22b072cbf None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:40.186194 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3191769-dd4e-48a2-980e-27f22b072cbf None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:40.186533 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3191769-dd4e-48a2-980e-27f22b072cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:40.210376 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c3191769-dd4e-48a2-980e-27f22b072cbf None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:40.211744 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c3191769-dd4e-48a2-980e-27f22b072cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:40.334309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1420/2860] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:40.342174 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b419bd-8e41-470d-a33d-4824215e0f40 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:40.344045 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-13b419bd-8e41-470d-a33d-4824215e0f40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:40.437308 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b419bd-8e41-470d-a33d-4824215e0f40 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:40.444513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52a351-369d-47a4-9b93-1558964cda36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:40.444513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52a351-369d-47a4-9b93-1558964cda36 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:40.444513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52a351-369d-47a4-9b93-1558964cda36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:40.444513 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52a351-369d-47a4-9b93-1558964cda36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:40.465030 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52a351-369d-47a4-9b93-1558964cda36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:40.468013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52a351-369d-47a4-9b93-1558964cda36 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:40.482093 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1441/2861] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:43:40.882607 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3191769-dd4e-48a2-980e-27f22b072cbf None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:40.884780 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c3191769-dd4e-48a2-980e-27f22b072cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:40.907396 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3191769-dd4e-48a2-980e-27f22b072cbf None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:40.917219 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f937e-84b4-4ba7-8a72-4bf74821ec27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:40.919550 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f937e-84b4-4ba7-8a72-4bf74821ec27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:40.920235 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f937e-84b4-4ba7-8a72-4bf74821ec27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:40.920988 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f937e-84b4-4ba7-8a72-4bf74821ec27 admin admin] PATH_INFO: `/v3/projects/d5d1684105ac43f7bd8a37919de871c9` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:40.923525 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f937e-84b4-4ba7-8a72-4bf74821ec27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5d1684105ac43f7bd8a37919de871c9)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:40.927433 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f937e-84b4-4ba7-8a72-4bf74821ec27 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:40.949466 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:41.014071 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8e2f937e-84b4-4ba7-8a72-4bf74821ec27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d1684105ac43f7bd8a37919de871c9', 'request_id': 'req-8e2f937e-84b4-4ba7-8a72-4bf74821ec27'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:41.022359 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8e2f937e-84b4-4ba7-8a72-4bf74821ec27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d1684105ac43f7bd8a37919de871c9', 'request_id': 'req-8e2f937e-84b4-4ba7-8a72-4bf74821ec27'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:41.029949 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8e2f937e-84b4-4ba7-8a72-4bf74821ec27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d1684105ac43f7bd8a37919de871c9', 'request_id': 'req-8e2f937e-84b4-4ba7-8a72-4bf74821ec27'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:41.046852 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8e2f937e-84b4-4ba7-8a72-4bf74821ec27 admin admin] The token cache is being invalidate because project d5d1684105ac43f7bd8a37919de871c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:41.047281 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8e2f937e-84b4-4ba7-8a72-4bf74821ec27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:41.048150 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8e2f937e-84b4-4ba7-8a72-4bf74821ec27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:41.050894 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1421/2862] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:40 2022] DELETE /identity/v3/projects/d5d1684105ac43f7bd8a37919de871c9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:41.058311 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec4c80-0a20-40bc-a548-d329969ceb58 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:41.059068 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec4c80-0a20-40bc-a548-d329969ceb58 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:41.059396 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec4c80-0a20-40bc-a548-d329969ceb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:41.091797 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-51ec4c80-0a20-40bc-a548-d329969ceb58 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:41.093219 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-51ec4c80-0a20-40bc-a548-d329969ceb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:41.138399 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:41.184143 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1442/2863] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:41.194279 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041081f-701c-4972-802b-a3352c76d283 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:41.194829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041081f-701c-4972-802b-a3352c76d283 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:41.195146 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041081f-701c-4972-802b-a3352c76d283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:41.220219 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5041081f-701c-4972-802b-a3352c76d283 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:41.223247 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5041081f-701c-4972-802b-a3352c76d283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:41.238888 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1422/2864] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:41.243375 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec4c80-0a20-40bc-a548-d329969ceb58 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:41.254097 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec4c80-0a20-40bc-a548-d329969ceb58 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:41.258909 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79a50b-6b14-41dd-bb7d-60dcce0bc7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:41.259536 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79a50b-6b14-41dd-bb7d-60dcce0bc7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:41.259983 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79a50b-6b14-41dd-bb7d-60dcce0bc7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:41.260262 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79a50b-6b14-41dd-bb7d-60dcce0bc7c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:41.260971 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79a50b-6b14-41dd-bb7d-60dcce0bc7c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:41.261299 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79a50b-6b14-41dd-bb7d-60dcce0bc7c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:41.263024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79a50b-6b14-41dd-bb7d-60dcce0bc7c6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:41.277223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1443/2865] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:43:41.282051 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041081f-701c-4972-802b-a3352c76d283 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:41.293761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041081f-701c-4972-802b-a3352c76d283 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:41.298900 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258670f9-984d-4c16-8ed6-98277f1b3bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:41.299523 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258670f9-984d-4c16-8ed6-98277f1b3bca admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:41.300378 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258670f9-984d-4c16-8ed6-98277f1b3bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:41.300678 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258670f9-984d-4c16-8ed6-98277f1b3bca admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:41.301344 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258670f9-984d-4c16-8ed6-98277f1b3bca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:41.303381 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258670f9-984d-4c16-8ed6-98277f1b3bca admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:41.339464 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1423/2866] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:41 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:41.344214 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79a50b-6b14-41dd-bb7d-60dcce0bc7c6 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:41.355560 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79a50b-6b14-41dd-bb7d-60dcce0bc7c6 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:41.432284 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1757829-cc6c-4987-9efd-54f22c66ba88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:41.433108 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1757829-cc6c-4987-9efd-54f22c66ba88 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:41.433486 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1757829-cc6c-4987-9efd-54f22c66ba88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:41.433868 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1757829-cc6c-4987-9efd-54f22c66ba88 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:41.434640 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1757829-cc6c-4987-9efd-54f22c66ba88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:41.437060 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1757829-cc6c-4987-9efd-54f22c66ba88 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:41.461769 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1444/2867] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:41 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:41.466691 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258670f9-984d-4c16-8ed6-98277f1b3bca admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:41.486078 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258670f9-984d-4c16-8ed6-98277f1b3bca admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:41.492078 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73152b5-7b96-47b4-86de-cfd05e45c633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:41.492837 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73152b5-7b96-47b4-86de-cfd05e45c633 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:41.493169 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73152b5-7b96-47b4-86de-cfd05e45c633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:41.493485 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73152b5-7b96-47b4-86de-cfd05e45c633 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:41.494250 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73152b5-7b96-47b4-86de-cfd05e45c633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:41.496427 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73152b5-7b96-47b4-86de-cfd05e45c633 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:41.509833 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1424/2868] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:41.514155 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1757829-cc6c-4987-9efd-54f22c66ba88 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:41.528166 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1757829-cc6c-4987-9efd-54f22c66ba88 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:41.536561 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52503be1-80c4-4302-b145-9feca0dc35a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:41.537685 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52503be1-80c4-4302-b145-9feca0dc35a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:41.538110 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52503be1-80c4-4302-b145-9feca0dc35a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:41.538448 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52503be1-80c4-4302-b145-9feca0dc35a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:41.539278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52503be1-80c4-4302-b145-9feca0dc35a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:41.541603 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52503be1-80c4-4302-b145-9feca0dc35a5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:41.570971 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1445/2869] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:41.577610 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73152b5-7b96-47b4-86de-cfd05e45c633 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:41.596646 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73152b5-7b96-47b4-86de-cfd05e45c633 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:41.605250 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c25d69-0c2e-4305-b495-3f5d848f24e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:41.606408 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c25d69-0c2e-4305-b495-3f5d848f24e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:41.606901 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c25d69-0c2e-4305-b495-3f5d848f24e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:41.607399 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c25d69-0c2e-4305-b495-3f5d848f24e7 admin admin] PATH_INFO: `/v3/projects/52b5fba178db423ab17bbc45a9e03080/users/4780c5ca96424a30ab6493d60f0d493d/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:41.632958 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c25d69-0c2e-4305-b495-3f5d848f24e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b5fba178db423ab17bbc45a9e03080, user_id=4780c5ca96424a30ab6493d60f0d493d, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:41.638700 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c25d69-0c2e-4305-b495-3f5d848f24e7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:41.658172 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1425/2870] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:41 2022] PUT /identity/v3/projects/52b5fba178db423ab17bbc45a9e03080/users/4780c5ca96424a30ab6493d60f0d493d/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:41.670908 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00e8a6-8f61-4e5c-9a1e-6234f740a898 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:41.671348 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00e8a6-8f61-4e5c-9a1e-6234f740a898 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:41.671672 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00e8a6-8f61-4e5c-9a1e-6234f740a898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:41.708035 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-fc00e8a6-8f61-4e5c-9a1e-6234f740a898 None None] MFA Rules not processed for user `4780c5ca96424a30ab6493d60f0d493d`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:41.709581 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fc00e8a6-8f61-4e5c-9a1e-6234f740a898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:41.829497 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1446/2871] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:41.835416 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c25d69-0c2e-4305-b495-3f5d848f24e7 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:41.935228 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c25d69-0c2e-4305-b495-3f5d848f24e7 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:41.944141 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144cc13-f706-4220-81a3-e04ddcec1baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:41.945606 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144cc13-f706-4220-81a3-e04ddcec1baa admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:41.946101 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144cc13-f706-4220-81a3-e04ddcec1baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:41.946592 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144cc13-f706-4220-81a3-e04ddcec1baa admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:41.947818 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144cc13-f706-4220-81a3-e04ddcec1baa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:41.951651 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144cc13-f706-4220-81a3-e04ddcec1baa admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:41.999067 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1426/2872] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:41 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:42.004305 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00e8a6-8f61-4e5c-9a1e-6234f740a898 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:42.015817 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00e8a6-8f61-4e5c-9a1e-6234f740a898 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:42.062003 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:42.098848 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702d8b8-b37e-4622-ad3e-76c4779e23ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:42.099904 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702d8b8-b37e-4622-ad3e-76c4779e23ac admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:42.100378 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702d8b8-b37e-4622-ad3e-76c4779e23ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:42.100866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702d8b8-b37e-4622-ad3e-76c4779e23ac admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:42.101782 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702d8b8-b37e-4622-ad3e-76c4779e23ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:42.104192 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702d8b8-b37e-4622-ad3e-76c4779e23ac admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:42.132939 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1447/2873] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:42 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:42.138460 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144cc13-f706-4220-81a3-e04ddcec1baa admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:42.150054 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144cc13-f706-4220-81a3-e04ddcec1baa admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:42.155454 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d57ce6-1d9f-42d8-b946-481ba19010d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:42.156123 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d57ce6-1d9f-42d8-b946-481ba19010d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:42.156405 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d57ce6-1d9f-42d8-b946-481ba19010d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:42.156715 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d57ce6-1d9f-42d8-b946-481ba19010d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:42.157392 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d57ce6-1d9f-42d8-b946-481ba19010d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:42.159129 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d57ce6-1d9f-42d8-b946-481ba19010d5 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:42.176305 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1427/2874] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:42.182437 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702d8b8-b37e-4622-ad3e-76c4779e23ac admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:42.197255 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702d8b8-b37e-4622-ad3e-76c4779e23ac admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:42.203013 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ccbde-b95f-4340-8f03-08c1d5a36bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:42.203699 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ccbde-b95f-4340-8f03-08c1d5a36bde admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:42.204020 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ccbde-b95f-4340-8f03-08c1d5a36bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:42.204332 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ccbde-b95f-4340-8f03-08c1d5a36bde admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:42.205134 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ccbde-b95f-4340-8f03-08c1d5a36bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:42.207112 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ccbde-b95f-4340-8f03-08c1d5a36bde admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:42.225525 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1448/2875] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:42.230516 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d57ce6-1d9f-42d8-b946-481ba19010d5 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:42.242319 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d57ce6-1d9f-42d8-b946-481ba19010d5 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:42.247612 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e170442-fec4-410f-8c02-49a2e002029a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:42.248308 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e170442-fec4-410f-8c02-49a2e002029a admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:42.248584 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e170442-fec4-410f-8c02-49a2e002029a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:42.248902 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e170442-fec4-410f-8c02-49a2e002029a admin admin] PATH_INFO: `/v3/projects/2847c3a127c54f6dbe188349e1713edf/users/1aa2dbe2fa4b4897887fae22803ee194/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:42.253957 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:42.271895 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e170442-fec4-410f-8c02-49a2e002029a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2847c3a127c54f6dbe188349e1713edf, user_id=1aa2dbe2fa4b4897887fae22803ee194, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:42.275395 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e170442-fec4-410f-8c02-49a2e002029a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:42.300306 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1428/2876] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:42 2022] PUT /identity/v3/projects/2847c3a127c54f6dbe188349e1713edf/users/1aa2dbe2fa4b4897887fae22803ee194/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:42.318862 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81c5df-15b6-406b-b96b-856780a15a57 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:42.319344 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81c5df-15b6-406b-b96b-856780a15a57 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:42.319696 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81c5df-15b6-406b-b96b-856780a15a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:42.356250 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3d81c5df-15b6-406b-b96b-856780a15a57 None None] MFA Rules not processed for user `1aa2dbe2fa4b4897887fae22803ee194`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:42.358501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3d81c5df-15b6-406b-b96b-856780a15a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:42.445931 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1449/2877] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:42.451926 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e170442-fec4-410f-8c02-49a2e002029a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:42.556686 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e170442-fec4-410f-8c02-49a2e002029a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:42.561904 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e8a99-e5f2-4d48-830c-0dae383b5659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:42.562574 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e8a99-e5f2-4d48-830c-0dae383b5659 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:42.562850 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e8a99-e5f2-4d48-830c-0dae383b5659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:42.563121 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e8a99-e5f2-4d48-830c-0dae383b5659 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:42.563789 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e8a99-e5f2-4d48-830c-0dae383b5659 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:42.566390 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e8a99-e5f2-4d48-830c-0dae383b5659 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:42.599603 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1429/2878] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:42 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:42.605754 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81c5df-15b6-406b-b96b-856780a15a57 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:42.629349 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81c5df-15b6-406b-b96b-856780a15a57 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:42.724648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ebd5a-3000-4c20-b748-1077a1d3b7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:42.725261 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ebd5a-3000-4c20-b748-1077a1d3b7e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:42.725537 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ebd5a-3000-4c20-b748-1077a1d3b7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:42.725807 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ebd5a-3000-4c20-b748-1077a1d3b7e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:42.726451 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ebd5a-3000-4c20-b748-1077a1d3b7e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:42.728413 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ebd5a-3000-4c20-b748-1077a1d3b7e4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:42.752613 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1450/2879] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:42 2022] POST /identity/v3/users => generated 299 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:42.757285 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e8a99-e5f2-4d48-830c-0dae383b5659 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:42.770435 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e8a99-e5f2-4d48-830c-0dae383b5659 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:42.777579 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e598989-1329-474e-8613-0eb9905bcc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:42.778436 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e598989-1329-474e-8613-0eb9905bcc6f admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:42.778982 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e598989-1329-474e-8613-0eb9905bcc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:42.779570 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e598989-1329-474e-8613-0eb9905bcc6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:42.780417 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e598989-1329-474e-8613-0eb9905bcc6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:42.782619 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e598989-1329-474e-8613-0eb9905bcc6f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:42.797114 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1430/2880] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:42.801935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ebd5a-3000-4c20-b748-1077a1d3b7e4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:42.819944 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ebd5a-3000-4c20-b748-1077a1d3b7e4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:42.828191 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177534d1-b9fd-43b9-ae36-a257891d6fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:42.829385 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177534d1-b9fd-43b9-ae36-a257891d6fea admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:42.829885 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177534d1-b9fd-43b9-ae36-a257891d6fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:42.830382 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177534d1-b9fd-43b9-ae36-a257891d6fea admin admin] PATH_INFO: `/v3/projects/b69e692a0b7d433b82afd278e7f8e407/users/d64641912b7b41c9806816fc309d5329/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:42.860399 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177534d1-b9fd-43b9-ae36-a257891d6fea admin admin] RBAC: Authorizing `identity:create_grant(project_id=b69e692a0b7d433b82afd278e7f8e407, user_id=d64641912b7b41c9806816fc309d5329, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:42.866059 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177534d1-b9fd-43b9-ae36-a257891d6fea admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:42.887851 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1451/2881] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:42 2022] PUT /identity/v3/projects/b69e692a0b7d433b82afd278e7f8e407/users/d64641912b7b41c9806816fc309d5329/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:42.892490 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e598989-1329-474e-8613-0eb9905bcc6f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:42.907515 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e598989-1329-474e-8613-0eb9905bcc6f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:42.996263 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb129a-04a5-4a9b-9e3e-fa2c02fa2063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:42.997619 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb129a-04a5-4a9b-9e3e-fa2c02fa2063 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:42.998110 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb129a-04a5-4a9b-9e3e-fa2c02fa2063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:42.998601 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb129a-04a5-4a9b-9e3e-fa2c02fa2063 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:42.999841 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb129a-04a5-4a9b-9e3e-fa2c02fa2063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:43.003116 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb129a-04a5-4a9b-9e3e-fa2c02fa2063 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:43.024836 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1431/2882] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:43.029716 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177534d1-b9fd-43b9-ae36-a257891d6fea admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:43.047285 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177534d1-b9fd-43b9-ae36-a257891d6fea admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:43.056012 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e04896-932b-4252-af47-6bbe4041ba95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:43.057508 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e04896-932b-4252-af47-6bbe4041ba95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:43.058008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e04896-932b-4252-af47-6bbe4041ba95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:43.059298 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e04896-932b-4252-af47-6bbe4041ba95 admin admin] PATH_INFO: `/v3/projects/b69e692a0b7d433b82afd278e7f8e407/users/d64641912b7b41c9806816fc309d5329/roles/a8896546a02c42489ef73c7ad7c43542` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:43.062313 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e04896-932b-4252-af47-6bbe4041ba95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b69e692a0b7d433b82afd278e7f8e407, user_id=d64641912b7b41c9806816fc309d5329, role_id=a8896546a02c42489ef73c7ad7c43542)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:43.068580 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e04896-932b-4252-af47-6bbe4041ba95 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:43.074275 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:43.088426 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1452/2883] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:43 2022] PUT /identity/v3/projects/b69e692a0b7d433b82afd278e7f8e407/users/d64641912b7b41c9806816fc309d5329/roles/a8896546a02c42489ef73c7ad7c43542 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:43.107376 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e971109-1ed0-4845-a148-89bb85b5448c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:43.107742 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e971109-1ed0-4845-a148-89bb85b5448c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:43.108228 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e971109-1ed0-4845-a148-89bb85b5448c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:43.148077 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8e971109-1ed0-4845-a148-89bb85b5448c None None] MFA Rules not processed for user `d64641912b7b41c9806816fc309d5329`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:43.149596 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8e971109-1ed0-4845-a148-89bb85b5448c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:43.217759 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:43.248292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1432/2884] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:43.264443 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e04896-932b-4252-af47-6bbe4041ba95 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:43.266886 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f5e04896-932b-4252-af47-6bbe4041ba95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:43.363327 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e04896-932b-4252-af47-6bbe4041ba95 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:43.369745 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26336d11-a8e0-4313-912b-43269ac204df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:43.370792 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26336d11-a8e0-4313-912b-43269ac204df service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:43.371198 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26336d11-a8e0-4313-912b-43269ac204df service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:43.371592 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26336d11-a8e0-4313-912b-43269ac204df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:43.478562 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26336d11-a8e0-4313-912b-43269ac204df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:43.481372 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26336d11-a8e0-4313-912b-43269ac204df service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:43.500549 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1453/2885] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:45.208557 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e971109-1ed0-4845-a148-89bb85b5448c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:45.219459 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e971109-1ed0-4845-a148-89bb85b5448c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:45.223973 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33144b7-12e7-40e0-b108-09bc975baa78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:45.224690 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33144b7-12e7-40e0-b108-09bc975baa78 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:45.224973 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33144b7-12e7-40e0-b108-09bc975baa78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:45.225241 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33144b7-12e7-40e0-b108-09bc975baa78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:45.301661 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33144b7-12e7-40e0-b108-09bc975baa78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:45.303153 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33144b7-12e7-40e0-b108-09bc975baa78 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:45.314204 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1433/2886] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:43:46.074663 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26336d11-a8e0-4313-912b-43269ac204df service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:46.076332 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-26336d11-a8e0-4313-912b-43269ac204df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:46.094997 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26336d11-a8e0-4313-912b-43269ac204df service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:46.100341 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77d2ab-7d4d-482e-ab19-b5889e46cb95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:46.101003 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77d2ab-7d4d-482e-ab19-b5889e46cb95 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:46.101278 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77d2ab-7d4d-482e-ab19-b5889e46cb95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:46.101711 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77d2ab-7d4d-482e-ab19-b5889e46cb95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:46.113587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77d2ab-7d4d-482e-ab19-b5889e46cb95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:46.115391 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77d2ab-7d4d-482e-ab19-b5889e46cb95 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:46.128796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1454/2887] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:43:50.404591 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33144b7-12e7-40e0-b108-09bc975baa78 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:50.511842 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33144b7-12e7-40e0-b108-09bc975baa78 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:50.518004 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e32fa4-c9e5-40a6-aca4-1f64de1f8f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:50.519133 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e32fa4-c9e5-40a6-aca4-1f64de1f8f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:50.519745 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e32fa4-c9e5-40a6-aca4-1f64de1f8f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:50.520308 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e32fa4-c9e5-40a6-aca4-1f64de1f8f0f admin admin] PATH_INFO: `/v3/users/4780c5ca96424a30ab6493d60f0d493d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:50.522391 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e32fa4-c9e5-40a6-aca4-1f64de1f8f0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4780c5ca96424a30ab6493d60f0d493d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:50.526090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e32fa4-c9e5-40a6-aca4-1f64de1f8f0f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:50.615346 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c7e32fa4-c9e5-40a6-aca4-1f64de1f8f0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4780c5ca96424a30ab6493d60f0d493d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:50.642376 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c7e32fa4-c9e5-40a6-aca4-1f64de1f8f0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4780c5ca96424a30ab6493d60f0d493d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:50.643933 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c7e32fa4-c9e5-40a6-aca4-1f64de1f8f0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4780c5ca96424a30ab6493d60f0d493d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:50.644612 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c7e32fa4-c9e5-40a6-aca4-1f64de1f8f0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4780c5ca96424a30ab6493d60f0d493d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:50.654097 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c7e32fa4-c9e5-40a6-aca4-1f64de1f8f0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4780c5ca96424a30ab6493d60f0d493d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:50.668985 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:50.675938 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1434/2888] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:50 2022] DELETE /identity/v3/users/4780c5ca96424a30ab6493d60f0d493d => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:50.683114 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c84b99-5a5f-4585-85a5-b5be3644b01b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:50.684407 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c84b99-5a5f-4585-85a5-b5be3644b01b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:50.685063 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c84b99-5a5f-4585-85a5-b5be3644b01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:50.721822 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-07c84b99-5a5f-4585-85a5-b5be3644b01b None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:50.723208 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-07c84b99-5a5f-4585-85a5-b5be3644b01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:50.792480 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1455/2889] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:50.803987 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e32fa4-c9e5-40a6-aca4-1f64de1f8f0f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:50.805553 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c7e32fa4-c9e5-40a6-aca4-1f64de1f8f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:50.873897 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e32fa4-c9e5-40a6-aca4-1f64de1f8f0f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:50.878656 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd34a79-b46b-46eb-a4a6-429473332260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:50.879288 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd34a79-b46b-46eb-a4a6-429473332260 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:50.879571 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd34a79-b46b-46eb-a4a6-429473332260 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:50.879874 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd34a79-b46b-46eb-a4a6-429473332260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:50.891730 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd34a79-b46b-46eb-a4a6-429473332260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:50.893947 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd34a79-b46b-46eb-a4a6-429473332260 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:50.905438 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1435/2890] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:43:51.240153 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c84b99-5a5f-4585-85a5-b5be3644b01b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:51.242815 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-07c84b99-5a5f-4585-85a5-b5be3644b01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:51.266088 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c84b99-5a5f-4585-85a5-b5be3644b01b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:51.275061 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a26d9-4ae4-426c-951b-e5c8c678a45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:51.276173 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a26d9-4ae4-426c-951b-e5c8c678a45a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:51.276720 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a26d9-4ae4-426c-951b-e5c8c678a45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:51.277223 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a26d9-4ae4-426c-951b-e5c8c678a45a admin admin] PATH_INFO: `/v3/projects/52b5fba178db423ab17bbc45a9e03080` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:51.279317 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a26d9-4ae4-426c-951b-e5c8c678a45a admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b5fba178db423ab17bbc45a9e03080)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:51.283202 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a26d9-4ae4-426c-951b-e5c8c678a45a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:51.342646 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:51.359337 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b24a26d9-4ae4-426c-951b-e5c8c678a45a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b5fba178db423ab17bbc45a9e03080', 'request_id': 'req-b24a26d9-4ae4-426c-951b-e5c8c678a45a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:51.366627 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b24a26d9-4ae4-426c-951b-e5c8c678a45a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b5fba178db423ab17bbc45a9e03080', 'request_id': 'req-b24a26d9-4ae4-426c-951b-e5c8c678a45a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:51.375744 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b24a26d9-4ae4-426c-951b-e5c8c678a45a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b5fba178db423ab17bbc45a9e03080', 'request_id': 'req-b24a26d9-4ae4-426c-951b-e5c8c678a45a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:51.389314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b24a26d9-4ae4-426c-951b-e5c8c678a45a admin admin] The token cache is being invalidate because project 52b5fba178db423ab17bbc45a9e03080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:51.389592 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b24a26d9-4ae4-426c-951b-e5c8c678a45a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:51.390350 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b24a26d9-4ae4-426c-951b-e5c8c678a45a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:51.392526 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1456/2891] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:51 2022] DELETE /identity/v3/projects/52b5fba178db423ab17bbc45a9e03080 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:51.397553 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd34a79-b46b-46eb-a4a6-429473332260 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:51.408083 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd34a79-b46b-46eb-a4a6-429473332260 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:51.478032 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb826758-8ca5-49c2-8b2b-460c0d037fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:51.478975 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb826758-8ca5-49c2-8b2b-460c0d037fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:51.479290 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb826758-8ca5-49c2-8b2b-460c0d037fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:51.479623 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb826758-8ca5-49c2-8b2b-460c0d037fa9 admin admin] PATH_INFO: `/v3/users/1aa2dbe2fa4b4897887fae22803ee194` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:51.481188 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb826758-8ca5-49c2-8b2b-460c0d037fa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aa2dbe2fa4b4897887fae22803ee194)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:51.483270 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb826758-8ca5-49c2-8b2b-460c0d037fa9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:51.543547 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cb826758-8ca5-49c2-8b2b-460c0d037fa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aa2dbe2fa4b4897887fae22803ee194'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:51.558669 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cb826758-8ca5-49c2-8b2b-460c0d037fa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aa2dbe2fa4b4897887fae22803ee194'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:51.559510 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cb826758-8ca5-49c2-8b2b-460c0d037fa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aa2dbe2fa4b4897887fae22803ee194'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:51.560184 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cb826758-8ca5-49c2-8b2b-460c0d037fa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aa2dbe2fa4b4897887fae22803ee194'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:51.570688 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cb826758-8ca5-49c2-8b2b-460c0d037fa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aa2dbe2fa4b4897887fae22803ee194'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:51.587546 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1436/2892] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:51 2022] DELETE /identity/v3/users/1aa2dbe2fa4b4897887fae22803ee194 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:52.003811 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a26d9-4ae4-426c-951b-e5c8c678a45a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:52.006182 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b24a26d9-4ae4-426c-951b-e5c8c678a45a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:52.029166 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a26d9-4ae4-426c-951b-e5c8c678a45a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:52.105442 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133abf4-2635-4f5d-9e83-43a1e51f590b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:52.106088 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133abf4-2635-4f5d-9e83-43a1e51f590b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:52.106363 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133abf4-2635-4f5d-9e83-43a1e51f590b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:52.106634 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133abf4-2635-4f5d-9e83-43a1e51f590b admin admin] PATH_INFO: `/v3/projects/2847c3a127c54f6dbe188349e1713edf` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:52.107823 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8133abf4-2635-4f5d-9e83-43a1e51f590b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2847c3a127c54f6dbe188349e1713edf)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:52.109810 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8133abf4-2635-4f5d-9e83-43a1e51f590b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:52.166330 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8133abf4-2635-4f5d-9e83-43a1e51f590b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2847c3a127c54f6dbe188349e1713edf', 'request_id': 'req-8133abf4-2635-4f5d-9e83-43a1e51f590b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:52.173354 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8133abf4-2635-4f5d-9e83-43a1e51f590b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2847c3a127c54f6dbe188349e1713edf', 'request_id': 'req-8133abf4-2635-4f5d-9e83-43a1e51f590b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:52.182359 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8133abf4-2635-4f5d-9e83-43a1e51f590b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2847c3a127c54f6dbe188349e1713edf', 'request_id': 'req-8133abf4-2635-4f5d-9e83-43a1e51f590b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:52.195845 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8133abf4-2635-4f5d-9e83-43a1e51f590b admin admin] The token cache is being invalidate because project 2847c3a127c54f6dbe188349e1713edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:52.196159 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8133abf4-2635-4f5d-9e83-43a1e51f590b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:52.196901 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8133abf4-2635-4f5d-9e83-43a1e51f590b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:52.198569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1457/2893] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:52 2022] DELETE /identity/v3/projects/2847c3a127c54f6dbe188349e1713edf => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:52.202862 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb826758-8ca5-49c2-8b2b-460c0d037fa9 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:52.204357 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cb826758-8ca5-49c2-8b2b-460c0d037fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:52.218671 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb826758-8ca5-49c2-8b2b-460c0d037fa9 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:52.237362 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:52.284068 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82e183-4cda-4f7d-893a-d68c7e2fc389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:52.284757 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82e183-4cda-4f7d-893a-d68c7e2fc389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:52.285038 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82e183-4cda-4f7d-893a-d68c7e2fc389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:52.285312 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82e183-4cda-4f7d-893a-d68c7e2fc389 admin admin] PATH_INFO: `/v3/users/d64641912b7b41c9806816fc309d5329` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:52.286507 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82e183-4cda-4f7d-893a-d68c7e2fc389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d64641912b7b41c9806816fc309d5329)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:52.288469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82e183-4cda-4f7d-893a-d68c7e2fc389 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:52.347901 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6c82e183-4cda-4f7d-893a-d68c7e2fc389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd64641912b7b41c9806816fc309d5329'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:52.376279 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6c82e183-4cda-4f7d-893a-d68c7e2fc389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd64641912b7b41c9806816fc309d5329'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:52.378046 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6c82e183-4cda-4f7d-893a-d68c7e2fc389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd64641912b7b41c9806816fc309d5329'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:52.379064 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6c82e183-4cda-4f7d-893a-d68c7e2fc389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd64641912b7b41c9806816fc309d5329'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:52.392342 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6c82e183-4cda-4f7d-893a-d68c7e2fc389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd64641912b7b41c9806816fc309d5329'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:52.407907 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1437/2894] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:52 2022] DELETE /identity/v3/users/d64641912b7b41c9806816fc309d5329 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:52.771422 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133abf4-2635-4f5d-9e83-43a1e51f590b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:52.773371 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8133abf4-2635-4f5d-9e83-43a1e51f590b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:52.797746 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133abf4-2635-4f5d-9e83-43a1e51f590b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:52.888715 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:52.915429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314cd47-9721-4e4a-82ed-0aef3cb8338d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:52.916460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314cd47-9721-4e4a-82ed-0aef3cb8338d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:52.916994 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314cd47-9721-4e4a-82ed-0aef3cb8338d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:52.917520 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314cd47-9721-4e4a-82ed-0aef3cb8338d admin admin] PATH_INFO: `/v3/projects/b69e692a0b7d433b82afd278e7f8e407` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:52.919390 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314cd47-9721-4e4a-82ed-0aef3cb8338d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b69e692a0b7d433b82afd278e7f8e407)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:52.922776 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314cd47-9721-4e4a-82ed-0aef3cb8338d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:52.993111 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e314cd47-9721-4e4a-82ed-0aef3cb8338d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b69e692a0b7d433b82afd278e7f8e407', 'request_id': 'req-e314cd47-9721-4e4a-82ed-0aef3cb8338d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:53.001866 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e314cd47-9721-4e4a-82ed-0aef3cb8338d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b69e692a0b7d433b82afd278e7f8e407', 'request_id': 'req-e314cd47-9721-4e4a-82ed-0aef3cb8338d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:53.015006 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e314cd47-9721-4e4a-82ed-0aef3cb8338d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b69e692a0b7d433b82afd278e7f8e407', 'request_id': 'req-e314cd47-9721-4e4a-82ed-0aef3cb8338d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:53.038351 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e314cd47-9721-4e4a-82ed-0aef3cb8338d admin admin] The token cache is being invalidate because project b69e692a0b7d433b82afd278e7f8e407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:53.038967 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e314cd47-9721-4e4a-82ed-0aef3cb8338d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:53.040460 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e314cd47-9721-4e4a-82ed-0aef3cb8338d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:53.043919 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1458/2895] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:52 2022] DELETE /identity/v3/projects/b69e692a0b7d433b82afd278e7f8e407 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:53.062007 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1a18a-b2b8-47f4-9db7-dd0769fc27a4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:53.062636 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1a18a-b2b8-47f4-9db7-dd0769fc27a4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:53.062796 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1a18a-b2b8-47f4-9db7-dd0769fc27a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:53.096209 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-7dd1a18a-b2b8-47f4-9db7-dd0769fc27a4 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:53.098878 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7dd1a18a-b2b8-47f4-9db7-dd0769fc27a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:53.201667 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1438/2896] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:53.212371 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f1b53-40f1-42b7-8fe3-21c500b8e1c8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:53.213235 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f1b53-40f1-42b7-8fe3-21c500b8e1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:53.213554 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f1b53-40f1-42b7-8fe3-21c500b8e1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:53.256558 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ae4f1b53-40f1-42b7-8fe3-21c500b8e1c8 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:53.258282 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ae4f1b53-40f1-42b7-8fe3-21c500b8e1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:53.272373 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1459/2897] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:53.277531 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1a18a-b2b8-47f4-9db7-dd0769fc27a4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:53.294714 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1a18a-b2b8-47f4-9db7-dd0769fc27a4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:53.306249 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec13e5a-f2b9-4964-86b3-b649fb9767d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:53.307337 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec13e5a-f2b9-4964-86b3-b649fb9767d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:53.307885 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec13e5a-f2b9-4964-86b3-b649fb9767d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:53.308532 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec13e5a-f2b9-4964-86b3-b649fb9767d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:53.309874 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec13e5a-f2b9-4964-86b3-b649fb9767d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:53.310479 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec13e5a-f2b9-4964-86b3-b649fb9767d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:53.319425 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec13e5a-f2b9-4964-86b3-b649fb9767d0 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:53.341174 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1439/2898] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:43:53.345624 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f1b53-40f1-42b7-8fe3-21c500b8e1c8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:53.356698 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f1b53-40f1-42b7-8fe3-21c500b8e1c8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:53.362796 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf81f8b-139a-473e-bdb7-885c7308762f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:53.363604 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf81f8b-139a-473e-bdb7-885c7308762f admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:53.364010 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf81f8b-139a-473e-bdb7-885c7308762f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:53.364314 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf81f8b-139a-473e-bdb7-885c7308762f admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:53.365027 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf81f8b-139a-473e-bdb7-885c7308762f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:53.367049 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf81f8b-139a-473e-bdb7-885c7308762f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:53.403146 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1460/2899] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:53 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:53.407615 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec13e5a-f2b9-4964-86b3-b649fb9767d0 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:53.419273 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec13e5a-f2b9-4964-86b3-b649fb9767d0 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:53.455992 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:53.513857 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a9afc-7618-45d2-8dd7-63b10a0b8264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:53.514368 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a9afc-7618-45d2-8dd7-63b10a0b8264 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:53.514648 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a9afc-7618-45d2-8dd7-63b10a0b8264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:53.514921 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a9afc-7618-45d2-8dd7-63b10a0b8264 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:53.515588 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a9afc-7618-45d2-8dd7-63b10a0b8264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:53.518400 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a9afc-7618-45d2-8dd7-63b10a0b8264 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:53.545293 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1440/2900] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:53 2022] POST /identity/v3/users => generated 286 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:53.549346 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf81f8b-139a-473e-bdb7-885c7308762f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:53.561154 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf81f8b-139a-473e-bdb7-885c7308762f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:53.567206 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5c957-a775-4fa7-a64c-782b28c59f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:53.567856 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5c957-a775-4fa7-a64c-782b28c59f29 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:53.568184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5c957-a775-4fa7-a64c-782b28c59f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:53.568475 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5c957-a775-4fa7-a64c-782b28c59f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:53.569975 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5c957-a775-4fa7-a64c-782b28c59f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:53.571699 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5c957-a775-4fa7-a64c-782b28c59f29 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:53.583946 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1461/2901] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:53.590312 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a9afc-7618-45d2-8dd7-63b10a0b8264 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:53.609308 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a9afc-7618-45d2-8dd7-63b10a0b8264 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:53.617466 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3987d-05ad-44bb-a22b-1aac512a6653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:53.618507 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3987d-05ad-44bb-a22b-1aac512a6653 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:53.618978 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3987d-05ad-44bb-a22b-1aac512a6653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:53.619462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3987d-05ad-44bb-a22b-1aac512a6653 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:53.620707 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3987d-05ad-44bb-a22b-1aac512a6653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:53.623904 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3987d-05ad-44bb-a22b-1aac512a6653 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:53.645116 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1441/2902] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:53.649661 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5c957-a775-4fa7-a64c-782b28c59f29 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:53.661131 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5c957-a775-4fa7-a64c-782b28c59f29 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:53.666270 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a62424-b725-4729-8891-bfd4c00d6240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:53.666982 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a62424-b725-4729-8891-bfd4c00d6240 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:53.667260 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a62424-b725-4729-8891-bfd4c00d6240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:53.667558 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a62424-b725-4729-8891-bfd4c00d6240 admin admin] PATH_INFO: `/v3/projects/91c93ab9e7524aefa7d5d8f8317586e0/users/6afcc5a6ee3c4f0fb4c76513cf09b921/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:53.685424 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a62424-b725-4729-8891-bfd4c00d6240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91c93ab9e7524aefa7d5d8f8317586e0, user_id=6afcc5a6ee3c4f0fb4c76513cf09b921, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:53.688368 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a62424-b725-4729-8891-bfd4c00d6240 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:53.705531 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1462/2903] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:53 2022] PUT /identity/v3/projects/91c93ab9e7524aefa7d5d8f8317586e0/users/6afcc5a6ee3c4f0fb4c76513cf09b921/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:53.777092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68fbd3-fedd-4f2d-83f3-6a6cae164c6c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:53.777092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68fbd3-fedd-4f2d-83f3-6a6cae164c6c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:53.777753 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68fbd3-fedd-4f2d-83f3-6a6cae164c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:53.810276 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8a68fbd3-fedd-4f2d-83f3-6a6cae164c6c None None] MFA Rules not processed for user `6afcc5a6ee3c4f0fb4c76513cf09b921`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:53.811608 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8a68fbd3-fedd-4f2d-83f3-6a6cae164c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:53.914492 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1442/2904] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:53.929170 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a62424-b725-4729-8891-bfd4c00d6240 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:53.931423 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-68a62424-b725-4729-8891-bfd4c00d6240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:54.004917 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a62424-b725-4729-8891-bfd4c00d6240 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:54.008882 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37706dec-46e1-463b-9b7c-779b9a224ad1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:54.009509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37706dec-46e1-463b-9b7c-779b9a224ad1 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:54.009786 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37706dec-46e1-463b-9b7c-779b9a224ad1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:54.010059 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37706dec-46e1-463b-9b7c-779b9a224ad1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:54.020701 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37706dec-46e1-463b-9b7c-779b9a224ad1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:54.022184 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37706dec-46e1-463b-9b7c-779b9a224ad1 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:54.032953 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1463/2905] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:43:54.071850 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68fbd3-fedd-4f2d-83f3-6a6cae164c6c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:54.176545 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68fbd3-fedd-4f2d-83f3-6a6cae164c6c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:54.182099 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df18751-66c9-48d0-b208-3216148d41df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:54.182843 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df18751-66c9-48d0-b208-3216148d41df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:54.183126 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df18751-66c9-48d0-b208-3216148d41df admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:54.183421 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df18751-66c9-48d0-b208-3216148d41df admin admin] PATH_INFO: `/v3/users/6afcc5a6ee3c4f0fb4c76513cf09b921` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:54.184770 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df18751-66c9-48d0-b208-3216148d41df admin admin] RBAC: Authorizing `identity:delete_user(user_id=6afcc5a6ee3c4f0fb4c76513cf09b921)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:54.186908 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df18751-66c9-48d0-b208-3216148d41df admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:54.241948 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:54.256512 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5df18751-66c9-48d0-b208-3216148d41df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6afcc5a6ee3c4f0fb4c76513cf09b921'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.272400 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5df18751-66c9-48d0-b208-3216148d41df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6afcc5a6ee3c4f0fb4c76513cf09b921'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.273226 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5df18751-66c9-48d0-b208-3216148d41df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6afcc5a6ee3c4f0fb4c76513cf09b921'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.273868 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5df18751-66c9-48d0-b208-3216148d41df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6afcc5a6ee3c4f0fb4c76513cf09b921'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.283499 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5df18751-66c9-48d0-b208-3216148d41df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6afcc5a6ee3c4f0fb4c76513cf09b921'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.302092 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1443/2906] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:54 2022] DELETE /identity/v3/users/6afcc5a6ee3c4f0fb4c76513cf09b921 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:54.308943 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd8924-aa40-412c-aa12-cd102adc4232 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:54.309437 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd8924-aa40-412c-aa12-cd102adc4232 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:54.309946 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd8924-aa40-412c-aa12-cd102adc4232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:54.344822 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-dabd8924-aa40-412c-aa12-cd102adc4232 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:54.347576 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dabd8924-aa40-412c-aa12-cd102adc4232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:54.373893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:54.453008 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1464/2907] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:54.467492 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df18751-66c9-48d0-b208-3216148d41df admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:54.469845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5df18751-66c9-48d0-b208-3216148d41df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:54.590387 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df18751-66c9-48d0-b208-3216148d41df admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:54.597746 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154facd-272f-432d-8f21-037f22717bb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:54.598692 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154facd-272f-432d-8f21-037f22717bb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:54.599193 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154facd-272f-432d-8f21-037f22717bb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:54.599662 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154facd-272f-432d-8f21-037f22717bb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:54.617567 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154facd-272f-432d-8f21-037f22717bb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:54.619198 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154facd-272f-432d-8f21-037f22717bb5 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:54.635072 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1444/2908] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:55.094674 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd8924-aa40-412c-aa12-cd102adc4232 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:55.097805 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dabd8924-aa40-412c-aa12-cd102adc4232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:55.117012 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd8924-aa40-412c-aa12-cd102adc4232 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:55.125509 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6b761-5f11-4e54-a73a-9e2a46c49231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:55.127081 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6b761-5f11-4e54-a73a-9e2a46c49231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:55.128107 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6b761-5f11-4e54-a73a-9e2a46c49231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:55.128679 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6b761-5f11-4e54-a73a-9e2a46c49231 admin admin] PATH_INFO: `/v3/projects/91c93ab9e7524aefa7d5d8f8317586e0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:55.131352 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6b761-5f11-4e54-a73a-9e2a46c49231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91c93ab9e7524aefa7d5d8f8317586e0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:55.134673 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6b761-5f11-4e54-a73a-9e2a46c49231 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:55.196706 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-15f6b761-5f11-4e54-a73a-9e2a46c49231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91c93ab9e7524aefa7d5d8f8317586e0', 'request_id': 'req-15f6b761-5f11-4e54-a73a-9e2a46c49231'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.206556 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-15f6b761-5f11-4e54-a73a-9e2a46c49231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91c93ab9e7524aefa7d5d8f8317586e0', 'request_id': 'req-15f6b761-5f11-4e54-a73a-9e2a46c49231'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.215900 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-15f6b761-5f11-4e54-a73a-9e2a46c49231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91c93ab9e7524aefa7d5d8f8317586e0', 'request_id': 'req-15f6b761-5f11-4e54-a73a-9e2a46c49231'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.231011 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-15f6b761-5f11-4e54-a73a-9e2a46c49231 admin admin] The token cache is being invalidate because project 91c93ab9e7524aefa7d5d8f8317586e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:55.231324 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-15f6b761-5f11-4e54-a73a-9e2a46c49231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.232119 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-15f6b761-5f11-4e54-a73a-9e2a46c49231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.233919 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1465/2909] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:55 2022] DELETE /identity/v3/projects/91c93ab9e7524aefa7d5d8f8317586e0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:55.240226 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b58380-eea3-4b8c-8943-acc3394ed987 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:55.241136 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b58380-eea3-4b8c-8943-acc3394ed987 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:55.241282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b58380-eea3-4b8c-8943-acc3394ed987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:55.268462 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-25b58380-eea3-4b8c-8943-acc3394ed987 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:55.270060 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-25b58380-eea3-4b8c-8943-acc3394ed987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:55.384100 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1445/2910] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:55.395567 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50671118-3f5e-403d-a38b-791ad2789b11 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:55.396126 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50671118-3f5e-403d-a38b-791ad2789b11 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:55.396648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50671118-3f5e-403d-a38b-791ad2789b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:55.431601 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-50671118-3f5e-403d-a38b-791ad2789b11 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:55.433789 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-50671118-3f5e-403d-a38b-791ad2789b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:55.449128 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1466/2911] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:55.454068 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b58380-eea3-4b8c-8943-acc3394ed987 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:55.473039 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b58380-eea3-4b8c-8943-acc3394ed987 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:55.481244 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0cda9-63e8-4ae2-938e-75393eafa4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:55.482341 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0cda9-63e8-4ae2-938e-75393eafa4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:55.482840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0cda9-63e8-4ae2-938e-75393eafa4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:55.483340 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0cda9-63e8-4ae2-938e-75393eafa4f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:55.484654 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0cda9-63e8-4ae2-938e-75393eafa4f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:55.485177 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0cda9-63e8-4ae2-938e-75393eafa4f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:55.488867 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0cda9-63e8-4ae2-938e-75393eafa4f0 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:55.513707 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1446/2912] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:43:55.519254 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50671118-3f5e-403d-a38b-791ad2789b11 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:55.533763 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50671118-3f5e-403d-a38b-791ad2789b11 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:55.542226 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271a70a-0165-44ca-b57f-771d62e5ff2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:55.543207 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271a70a-0165-44ca-b57f-771d62e5ff2e admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:55.543701 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271a70a-0165-44ca-b57f-771d62e5ff2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:55.544130 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271a70a-0165-44ca-b57f-771d62e5ff2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:55.545755 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271a70a-0165-44ca-b57f-771d62e5ff2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:55.550093 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271a70a-0165-44ca-b57f-771d62e5ff2e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:55.595359 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1467/2913] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:55 2022] POST /identity/v3/projects => generated 397 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:55.601266 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0cda9-63e8-4ae2-938e-75393eafa4f0 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:55.616252 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0cda9-63e8-4ae2-938e-75393eafa4f0 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:55.688254 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:55.717552 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c6e3f-4c2c-4552-8931-7c9c2a81d84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:55.718605 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c6e3f-4c2c-4552-8931-7c9c2a81d84a admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:55.719088 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c6e3f-4c2c-4552-8931-7c9c2a81d84a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:55.719571 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c6e3f-4c2c-4552-8931-7c9c2a81d84a admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:55.720778 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c6e3f-4c2c-4552-8931-7c9c2a81d84a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:55.725229 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c6e3f-4c2c-4552-8931-7c9c2a81d84a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:55.753402 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1447/2914] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:55 2022] POST /identity/v3/users => generated 299 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:55.757910 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271a70a-0165-44ca-b57f-771d62e5ff2e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:55.769920 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271a70a-0165-44ca-b57f-771d62e5ff2e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:55.776490 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01737f8f-23f7-40ab-9d69-946d23536fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:55.777275 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01737f8f-23f7-40ab-9d69-946d23536fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:55.777614 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01737f8f-23f7-40ab-9d69-946d23536fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:55.777936 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01737f8f-23f7-40ab-9d69-946d23536fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:55.778658 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01737f8f-23f7-40ab-9d69-946d23536fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:55.780372 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01737f8f-23f7-40ab-9d69-946d23536fe4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:55.795337 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1468/2915] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:55.801066 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c6e3f-4c2c-4552-8931-7c9c2a81d84a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:55.813172 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c6e3f-4c2c-4552-8931-7c9c2a81d84a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:55.818903 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc0fd2-124c-4a0d-bc4a-e847057f39c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:55.819664 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc0fd2-124c-4a0d-bc4a-e847057f39c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:55.820041 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc0fd2-124c-4a0d-bc4a-e847057f39c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:55.820411 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc0fd2-124c-4a0d-bc4a-e847057f39c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:55.821309 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc0fd2-124c-4a0d-bc4a-e847057f39c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:55.823573 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc0fd2-124c-4a0d-bc4a-e847057f39c9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:55.837575 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1448/2916] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:55.843853 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01737f8f-23f7-40ab-9d69-946d23536fe4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:55.858179 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01737f8f-23f7-40ab-9d69-946d23536fe4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:55.866689 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a527dc-91d8-469a-b4c3-ed0b4e147a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:55.867915 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a527dc-91d8-469a-b4c3-ed0b4e147a1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:55.868419 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a527dc-91d8-469a-b4c3-ed0b4e147a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:55.868982 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a527dc-91d8-469a-b4c3-ed0b4e147a1a admin admin] PATH_INFO: `/v3/projects/b8b88ec22f8b45b28413e9e4bbef95bb/users/fb32017d1a5d4027a824ce2c04cbf64f/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:55.897330 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a527dc-91d8-469a-b4c3-ed0b4e147a1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b88ec22f8b45b28413e9e4bbef95bb, user_id=fb32017d1a5d4027a824ce2c04cbf64f, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:55.902120 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a527dc-91d8-469a-b4c3-ed0b4e147a1a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:55.926743 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1469/2917] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:55 2022] PUT /identity/v3/projects/b8b88ec22f8b45b28413e9e4bbef95bb/users/fb32017d1a5d4027a824ce2c04cbf64f/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:55.946451 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e8727-7b47-4fee-8187-c325805706d6 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:55.946868 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e8727-7b47-4fee-8187-c325805706d6 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:55.947469 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e8727-7b47-4fee-8187-c325805706d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:55.990475 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c22e8727-7b47-4fee-8187-c325805706d6 None None] MFA Rules not processed for user `fb32017d1a5d4027a824ce2c04cbf64f`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:55.991831 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c22e8727-7b47-4fee-8187-c325805706d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:56.115735 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1449/2918] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:43:55 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:56.138140 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a527dc-91d8-469a-b4c3-ed0b4e147a1a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:56.141303 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e0a527dc-91d8-469a-b4c3-ed0b4e147a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:56.197379 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:56.219943 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a527dc-91d8-469a-b4c3-ed0b4e147a1a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:56.225857 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc83c7-c200-40dd-99e0-a9fe19328103 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80a92eaeb5c54414864deef3052bd8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:56.226648 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc83c7-c200-40dd-99e0-a9fe19328103 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:56.227032 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc83c7-c200-40dd-99e0-a9fe19328103 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:56.227409 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc83c7-c200-40dd-99e0-a9fe19328103 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:56.240343 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc83c7-c200-40dd-99e0-a9fe19328103 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:56.242394 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc83c7-c200-40dd-99e0-a9fe19328103 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:56.254396 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1470/2919] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:56 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:44:00.841531 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e8727-7b47-4fee-8187-c325805706d6 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:00.843863 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c22e8727-7b47-4fee-8187-c325805706d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:00.950449 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e8727-7b47-4fee-8187-c325805706d6 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:00.958753 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c6410-dd4c-4fa0-b9e5-1f0d13964c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:00.959877 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c6410-dd4c-4fa0-b9e5-1f0d13964c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:00.960351 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c6410-dd4c-4fa0-b9e5-1f0d13964c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:00.960895 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c6410-dd4c-4fa0-b9e5-1f0d13964c47 admin admin] PATH_INFO: `/v3/users/a5903f692c0e4008a7bcbd0b0a570649` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:00.962978 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c6410-dd4c-4fa0-b9e5-1f0d13964c47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5903f692c0e4008a7bcbd0b0a570649)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:00.966728 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c6410-dd4c-4fa0-b9e5-1f0d13964c47 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:01.053415 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fc7c6410-dd4c-4fa0-b9e5-1f0d13964c47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5903f692c0e4008a7bcbd0b0a570649'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:01.063301 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:01.076063 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fc7c6410-dd4c-4fa0-b9e5-1f0d13964c47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5903f692c0e4008a7bcbd0b0a570649'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:01.077413 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fc7c6410-dd4c-4fa0-b9e5-1f0d13964c47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5903f692c0e4008a7bcbd0b0a570649'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:01.078517 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fc7c6410-dd4c-4fa0-b9e5-1f0d13964c47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5903f692c0e4008a7bcbd0b0a570649'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:01.091480 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fc7c6410-dd4c-4fa0-b9e5-1f0d13964c47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5903f692c0e4008a7bcbd0b0a570649'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:01.109114 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1450/2920] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:44:00 2022] DELETE /identity/v3/users/a5903f692c0e4008a7bcbd0b0a570649 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:01.116147 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6c6b1-dd77-4e4b-b476-21864c6021c7 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:01.116819 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6c6b1-dd77-4e4b-b476-21864c6021c7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:01.116819 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6c6b1-dd77-4e4b-b476-21864c6021c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:01.139949 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-66e6c6b1-dd77-4e4b-b476-21864c6021c7 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:01.141548 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-66e6c6b1-dd77-4e4b-b476-21864c6021c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:01.221995 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1471/2921] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:44:01.233478 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c6410-dd4c-4fa0-b9e5-1f0d13964c47 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:01.235807 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fc7c6410-dd4c-4fa0-b9e5-1f0d13964c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:01.314845 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c6410-dd4c-4fa0-b9e5-1f0d13964c47 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:01.319187 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c647ba-9bc6-41b6-b050-63ca366ff90f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:01.319826 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c647ba-9bc6-41b6-b050-63ca366ff90f service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:01.320110 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c647ba-9bc6-41b6-b050-63ca366ff90f service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:01.320389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c647ba-9bc6-41b6-b050-63ca366ff90f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:01.331571 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c647ba-9bc6-41b6-b050-63ca366ff90f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:01.333113 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c647ba-9bc6-41b6-b050-63ca366ff90f service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:01.344267 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1451/2922] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:44:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:44:01.535429 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6c6b1-dd77-4e4b-b476-21864c6021c7 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:01.538257 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-66e6c6b1-dd77-4e4b-b476-21864c6021c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:01.561063 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6c6b1-dd77-4e4b-b476-21864c6021c7 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:01.569825 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8457fd-01df-42aa-89c4-48cf1d2c217c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:01.570971 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8457fd-01df-42aa-89c4-48cf1d2c217c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:01.571504 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8457fd-01df-42aa-89c4-48cf1d2c217c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:01.571978 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8457fd-01df-42aa-89c4-48cf1d2c217c admin admin] PATH_INFO: `/v3/users/fb32017d1a5d4027a824ce2c04cbf64f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:01.574135 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8457fd-01df-42aa-89c4-48cf1d2c217c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb32017d1a5d4027a824ce2c04cbf64f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:01.577967 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8457fd-01df-42aa-89c4-48cf1d2c217c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:01.658293 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2f8457fd-01df-42aa-89c4-48cf1d2c217c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb32017d1a5d4027a824ce2c04cbf64f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:01.679935 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2f8457fd-01df-42aa-89c4-48cf1d2c217c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb32017d1a5d4027a824ce2c04cbf64f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:01.681210 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2f8457fd-01df-42aa-89c4-48cf1d2c217c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb32017d1a5d4027a824ce2c04cbf64f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:01.694187 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2f8457fd-01df-42aa-89c4-48cf1d2c217c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb32017d1a5d4027a824ce2c04cbf64f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:01.705501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2f8457fd-01df-42aa-89c4-48cf1d2c217c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb32017d1a5d4027a824ce2c04cbf64f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:01.718103 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1472/2923] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:44:01 2022] DELETE /identity/v3/users/fb32017d1a5d4027a824ce2c04cbf64f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:01.719270 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c647ba-9bc6-41b6-b050-63ca366ff90f service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:01.720964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-23c647ba-9bc6-41b6-b050-63ca366ff90f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:01.724944 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776db39-06e7-49ed-9a64-a34c13d2edfe None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:01.725676 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776db39-06e7-49ed-9a64-a34c13d2edfe None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:01.726284 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776db39-06e7-49ed-9a64-a34c13d2edfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:01.759769 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c647ba-9bc6-41b6-b050-63ca366ff90f service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:01.760212 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c776db39-06e7-49ed-9a64-a34c13d2edfe None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:01.762721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c776db39-06e7-49ed-9a64-a34c13d2edfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:01.854732 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:01.857445 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51faad37-7f7f-4fc5-bc9c-4e1c2154b0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:01.858349 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51faad37-7f7f-4fc5-bc9c-4e1c2154b0c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:01.858543 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51faad37-7f7f-4fc5-bc9c-4e1c2154b0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:01.858840 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51faad37-7f7f-4fc5-bc9c-4e1c2154b0c8 admin admin] PATH_INFO: `/v3/projects/e9749f8d8e874c5b8fa52f1729192dff` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:01.860495 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51faad37-7f7f-4fc5-bc9c-4e1c2154b0c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9749f8d8e874c5b8fa52f1729192dff)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:01.864024 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51faad37-7f7f-4fc5-bc9c-4e1c2154b0c8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:01.874201 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1473/2924] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:44:01.887432 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776db39-06e7-49ed-9a64-a34c13d2edfe None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:01.889857 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c776db39-06e7-49ed-9a64-a34c13d2edfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:01.933597 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-51faad37-7f7f-4fc5-bc9c-4e1c2154b0c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9749f8d8e874c5b8fa52f1729192dff', 'request_id': 'req-51faad37-7f7f-4fc5-bc9c-4e1c2154b0c8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:01.941666 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-51faad37-7f7f-4fc5-bc9c-4e1c2154b0c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9749f8d8e874c5b8fa52f1729192dff', 'request_id': 'req-51faad37-7f7f-4fc5-bc9c-4e1c2154b0c8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:01.949454 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-51faad37-7f7f-4fc5-bc9c-4e1c2154b0c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9749f8d8e874c5b8fa52f1729192dff', 'request_id': 'req-51faad37-7f7f-4fc5-bc9c-4e1c2154b0c8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:01.974643 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-51faad37-7f7f-4fc5-bc9c-4e1c2154b0c8 admin admin] The token cache is being invalidate because project e9749f8d8e874c5b8fa52f1729192dff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:44:01.975154 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-51faad37-7f7f-4fc5-bc9c-4e1c2154b0c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:01.976292 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-51faad37-7f7f-4fc5-bc9c-4e1c2154b0c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:01.978955 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1452/2925] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:44:01 2022] DELETE /identity/v3/projects/e9749f8d8e874c5b8fa52f1729192dff => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:01.981556 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776db39-06e7-49ed-9a64-a34c13d2edfe None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:01.986936 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04074f1d-53ea-42a1-83ac-65cccf0292f1 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:01.987392 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04074f1d-53ea-42a1-83ac-65cccf0292f1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:01.987882 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04074f1d-53ea-42a1-83ac-65cccf0292f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:02.000922 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:02.025208 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-04074f1d-53ea-42a1-83ac-65cccf0292f1 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:02.029090 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-04074f1d-53ea-42a1-83ac-65cccf0292f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:02.052338 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cca005-3234-4050-8e2b-203165f20645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:02.053613 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cca005-3234-4050-8e2b-203165f20645 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:02.054626 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cca005-3234-4050-8e2b-203165f20645 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:02.055093 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cca005-3234-4050-8e2b-203165f20645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:02.058550 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-67cca005-3234-4050-8e2b-203165f20645 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:02.124982 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1453/2926] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:44:02.141856 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a6ceb-ccf4-4b37-882f-09046dffe74f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:02.142199 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a6ceb-ccf4-4b37-882f-09046dffe74f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:02.143206 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a6ceb-ccf4-4b37-882f-09046dffe74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:02.157664 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cca005-3234-4050-8e2b-203165f20645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:02.160370 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cca005-3234-4050-8e2b-203165f20645 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:02.168586 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a55a6ceb-ccf4-4b37-882f-09046dffe74f None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:02.169976 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a55a6ceb-ccf4-4b37-882f-09046dffe74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:02.173776 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1474/2927] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:44:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:44:02.180402 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1454/2928] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:44:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:44:02.187893 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cca005-3234-4050-8e2b-203165f20645 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:02.205909 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cca005-3234-4050-8e2b-203165f20645 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:02.214547 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364b3dc-5987-487c-b44e-b45f17666ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:02.215597 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364b3dc-5987-487c-b44e-b45f17666ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:02.216086 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364b3dc-5987-487c-b44e-b45f17666ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:02.216577 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364b3dc-5987-487c-b44e-b45f17666ef8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:02.217847 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364b3dc-5987-487c-b44e-b45f17666ef8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:44:02.218394 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364b3dc-5987-487c-b44e-b45f17666ef8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:02.222076 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364b3dc-5987-487c-b44e-b45f17666ef8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:02.244071 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1475/2929] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 1 16:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:44:02.245788 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a6ceb-ccf4-4b37-882f-09046dffe74f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:02.259591 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a6ceb-ccf4-4b37-882f-09046dffe74f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:02.267036 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5d73f-ac66-4349-a0e5-a0de9b51de36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:02.268529 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5d73f-ac66-4349-a0e5-a0de9b51de36 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:02.269050 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5d73f-ac66-4349-a0e5-a0de9b51de36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:02.269483 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5d73f-ac66-4349-a0e5-a0de9b51de36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:02.270346 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5d73f-ac66-4349-a0e5-a0de9b51de36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:02.272964 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5d73f-ac66-4349-a0e5-a0de9b51de36 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:02.313761 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1455/2930] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 1 16:44:02 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:44:02.319961 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364b3dc-5987-487c-b44e-b45f17666ef8 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:02.334900 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364b3dc-5987-487c-b44e-b45f17666ef8 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:02.410033 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:02.427180 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110acfc-8406-4f2d-8f8e-29b20c9cfb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:02.427812 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110acfc-8406-4f2d-8f8e-29b20c9cfb41 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:02.428094 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110acfc-8406-4f2d-8f8e-29b20c9cfb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:02.428371 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110acfc-8406-4f2d-8f8e-29b20c9cfb41 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:02.429100 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110acfc-8406-4f2d-8f8e-29b20c9cfb41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:02.431133 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110acfc-8406-4f2d-8f8e-29b20c9cfb41 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:02.459923 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1476/2931] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 1 16:44:02 2022] POST /identity/v3/users => generated 286 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:44:02.465352 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5d73f-ac66-4349-a0e5-a0de9b51de36 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:02.482439 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5d73f-ac66-4349-a0e5-a0de9b51de36 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:02.490402 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1b13f-d714-4fa6-b000-d145b202f886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:02.491399 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1b13f-d714-4fa6-b000-d145b202f886 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:02.491829 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1b13f-d714-4fa6-b000-d145b202f886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:02.492389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1b13f-d714-4fa6-b000-d145b202f886 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:02.493686 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1b13f-d714-4fa6-b000-d145b202f886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:02.496999 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1b13f-d714-4fa6-b000-d145b202f886 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:02.522079 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1456/2932] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:44:02.524057 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110acfc-8406-4f2d-8f8e-29b20c9cfb41 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:02.543272 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110acfc-8406-4f2d-8f8e-29b20c9cfb41 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:02.550459 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840c824-8d2a-4a7e-ab5e-49c0db0be388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:02.551312 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840c824-8d2a-4a7e-ab5e-49c0db0be388 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:02.551697 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840c824-8d2a-4a7e-ab5e-49c0db0be388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:02.552134 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840c824-8d2a-4a7e-ab5e-49c0db0be388 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:02.552985 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840c824-8d2a-4a7e-ab5e-49c0db0be388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:02.555491 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840c824-8d2a-4a7e-ab5e-49c0db0be388 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:02.573558 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1477/2933] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 1 16:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:44:02.580841 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1b13f-d714-4fa6-b000-d145b202f886 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:02.600282 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1b13f-d714-4fa6-b000-d145b202f886 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:02.609029 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b39c8-9cd5-4ac1-abd4-a0250b68f032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:02.610238 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b39c8-9cd5-4ac1-abd4-a0250b68f032 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:02.610764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b39c8-9cd5-4ac1-abd4-a0250b68f032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:02.611307 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b39c8-9cd5-4ac1-abd4-a0250b68f032 admin admin] PATH_INFO: `/v3/projects/c38c0f8ab8b543c59972d547d34244af/users/ca23aa5a64e943aa80eae046b43d10a2/roles/76a38a2307da45bcb511ef106076613d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:02.638717 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840c824-8d2a-4a7e-ab5e-49c0db0be388 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:02.641984 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5840c824-8d2a-4a7e-ab5e-49c0db0be388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:02.643468 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b39c8-9cd5-4ac1-abd4-a0250b68f032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c38c0f8ab8b543c59972d547d34244af, user_id=ca23aa5a64e943aa80eae046b43d10a2, role_id=76a38a2307da45bcb511ef106076613d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:02.647411 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b39c8-9cd5-4ac1-abd4-a0250b68f032 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:02.668396 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840c824-8d2a-4a7e-ab5e-49c0db0be388 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:02.672695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1457/2934] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 1 16:44:02 2022] PUT /identity/v3/projects/c38c0f8ab8b543c59972d547d34244af/users/ca23aa5a64e943aa80eae046b43d10a2/roles/76a38a2307da45bcb511ef106076613d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:44:02.686677 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db46e2d-5237-41ab-a293-238ca6f0da35 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:02.687150 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db46e2d-5237-41ab-a293-238ca6f0da35 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:02.687623 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db46e2d-5237-41ab-a293-238ca6f0da35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:02.733316 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-0db46e2d-5237-41ab-a293-238ca6f0da35 None None] MFA Rules not processed for user `ca23aa5a64e943aa80eae046b43d10a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:02.734945 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0db46e2d-5237-41ab-a293-238ca6f0da35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:02.781736 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b0ae2-1e0d-46bc-9fb9-cb7156582c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:02.782745 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b0ae2-1e0d-46bc-9fb9-cb7156582c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:02.783240 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b0ae2-1e0d-46bc-9fb9-cb7156582c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:02.783668 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b0ae2-1e0d-46bc-9fb9-cb7156582c11 admin admin] PATH_INFO: `/v3/projects/b8b88ec22f8b45b28413e9e4bbef95bb` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:02.785569 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b0ae2-1e0d-46bc-9fb9-cb7156582c11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8b88ec22f8b45b28413e9e4bbef95bb)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:02.789004 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b0ae2-1e0d-46bc-9fb9-cb7156582c11 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:02.843646 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1458/2935] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:44:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:44:02.857450 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db46e2d-5237-41ab-a293-238ca6f0da35 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:02.859726 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0db46e2d-5237-41ab-a293-238ca6f0da35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:02.865173 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-208b0ae2-1e0d-46bc-9fb9-cb7156582c11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b88ec22f8b45b28413e9e4bbef95bb', 'request_id': 'req-208b0ae2-1e0d-46bc-9fb9-cb7156582c11'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:02.877457 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-208b0ae2-1e0d-46bc-9fb9-cb7156582c11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b88ec22f8b45b28413e9e4bbef95bb', 'request_id': 'req-208b0ae2-1e0d-46bc-9fb9-cb7156582c11'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:02.892538 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-208b0ae2-1e0d-46bc-9fb9-cb7156582c11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b88ec22f8b45b28413e9e4bbef95bb', 'request_id': 'req-208b0ae2-1e0d-46bc-9fb9-cb7156582c11'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:02.912214 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-208b0ae2-1e0d-46bc-9fb9-cb7156582c11 admin admin] The token cache is being invalidate because project b8b88ec22f8b45b28413e9e4bbef95bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:44:02.912576 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-208b0ae2-1e0d-46bc-9fb9-cb7156582c11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:02.913487 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-208b0ae2-1e0d-46bc-9fb9-cb7156582c11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:02.915217 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1478/2936] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:44:02 2022] DELETE /identity/v3/projects/b8b88ec22f8b45b28413e9e4bbef95bb => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:44:02.923506 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:02.974389 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db46e2d-5237-41ab-a293-238ca6f0da35 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:03.075491 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b6be7-2c82-4a10-8a32-cf298be67429 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2feb3132ad9497aaae8720ed170ef3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:03.076584 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b6be7-2c82-4a10-8a32-cf298be67429 service glance] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:03.077161 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b6be7-2c82-4a10-8a32-cf298be67429 service glance] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:03.077619 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b6be7-2c82-4a10-8a32-cf298be67429 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:03.081764 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-dd0b6be7-2c82-4a10-8a32-cf298be67429 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:03.189739 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b6be7-2c82-4a10-8a32-cf298be67429 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:03.191399 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b6be7-2c82-4a10-8a32-cf298be67429 service glance] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:03.209507 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1459/2937] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:44:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:44:12.907721 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=63,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:13.202907 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=54 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:27.699587 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b0ae2-1e0d-46bc-9fb9-cb7156582c11 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:27.701370 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-208b0ae2-1e0d-46bc-9fb9-cb7156582c11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:27.778032 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b0ae2-1e0d-46bc-9fb9-cb7156582c11 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:27.783563 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c75124-4bf5-45da-bde7-dff0eecb12fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:27.784245 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c75124-4bf5-45da-bde7-dff0eecb12fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:27.784519 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c75124-4bf5-45da-bde7-dff0eecb12fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:27.784822 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c75124-4bf5-45da-bde7-dff0eecb12fe admin admin] PATH_INFO: `/v3/users/ca23aa5a64e943aa80eae046b43d10a2` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:27.786034 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c75124-4bf5-45da-bde7-dff0eecb12fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca23aa5a64e943aa80eae046b43d10a2)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:27.788029 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c75124-4bf5-45da-bde7-dff0eecb12fe admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:27.843400 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-90c75124-4bf5-45da-bde7-dff0eecb12fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca23aa5a64e943aa80eae046b43d10a2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:27.857403 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-90c75124-4bf5-45da-bde7-dff0eecb12fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca23aa5a64e943aa80eae046b43d10a2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:27.858168 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-90c75124-4bf5-45da-bde7-dff0eecb12fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca23aa5a64e943aa80eae046b43d10a2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:27.866873 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-90c75124-4bf5-45da-bde7-dff0eecb12fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca23aa5a64e943aa80eae046b43d10a2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:27.875140 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-90c75124-4bf5-45da-bde7-dff0eecb12fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca23aa5a64e943aa80eae046b43d10a2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:27.883024 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1479/2938] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 1 16:44:27 2022] DELETE /identity/v3/users/ca23aa5a64e943aa80eae046b43d10a2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:27.888105 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7f419-876e-463d-8064-7b9687047ad4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:27.888990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7f419-876e-463d-8064-7b9687047ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:27.888990 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7f419-876e-463d-8064-7b9687047ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:27.911116 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-32e7f419-876e-463d-8064-7b9687047ad4 None None] MFA Rules not processed for user `2b43f72ae2234a7eb9bf83a968fd7292`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:27.912451 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-32e7f419-876e-463d-8064-7b9687047ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:27.981442 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1460/2939] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 1 16:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:44:27.992380 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c75124-4bf5-45da-bde7-dff0eecb12fe admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:27.994100 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-90c75124-4bf5-45da-bde7-dff0eecb12fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:28.061578 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c75124-4bf5-45da-bde7-dff0eecb12fe admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:28.065694 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5570df-13d4-4b15-a403-5872a3f7a248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0668b918bf2c49c2901838cd22770030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:28.066318 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5570df-13d4-4b15-a403-5872a3f7a248 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:28.066596 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5570df-13d4-4b15-a403-5872a3f7a248 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:28.066873 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5570df-13d4-4b15-a403-5872a3f7a248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:28.077200 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5570df-13d4-4b15-a403-5872a3f7a248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:28.079668 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5570df-13d4-4b15-a403-5872a3f7a248 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:28.091545 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1480/2940] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:44:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:44:28.432192 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7f419-876e-463d-8064-7b9687047ad4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:28.434695 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-32e7f419-876e-463d-8064-7b9687047ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:28.453437 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7f419-876e-463d-8064-7b9687047ad4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:28.459889 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b55c9-505c-46b3-8a39-19d341ec5159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b43f72ae2234a7eb9bf83a968fd7292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac22d8b2a234cb4ae28b76d9f5e893d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:28.460780 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b55c9-505c-46b3-8a39-19d341ec5159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:28.461176 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b55c9-505c-46b3-8a39-19d341ec5159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:28.461714 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b55c9-505c-46b3-8a39-19d341ec5159 admin admin] PATH_INFO: `/v3/projects/c38c0f8ab8b543c59972d547d34244af` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:28.463083 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b55c9-505c-46b3-8a39-19d341ec5159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c38c0f8ab8b543c59972d547d34244af)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:28.465657 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b55c9-505c-46b3-8a39-19d341ec5159 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:28.547547 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-aa5b55c9-505c-46b3-8a39-19d341ec5159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c38c0f8ab8b543c59972d547d34244af', 'request_id': 'req-aa5b55c9-505c-46b3-8a39-19d341ec5159'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:28.555706 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-aa5b55c9-505c-46b3-8a39-19d341ec5159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c38c0f8ab8b543c59972d547d34244af', 'request_id': 'req-aa5b55c9-505c-46b3-8a39-19d341ec5159'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:28.562479 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-aa5b55c9-505c-46b3-8a39-19d341ec5159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c38c0f8ab8b543c59972d547d34244af', 'request_id': 'req-aa5b55c9-505c-46b3-8a39-19d341ec5159'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:28.579180 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-aa5b55c9-505c-46b3-8a39-19d341ec5159 admin admin] The token cache is being invalidate because project c38c0f8ab8b543c59972d547d34244af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:44:28.579519 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-aa5b55c9-505c-46b3-8a39-19d341ec5159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:28.580154 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-aa5b55c9-505c-46b3-8a39-19d341ec5159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:28.582220 dv-cinder-852209-10-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1461/2941] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 1 16:44:28 2022] DELETE /identity/v3/projects/c38c0f8ab8b543c59972d547d34244af => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:38.086549 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:38.574373 dv-cinder-852209-10-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:02.460048 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5570df-13d4-4b15-a403-5872a3f7a248 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:49:02.461990 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fc5570df-13d4-4b15-a403-5872a3f7a248 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:02.599573 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5570df-13d4-4b15-a403-5872a3f7a248 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:49:02.697203 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9892b7a-07e1-41b8-ac74-900c05e7681b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd64fc190fac540259444a531cdbb8d53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f5c22e38824a8b8dff2f9b4bc1df3f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:49:02.697880 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9892b7a-07e1-41b8-ac74-900c05e7681b service placement] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:49:02.698168 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9892b7a-07e1-41b8-ac74-900c05e7681b service placement] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:49:02.698444 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9892b7a-07e1-41b8-ac74-900c05e7681b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:49:02.700651 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c9892b7a-07e1-41b8-ac74-900c05e7681b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:49:02.716806 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9892b7a-07e1-41b8-ac74-900c05e7681b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:49:02.718501 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9892b7a-07e1-41b8-ac74-900c05e7681b service placement] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:49:02.732966 dv-cinder-852209-10-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1481/2942] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 1 16:49:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:49:12.725831 dv-cinder-852209-10-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=58 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}